Richardson began his football career at the high school level, where he excelled as a defensive back. His skills and talent caught the attention of college scouts, and he eventually received a scholarship to play college football at the University of Miami. During his time at Miami, Richardson showcased his speed, agility, and exceptional coverage skills, making him a valuable asset to the team.