Miller attended Kathleen High School in Lakeland, Florida, where he played football as a linebacker. After high school, he went on to play college football at the University of Florida. He had a successful college career, recording 113 tackles, 4 sacks, and 2 interceptions in his senior year.