Loudermilk attended Howard High School and quickly made a name for himself as a standout football player. He later continued his football career at the University of Wisconsin, where he played for the Badgers. During his time at Wisconsin, Loudermilk showcased his skills as a strong and physical defensive end, garnering attention from NFL scouts.