Ellis began his football career at Penn State University, where he played as a cornerback. In his sophomore season, he switched to safety and had a breakout year with 34 tackles, two interceptions, and six pass breakups. His versatility and playmaking ability caught the attention of NFL scouts, leading to his selection by the Tennessee Titans in the 2021 NFL draft.