McFadden played college football at Clemson University, where he was a standout player for the Tigers. He was a three-year starter at Clemson and earned All-ACC honors during his collegiate career. McFadden declared for the 2022 NFL Draft after his junior season and was selected by the Chargers in the fourth round with the 123rd overall pick.