Pollard began his football career at the University of Memphis, where he quickly made a name for himself as a dynamic playmaker on offense and special teams. During his time at Memphis, Pollard amassed over 2,600 all-purpose yards and scored 25 touchdowns. He was also a two-time first-team all-conference selection in the American Athletic Conference.