After high school, Palmer went on to play college football at the University of Tennessee. He quickly emerged as a key player for the Volunteers and showcased his impressive skill set as a wide receiver. In his senior year, he recorded 33 receptions for 475 yards and four touchdowns.