Summers began his football career at TCU (Texas Christian University) where he played college football for the TCU Horned Frogs. As a sophomore, he was named to the All-Big 12 Second Team after recording 121 tackles, four sacks, and eight passes defended. Summers remained a standout player throughout his college career, finishing with 318 tackles, 18.5 tackles for loss, and 10.5 sacks.