Smart began his football career at Scotlandville Magnet High School in Baton Rouge, where he excelled as a defensive lineman. After high school, Smart went on to play college football for Tulane University in New Orleans. During his time at Tulane, Smart proved himself to be a formidable force on the defensive line, accumulating 165 tackles, 16.5 sacks, and 25 tackles for loss over his four-year collegiate career.