Toffolo was born on February 19, 1995, in Welwyn Garden City, England. He began his football career at the youth academy of Norwich City and made his professional debut for the club in 2014. Toffolo was loaned out to various clubs during his time at Norwich City, including Rotherham United, Peterborough United, and Scunthorpe United.