Caprice began his senior career with Blackpool in 2012, making a handful of appearances before moving on loan to Dagenham & Redbridge in 2013. He then signed with Woking in 2014, where he established himself as a key player over the next two seasons. His performances caught the attention of Leyton Orient, and Caprice joined the club in 2016.