Pattison began his career at Middlesbrough, where he rose through the youth ranks before making his first-team debut in 2017. He made several appearances for the club before going out on loan to Yeovil Town in 2018, where he gained valuable experience and game time.