Byers started his youth career at Watford before moving to Premier League side Swansea City in 2016. He spent five years at Swansea, making over 50 appearances for the first team and establishing himself as a key player in the squad. Byers also had loan spells at Scottish club St. Mirren and Portsmouth before joining Blackpool FC in 2021.