Palmer made his professional debut for Chelsea in the 2015-2016 season but struggled to break into the first team due to the stiff competition for places. He was subsequently loaned out to Huddersfield Town, where he enjoyed a successful spell, helping the club secure promotion to the Premier League.