Atherton began his career at hometown club Rotherham United, where he made his professional debut at the age of 17. He quickly established himself as a solid defender and caught the eye of scouts from bigger clubs. In 1994, Atherton moved to Sheffield Wednesday, where he spent six successful seasons and made over 150 appearances.