Mountain began his career playing in the youth academy of Celtic FC, one of the most successful football clubs in Scotland. He then went on to play for various clubs in the Scottish lower leagues before making the move to England to join Bristol City.