Dunkley's stay at Fosse was short and sweet - he made eleven appearances in less than a year with the club.

He was a member of Northampton Town's first-ever competitive side before he made the move to Leicester in May 1900, making his debut in September of the same year at home against Stockport County. He couldn't hold on to his place, however, with Tommy Allsopp soon taking it.

It resulted in Albert making a swift return back to Northampton, where he also had a job as a shoe clicker, before moving on to Blackburn Rovers where he enjoyed a brief taste of playing in the top flight. His best season came following a move to Bristol Rovers from Ewood Park, where he was a key cog in Rovers' 1905 Southern League Championship-winning side.

He returned to Northampton for a third time to finish his career but that was cut-short by a career-ending injury, and he went on to work in the pub industry following his retirement from the game.