I'm not sure of the reasons why but he did change managers on a number of occasions. Burley was also hindered by the freezing of the belts and I gather he had few fans largely because he was considered boring (although he did have one of the better KO percentages of the period).
Comment