Depends on the extent of the crime...
This is also what i believe. Something like loaded gloves ala Resto and Margarito should merit HOF prohibition. Here is my take on PEDS and Steroids. I believe that many players and athletes in all sports have tried or experimented with them. Notice my word is many and not most.
Guys like James Toney or Roy Jones are likely Hall of Famers even despite their infractions. Toney being the more severe infraction than Jones as he was found with a more overt banned substance.
In Baseball; guys like Clemens and Bonds are also hall of famers who likely took PEDS. But the question is we can't say for sure when they started or didnt take PEDS. As a result, i think a full banning of the HOF its too severe. Unless, the boxer has been in violation or caught more than 2 times.
But there is a think line between who should be banned or not.