In boxing it's height that doesn't matter.
Weight does though. That's why there are weight classes not height classes.
It's all about how hard you can hit and how well you can take a hit.
Some guys are monster punchers in the lower weights but when they move up they're only average. Same thing with speed, punch resistance and stamina.
Your best weight class should be a good balance of all of the above.