I think it is really important for any fighter to find the best gym for them. I spent 2 years at a gym that I felt had terrible energy, and made me hate training. I went to another gym and felt completely revitalized, and was more appreciated there.
Don't waste your time in a gym that is holding you back. Loyalty is important in life, but don't pledge it to someone who doesn't deserve it.