I'm strongly considering veg(etari)anism, but I'm wary of being criticized for it?

Educate yourself so you can respond intelligently to each of their criticisms and defend your choices with facts about any issue they may raise. You have to behave according to your belief system, in spite of others who will challenge you for it.