Humans are a funny species. We concoct a myriad of rules and regulations (outside of common sense and morality) that we expect everyone around us to conform too and then judge or condemn when people choose to buck the system.
I have harped on this before and will do so again; as long as you are not harming yourself or others in any way, what you do with your life and time is your business. Simple as. Unfortunately, not everyone has the same open mind set as I do and so, rumour mills abound.