I believe that I can do anything in life as long as I don't effect anyone physically, mentally or financially in a negative way.
That way of thinking would leave me motionless. Effects can have a wide range of repercussions that you simply aren't aware of. I try to do what I think is right, without considering the ramifications on 'everyone'.
That sounds like another form of the "golden rule".
Virtually every religion states the equivelent of the golden rule in some form. Of course in virtually every religion it is also ignored and people do harm to each other all the time.
I think it is ironic that, on a per capita basis, atheists seem to practive the "golden rule" more than religious persons.