OK I get what you mean. You want to take photo of what you see and keep it for memory. In that case you can take it the anyway you like. However you wont be able to fully share the feeling of the photo. A good photo makes the viewer feel the atmosphere at the time the photo was taken.
As for me, I walk straight and I always look straight so I actually sees balanced and straight images not tilted. I think most ppl are like me. Ocassionally I do tilt my head to see another perspective but not always. However, there is no right and wrong in arts.