I too used to believe until one day I realized something. The laws of Thermodynamics. Two specifically, in which energy cannot be created or destroyed just transferred. So if you time travel, unless the process takes away the same amount of energy from the past or future then it would be impossible. If you time travel with a battery into the past you are in turn "Creating energy." Which is impossible. No creation only transference.