My controls go the other way when I use them!

If you go to the Menu (cogwheel icon) when you are using a gun you can select the thumbstick option you prefer. Here you can chose to have them Regular or Inverted.