If you're on Android, the simple gallery app on f-droid actually rotates the image. I just rotate it forward, then save, then backwards and save again.

Yep! Cropping an image will work, as it does mean that the file would actually need to have core attributes changed, so your image editor will actually create a new file instead of just adding the instruction telling image viewers to just display it turned.