Lidocaine can help, but it will only last for 10 minutes per application.

I used to get cankers all the time, and then I switched to a sensitive toothpaste. If you get them chronically you might want to try a different toothpaste.