In my cursed experience, this pain typically subsides after a few days - however you want to look out for any signs of infection. Typically what happens is a feedback loop between irritation causing swelling causing teeth to move around causing more irritation causing more swelling. Even though over-the-counter pain meds do very little for the pain, you should take ibuprofen to help reduce the swelling (I AM NOT A DOCTOR).

If it is infected, you will need a prescription for antibiotics. Infections can potentially be very dangerous. Without solving the root cause, infection can return down the road, requiring more exotic antibiotics to treat.

I just hat a bunch of teeth yanked after being in the same situation for many years. Death to America.