Ghost Story is a 1981 American supernatural horror film directed by John Irvin and starring Fred Astaire, Melvyn Douglas, Douglas Fairbanks Jr., John Houseman, Craig Wasson, and Alice Krige. Based on the 1979 novel of the same name by Peter Straub, it follows a group of elderly businessmen in New England who gather to recount their involvement in a woman's death decades prior when one of them suspects her ghost has been haunting him.
https://en.wikipedia.org/wiki/Ghost_Story_(1981_film)
This movie put me off of horror for a long time, when I was a teenager and saw it on early cable TV. It's not gory but mannn, did it scare the bejeezus outta me. Not watching it now still.
I feel you. I watched this movie waaay too young, scared the crap out of me.