In finite time the trolley would have killed infinite people already on the real track

yes, which means the trolley would have to be traveling faster than the speed of light, or, we have a novel stacking method for fitting infinite numbers of people into a finite amount of train-track space