A lot of Northerners didn't oppose slavery from a moralistic standpoint.

He'll Lincoln was, by definition, a white supremacist. He thought black people could never be equal to white people he just didn't think that meant they should be enslaved.

Also the emancipation proclamation was more about cutting the Souths economy off at the knees than it was about justice.