Why did non slaveholding whites feel their future were tied to the survival of slavery?

They felt as if they were living the "American Dream." They took satisfaction in their supposed racial superiority, which would be gone if the slaves were released; many of the poorer whites were not economically much better off.