In the late 1800's, why were the union leaders mainly opposed to immigration?

Immigrants at the time we're willing to work in unfit conditions for a lower pay than the union workers. So the immigrants were taking the jobs, leaving fewer jobs available to the union workers, thus causing union opposition to the immigrants.