Why was it surprising that Robert E. Lee let the confederate army?

Lee believed that slavery was a "moral and political evil".

Because when the Civil War began, Robert E. Lee, the Commander-in-Chief of the Confederation's army, did not own slaves, and General Ulysses Grant, commander of the Norther army, was a slave owner.