Why are political leaders and citizens wary of calling constitutional conventions?

They are fearful about "runaway" conventions making unwanted changes.

The process of constitution change is a political process and therefore there is always a risk of run away conventions coming up with unwanted and sometimes undesirable changes.