Why would the isolation of Buddhist monks contribute to the religion's decline?

This can be generalized: with isolation, people don't have contact with others, so they can't spread the religion. Because the monks were so isolated, the general population was less involved and didn't find out about the religion as much and people abandoned it and new people didn't join.