Why doesn't Haymitch think an uprising would work in district 12

For a revolt in District 12 to have any chance, Haymitch says, everyone in the district would have to be involved and District 12 wasn't known for being particularly aggressive with a high chance that many people would refuse to partake in this. They also don't have many people and lack strength in numbers being one of the smaller districts.