Membership, Growth & Digital Transformation · 16 February 2027
A low member satisfaction score is not always the warning sign a board assumes it is, and a board that interprets association member research the same way a consumer business interprets customer satisfaction data is at risk of drawing the wrong conclusion from the right data. This deserves specific, careful attention, particularly given how directly member research connects to the value proposition testing discussed earlier in this quarter.
The Methodological Caveat Most Boards Miss Entirely
Net Promoter Score, the widely used measure asking how likely a member is to recommend the association, has a documented limitation specific to the association sector. In professional bodies and colleges where membership functions as an effective requirement for a given career, a low recommendation score does not necessarily indicate dissatisfaction or churn risk. A member may remain enrolled regardless of how they actually feel, simply because membership is not discretionary, and recommending it to a colleague may not be a meaningful action at all when that colleague already belongs to the same body as a practical necessity. A board treating this the way a retail business treats a low recommendation score, as a direct signal of imminent loss, is drawing a conclusion the data does not actually support in this specific context. A low likelihood to recommend, in a profession where membership is effectively mandatory, may mean nothing more than that recommending isn't a meaningful concept for this member, not that they are quietly planning to leave.
The Bias Problem Every Survey Carries
Survey methodology itself introduces bias worth understanding before acting on results. Low response rates tend to over-represent members with the strongest opinions in either direction, meaning a board may be looking at the views of a vocal minority rather than the membership as a whole. The survey method itself matters too: methods involving direct personal contact tend to produce more favourable responses than anonymous formats, which tend to surface more critical feedback. A board reviewing survey results should ask about response rate and methodology before treating a single score as a reliable verdict on member sentiment.
The Governance Failure That Matters More Than Methodology
The more common and more damaging failure is not methodological. It is running a member survey, collecting feedback, and never visibly acting on it or closing the loop with the members who responded. A survey that produces data nobody uses to change a real decision does not simply waste the effort of running it. It quietly trains members that responding to future research is pointless, degrading response rates and data quality on every subsequent survey the association runs. Every question included should map to a decision the association would make differently depending on the answer. If a question would not change what the organisation does, it does not belong in the survey.
- Interpret recommendation-based metrics specifically in light of whether membership is discretionary for your sector, rather than applying consumer-business benchmarks uncritically.
- Pair any standardised satisfaction or loyalty metric with open-ended diagnostic questions, since the score alone rarely explains why members feel the way they do.
- Assess response rate and survey method honestly before treating results as representative of the full membership, rather than a vocal minority at either extreme.
- Design every survey question to map to an actual decision the association would make differently depending on the answer, cutting anything that would not change a real outcome.
- Close the loop visibly with members after every survey, communicating what was learned and what changed as a result, since this is what determines whether future research efforts actually get engagement.
Member research is one of the most valuable governance tools an association has for testing whether its value proposition and strategic direction match what members experience, connecting directly to the value proposition discussion earlier in this quarter. It is only valuable, however, when the board understands its limitations and commits to actually acting on what it finds.
This is one of the practical governance topics built into our Association CEO course — alongside the papers, tools and frameworks that turn the principle into your board's actual practice. Explore the course →
— Annie