Resources · 109

Community polls: interpret who responds and who is missing

Use answers as a documented signal without automatically treating them as the opinion of an entire audience.

· 2 min

Meeting with laptops and notebooks Illustration · fictional scene

What this guide helps achieve

  • Define the target population
  • Test the question
  • Document recruitment
  • Publish counts
  • Choose further verification

Quick check

  • Are many responses enough?
  • Can platforms be added together?

Step-by-step method

  1. 01

    Define the target population

    Separate followers, people exposed to the poll and actual respondents. Record the decision being informed; a community question does not automatically represent all customers.

    Deliverable: population and decision.

  2. 02

    Test the question

    Check neutrality, understanding and mutually exclusive choices. Offer unknown or not-applicable states when relevant; avoid combining two subjects in one option.

    Deliverable: question and comprehension test.

  3. 03

    Document recruitment

    Retain channel, period, invitations and participation rules. Qualify repeated answers and access mechanisms without collecting unnecessary identifiers; inspect lightly exposed groups.

    Deliverable: participation protocol.

  4. 04

    Publish counts

    Show response count, percentage base and missing or excluded answers. Separate observed answers from generalisation; a large voluntary volume does not remove selection bias.

    Deliverable: scoped results.

  5. 05

    Choose further verification

    When a decision affects a wider audience, prepare other recruitment or targeted interviews. Preserve contradictions and limitations; do not present an engagement poll as representative research.

    Deliverable: next steps and inference limits.

Bound conclusions by observed evidence

Check the observed state before choosing next steps.

  1. Respondent preference

    Publish count, base and recruitment.

  2. Lightly exposed group

    Qualify the gap before generalising.

  3. Audience-wide decision

    Prepare appropriate complementary verification.

Reusable worksheet

Complete with your authorised observations. These fields are a working template, not observed results.

FieldInformation to record
QuestionVersion, options and test
ParticipationChannel, period and rules
ResultCount, denominator and limitations

Worked example

Illustrative situation

Illustrative case: highly active members answer a feature question. Occasional users rarely see the invitation.

Decision and expected evidence

Describe respondents’ preference and check less-active users’ needs before a general decision.

Distinguish the mechanisms

MechanismPurposeCheck or limitation
Voluntary pollGather a community signalQualify self-selection
InterviewsUnderstand reasonsDo not infer a proportion
Defined sampleStudy a specified populationInspect recruitment and non-response

Management indicators

IndicatorWhat it measuresFirst action
ScopeResults with an explicit baseCorrect percentages without bases
CoverageTargeted and actually exposed groupsPlan complementary checks

Common pitfalls

  • Confuse volume with representativeness
  • Publish percentages without counts or denominator
  • Add platforms without compatible methods

Frequently asked questions

Are many responses enough?

Volume alone does not correct participant selection. Examine who could see the question and who chose to answer.

Can platforms be added together?

Check question, period, population and repeat participation. Without compatible methods, present results separately.

Official references

References consulted: . The method and worksheet propose checks to adapt to your context; they do not constitute certification.