Similar demographics can hide different access
Two residents of the same age and neighborhood may differ in language, housing stability, work hours, disability access, or connection to local services. A sample can resemble the population on a few variables while still missing important experiences.
Recruitment through one trusted organization may reach its members well and others poorly.
Review the path into the assessment
- Where were invitations distributed?
- Which languages and formats were available?
- What time, transport, or technology was required?
- Could people contribute privately or outside a group meeting?
- Who declined, and what is known without pressuring them?
Nonparticipation should not be treated as lack of concern.
Weighting has limits
Statistical weights can address aspects of a defined sampling design and some imbalances. They cannot reliably reconstruct every missing experience or repair unknown selection simply because a population total is available.
Let the gap change the claim
Additional outreach may be appropriate, or the report may need a narrower conclusion. State which perspectives are missing and how that affects interpretation.
A credible assessment is not one that claims to have heard everyone. It is one that makes a serious effort to reach relevant groups and remains honest about the people and circumstances its evidence does not adequately describe.
