Publishing limitations alongside research findings

Put a limitation where it changes the reader’s understanding of a finding: in the headline or opening when needed, beside the relevant figure, and in accessible method information. A note at the bottom can provide detail, but it cannot undo an opening that implies a broader or more certain result.

Identify the limit that changes the claim

Compare each proposed finding with the study record. Would readers interpret it differently if they knew participants volunteered, the study covered only one business’s customers, an important group was absent, or a question measured reported opinion rather than observed behaviour? A comparison across periods also needs care if the study cannot establish what caused a change.

Choose precise wording. “Among respondents to our customer survey” identifies the measured group. “Results may vary” does little to explain why or for whom.

If a figure uses only people who answered a particular question, give that base beside the figure. If an online survey missed people without internet access, explain the gap when it matters to the intended inference.

Prioritise the limit that changes the main takeaway. The fuller method information can explain other collection, processing and analysis choices.

Explain the finding and the method

In the finding itself, name the studied group, measure and period, with the decisive qualification in the same sentence or nearby. In accessible method information, explain who sponsored and conducted the work, how cases were recruited or selected, collection dates, the relevant sample and question wording, important exclusions, missing data and any weighting.

The detail depends on the method. An interview study needs to explain who participated and how themes were developed; it should not be presented as a population percentage. A survey percentage needs its denominator and the wording that produced the answer.

A company-record analysis needs definitions for recorded events, plus a record of any changes to them. Clear disclosure permits scrutiny, but it does not make an unsuitable method support a wider claim.

For a hypothetical voluntary customer survey, a useful short limit might say: “This result describes participating customers during the collection period; it is not a design-based estimate of all Australians’ views.” The wording for a real study must follow its actual selection route and finding.

Keep shortened versions accurate

Review the page headline, summary, figure caption, media handover and social preview together. Readers may see a chart or preview without the methods section. Keep the same population and period in each shortened version. Where space is tight, narrow the claim rather than omit the condition that defines it.

Make fuller method information available when the finding is released, and provide a contact who can explain the calculation and what supporting material can be shared. Before publication, ask a reviewer to read only the headline, opening and main figure. If those create an impression the method cannot support, revise them. The fuller explanation should add detail, not carry the whole burden of accuracy.