What exactly are null results, and how do they work in science?
In scientific research, a null result occurs when data fail to support the expected effect. This does not mean there is “no data” — rather, the data do not confirm the desired hypothesis. These outcomes are frequently dismissed as unnoteworthy, even by scientists themselves. Yet they play a foundational role in how knowledge is built.
The null hypothesis states that there is no statistically significant association between variables. To support a hypothesis — for example, “X affects Y” — researchers must first show that the null hypothesis (“X has no effect on Y”) is false. One clear example is the LUX experiment, which found no dark matter particles despite an extensive search. That is a textbook null result.
Overview of null results at a glance
- Null results fail to confirm the expected effect, but still contain valuable data.
- The null hypothesis assumes no relationship between variables until evidence proves otherwise.
- Many null findings go unpublished, creating a biased record of scientific knowledge.
- A large-scale survey of 11,069 researchers across 166 countries confirmed that null results are underpublished and that this needs to change.
Key insights about null results
- Null results are not “nothing” — they disconfirm a hypothesis, which is a meaningful scientific outcome.
- Researchers often do not publish null findings, leading to a distorted understanding of research topics.
- A null result for one researcher can be a positive finding for another, depending on the research question.
- Access to all results, including null ones, is essential for reproducibility and data sharing.
- News exposure studies show that null effects on political knowledge, participation, and polarization are consistent and robust.
- News accounts for only 2–3% of citizens’ online information diet, which helps explain the null effects.
- Turning null results into news requires strong narrative arcs that show how non-findings advance science or affect real lives.
Key studies on null results in news exposure
| Study | Finding |
|---|---|
| Nature (2022) | Reducing or increasing news exposure has no impact on political knowledge, participation, or support for compromise. |
| EUR (2023) | Online exposure to local news websites has no over-time effects on political participation or polarization. |
| Stanford (Malhotra) | Neglecting null findings in research is detrimental to scientific progress. |
| LUX experiment | Researchers found no dark matter particles — a clear null result. |
| Springer Nature survey | 11,069 researchers across 166 countries confirm null results are underpublished. |
| Covering Null Results (2025) | Journalists can transform null results into compelling stories with narrative arcs and targeted alerts. |
Why do null results matter for scientific progress?
Despite being seen as failures, null results are critical for advancing science. When researchers consistently leave null findings unpublished, the scientific record becomes biased. Other scientists cannot build on work they never see, and the same experiments may be repeated unnecessarily.
A survey of 11,069 researchers across 166 countries confirms that null results are widely underpublished. Many scientists admit they do not submit null findings because they assume editors and reviewers will reject them. This practice undermines the reproducibility of research and slows progress across disciplines.
The value of null results for different researchers
A null result for one team may be a positive finding for another. For example, if a drug fails to show an effect in one population, that same null result might be exactly what a researcher studying that drug’s limitations needs to see. Without access to the full range of outcomes, scientific understanding remains incomplete.
Reproducibility and data sharing
Access to all results — including null ones — is essential for reproducibility. When only positive findings are published, it becomes impossible to verify whether a reported effect is genuine or just a statistical fluke. Null results provide the counterbalance that keeps the scientific process honest.
How can journalists turn null results into compelling news?
Reporting on null results requires a shift in mindset. Journalists can transform these non-findings into news by focusing on their real-world impact. Strong narrative arcs help readers see why a study that found “nothing” still matters.
Finding hidden null results
Many null results are not obvious at first glance. Journalists can uncover them by checking preprints, reviewing conference Q&A sessions, and following up with researchers after a study is published. Setting Google Scholar alerts for terms like “no evidence,” “null,” and “replication” can surface stories others miss.
Ask researchers directly what else they are working on and follow up on study outcomes. Often, a scientist’s most interesting null result comes from a separate line of inquiry. Staying in touch with sources over time can reveal stories that never appear in press releases.
Balancing accuracy with relevance
Avoid overselling null results while clearly explaining their relevance. The goal is not to make a non-finding sound like a breakthrough, but to show why it matters for public understanding or policy decisions. Precision in language — using phrases like “found no evidence” rather than “proved nothing” — helps maintain credibility.
What does research show about news exposure and its effects?
Multiple studies have found that news exposure has null effects on key democratic outcomes. This challenges the long-held assumption that more news consumption leads to more informed and engaged citizens.
The Nature (2022) study
In a large experiment published in Nature, researchers asked participants to either reduce or increase their news consumption. Across multiple measures — political knowledge, political participation, and support for compromise — they found no significant changes. These null effects persisted regardless of prior news consumption levels or the ideological alignment of a person’s news diet.
The EUR (2023) study
A study from Erasmus University Rotterdam tracked the effects of online exposure to local news websites over time. It found no over-time effects on political participation or polarization. Even participants who complied fully with the treatment showed no measurable shift in behavior or attitudes.
The reason these null effects appear is that news accounts for only about 2–3% of citizens’ online information diet. Even dramatic changes in news consumption represent a tiny fraction of total media exposure, which is dominated by entertainment, social media, and other content.
The Stanford perspective
Neil Malhotra at Stanford University has highlighted how neglecting null findings in research is detrimental to scientific progress. His work underscores that null results are not just missing from the literature — they are actively dismissed, which distorts the evidence base for media effects and many other fields.
How has the understanding of null results evolved over time?
- Early 2000s — Awareness grows that many null results are never submitted for publication, creating a “file drawer problem.”
- 2010s — Replication crises in psychology and medicine draw attention to the importance of publishing all outcomes, including nulls.
- 2022 — A Nature study on news exposure finds null effects on political knowledge and participation, challenging media impact assumptions.
- 2023 — EUR research extends these findings to local news websites, showing no over-time effects on polarization.
- 2024-2025 — Springer Nature publishes a global survey of 11,069 researchers confirming that null results remain underpublished. The Open Notebook offers practical guidance for journalists on covering null results.
What is established and what remains unclear about null results?
| Established information | Information that remains unclear |
|---|---|
| Null results occur when data fail to support the expected hypothesis. | The exact proportion of null results that go unpublished across all scientific fields. |
| The null hypothesis assumes no association between variables. | The full impact of underpublished nulls on public policy and medical guidelines. |
| News exposure has null effects on political knowledge, participation, and polarization. | Whether these null effects hold for certain subgroups (e.g., heavy news consumers, low-trust individuals). |
| News accounts for only 2–3% of citizens’ online information diet. | How the rise of AI-generated news might alter this percentage in the future. |
| 11,069 researchers across 166 countries confirm underpublication of null results. | The specific barriers that prevent researchers from submitting null findings to journals. |
What does “null” mean in other contexts?
Beyond scientific research, the term “null” appears in several other domains. In computing and programming, NULL or nil marks an unset pointer. It is a convention for indicating that a variable holds no valid memory address — not necessarily a “billion-dollar mistake” but a practical tool for developers.
There is also a former journalist named Null who worked at the Bluefield Daily Telegraph before moving into the tourism industry. And in the hacker community, “Null Byte” is a well-known site for white-hat security, networking, and penetration testing tutorials.
Where can readers find more about covering null results?
“Access to all results, including nulls, is essential for reproducibility and data sharing.”
— Springer Nature survey report
“A person’s ‘null’ result may be positive for another researcher.”
— Covering Null Results, The Open Notebook
“Neglecting null findings in research is detrimental to scientific progress.”
— Neil Malhotra, Stanford University
What is the core takeaway about null results?
Null results are findings that disconfirm hypotheses. They are vital for science but often underreported. Turning them into news requires strong storytelling and precise language. Additionally, research shows that news exposure has null effects on key democratic outcomes, challenging long-held assumptions about media’s impact. For deeper exploration, see the guide on turning null results into news.
Frequently asked questions
What is the null hypothesis?
The null hypothesis states there is no statistically significant association between two variables. Researchers aim to reject it to support their alternative hypothesis.
Why do scientists avoid publishing null results?
Many scientists believe editors and reviewers will reject null findings because they are seen as less interesting. This leads to a biased scientific record.
Can a null result ever be useful?
Yes. A null result for one researcher may be a positive finding for another. It can also rule out ineffective treatments or incorrect theories.
How can journalists find null results to report on?
Journalists can check preprints, conference Q&As, and set Google Scholar alerts for terms like “no evidence” or “null.” Following up with researchers also works.
What did the LUX experiment find?
The LUX experiment searched for dark matter particles and found none — a classic null result that helped constrain future searches.
Does news exposure really have no effect on political knowledge?
Multiple studies, including a 2022 Nature experiment, found that changing news exposure levels had no measurable impact on political knowledge, participation, or polarization.
What percentage of online information is news?
News accounts for only about 2–3% of citizens’ online information diet, which helps explain why news exposure changes have little effect.
What does NULL mean in programming?
In code, NULL or nil represents an unset pointer — a way to indicate that a variable holds no valid memory address.
Who is Null in journalism?
Null is a former journalist at the Bluefield Daily Telegraph who later transitioned to working in tourism.
What is Null Byte?
Null Byte is a white-hat hacker community website focused on security, networking, and penetration testing tutorials.
Freddie Harry Cooper Bennett is a staff writer for DailyPressUK.co.uk, covering UK news, politics, business and culture. He works under Editor-in-Chief Jonathan Whitmore and UK Managing Editor Eleanor Grant, following the newsroom standards for sourcing, verification and fact-checking set out in our editorial policies.