
Module 6 · Lesson 5 of 6 · with Nova
Test a Claim Before You Build on It
Objective
Use AI to challenge an appealing explanation and identify alternatives.
A friend sends you an article claiming that people who wake up at five in the morning are more successful. You might be intrigued, especially if you're trying to improve your routine. Before changing your alarm, there's a more interesting question: what would we need to know for that claim to mean anything?
The headline might describe a genuine pattern. Perhaps a survey found that high earners report waking early. But a pattern between two things doesn't tell us that one caused the other. Early rising could be associated with job type, family responsibilities, age or a host of other circumstances.
Ask an assistant to separate the observation from the proposed explanation. 'People who wake early report higher earnings' is an observational claim. 'Waking early increases earnings' is a causal claim. The second is much stronger and requires different evidence. That distinction is one of the most useful habits in research.
Now look for alternative explanations. Perhaps people in certain occupations must start early, and those occupations also have different earnings. Perhaps successful people have routines that include early mornings, but the routine isn't what produced their success. Neither possibility proves the headline false. Both show why the observed pattern is not enough on its own.
You can use AI to formulate questions about the study. Who participated? How were waking times measured? What counted as success? Were other factors considered? Was the sample representative? If the article doesn't provide that information, the assistant can help you identify what remains unknown rather than filling the gaps with certainty.
Suppose a second article repeats the same finding. Check whether it reports a separate investigation or simply cites the original source. Repetition may spread an interesting claim without adding independent evidence. If the assertion matters to your decision, tracing it back to the original study can be more useful than reading ten summaries.
There's also a practical way to think about the claim. If your goal is having more time to exercise, an early morning might suit you, regardless of whether it increases earnings. You could test a modest change to your schedule and observe how you feel. That personal experiment answers a different question: does this routine work for me?
Be willing to arrive at an uncertain conclusion. You may find evidence of an association but no compelling basis for claiming causation. That's still a useful research result. It means you understand the limits of the headline and can make your decision for better reasons.
Let's imagine asking the assistant for evidence that early rising improves success. If you phrase the request that way, you may be encouraging it to search for supporting material rather than assess the claim fairly. Try asking instead what the strongest evidence for and against the proposed relationship would look like. That opens the door to alternatives and prevents the discussion from becoming an exercise in defending a headline.
Suppose the original study used self-reported waking times. People may not remember or describe their routines accurately. If it surveyed only people from one profession, the results may not generalise to everyone. These aren't minor technical complaints. They affect the meaning of the conclusion. Ask AI to explain how changing the sample or measurement could change the finding.
Sometimes the right outcome is a better framed claim rather than a simple verdict. You might conclude that some observational studies associate early rising with particular outcomes, but the evidence presented does not show that changing your wake-up time would cause those outcomes. That's a substantial improvement in understanding. You can still experiment with an earlier routine for personal reasons, without borrowing certainty from research that doesn't establish it.
Think about what you'd actually do differently if the headline were true. Perhaps early waking could create quiet time, but so might changing another part of your routine. The practical question about your life and the causal research question are not identical. Keeping them separate prevents a doubtful headline from dictating your behaviour.
Once you practise distinguishing claims, observations and explanations, many impressive headlines become easier to examine. AI is valuable here as a patient challenger: ask it what else could explain the result, what evidence would change the conclusion and which assumptions you've accidentally accepted.