For Data Analysts

20 Practical Ideas for Data Analysts to Stay Cognitively Sovereign

AI tools like Code Interpreter and Tableau AI can generate plausible-looking charts and summaries without showing their reasoning. When you present these findings to stakeholders without verifying the underlying logic, you risk insight laundering: acting on conclusions no one actually validated.

These are suggestions. Take what fits, leave the rest.

Download printable PDF

Before You Trust the Output

Read the SQL query before running itbeginner
Check the joins, filters, and aggregations. Ask why those specific logic choices were made.
Spot-check five rows of raw databeginner
Open the source table yourself. Does the detail match what the summary claims?
Verify the sample size and date rangebeginner
AI often hides crucial filtering logic. Ask what period the chart actually covers.
Ask what null values were excludedintermediate
Missing data shapes conclusions. Request a count of dropped or imputed records.
Recalculate one metric manually in Excelintermediate
Pick one number from the AI output. Reproduce it using basic formulas yourself.
Check for Simpson's Paradox in aggregatesadvanced
Break the total by category. Does the trend reverse when you disaggregate?
Compare AI's method to your known standardintermediate
Use a metric you have calculated manually before. Does the AI method match?
Ask the tool to show its statistical assumptionsintermediate
Demand it state whether it used mean, median, or other measures. Which was appropriate?
Test the finding on a different date rangeintermediate
Run the same query on last quarter. Does the pattern hold or disappear?
Identify which stakeholder question remains unansweredbeginner
Before showing the chart, write down what they asked. Does the output actually answer it?

Keeping Your Judgment Sharp

Write the question yourself before using AIbeginner
Formulate the business logic first. Then check if AI's approach matches your thinking.
Build at least one chart without AI tools monthlyintermediate
Use SQL and Excel directly. Keep your ability to reason through joins and formulas alive.
Practice saying 'I do not know' to stakeholdersbeginner
When AI output contradicts your instinct, pause. Do not present it until you understand why.
Document why you rejected an AI suggestionintermediate
Write it down. This builds your pattern recognition for when automation gets things wrong.
Ask why the outlier exists before smoothing itintermediate
AI may flag or remove unusual values. Investigate the business cause first.
Teach a colleague how you verified the logicbeginner
Explain your spot-checks aloud. This forces you to articulate your reasoning criteria.
Keep a log of AI errors you discoverintermediate
Over time, patterns emerge. This sharpens your ability to predict where automation fails.
Set a time limit before requesting AI helpbeginner
Try to solve the query yourself for ten minutes first. This preserves your statistical instinct.
Compare AI's visualisation choice to yoursintermediate
If AI picked a bar chart, ask yourself if a line or scatter plot would tell the story better.
Challenge the narrative AI assigns to dataadvanced
AI generates insights. You decide whether the story it tells is the most important one.

Five things worth remembering

Related reads

The Book — Out Now

Cognitive Sovereignty: How To Think For Yourself When AI Thinks For You

Read the first chapter free.

No spam. Unsubscribe anytime.