Which GenAI Tool FAILED? Tested on a Fake Legal Case (AI Hallucination Test) скачать в хорошем качестве

Which GenAI Tool FAILED? Tested on a Fake Legal Case (AI Hallucination Test)

Can you trust AI to summarise case law? In this video, I run a “GenAI Case Summary Hallucination Test” on seven different AI tools using a completely fake Australian case citation: Brown v Mitchell (1980) 14 NSWLR 224 – a case that does not exist but follows NSW Law Reports citation format. I ask each tool three questions: 1. “Summarise Brown v Mitchell (1980) 14 NSWLR 224.” 2. “Where did you get this from?” 3. “Is this case made up?” You’ll see which tools: • Confidently hallucinated detailed case summaries • Insisted the case was real • Refused to make things up and flagged it as likely fake This experiment was inspired by: Sally McLaren and Lily Rowe, ‘“You’re right to be sceptical!”: The Role of Legal Information Professionals in Assessing Generative AI Outputs’ (2025) 25(1) Legal Information Management 19–25. https://www.cambridge.org/core/journa... ============================ ⏰ Timecodes ⏰ 00:00:00 – 00:03:10 Intro and purpose of the test 00:03:10 – 00:06:11 ChatGPT (free) - test 1 00:06:12 – 00:07:16 ChatGPT 5.1 (paid) - test 2a 00:07:17 – 00:08:46 ChatGPT 5.1 (paid) + ‘Thinking mode’ turned on - test 2b 00:08:46 – 00:10:58 Gemini 2.5 (free) - test 3 00:10:58 – 00:12:22 Perplexity (free) - test 4 00:12:23 – 00:12:54 Copilot (included in your Microsoft suite) - test 5 00:12:55 – 00:14:19 Meta AI (free) - test 6 00:14:20 – 00:16:08 Claude (free, Sonnet 4.5, Extended Thinking on) - test 7 00:16:12 – 00:18:58 Summary of all tests ============================ ⚖️ Important disclaimer (not legal advice): This video is for education and general information only. It is not legal advice and should not be relied on as such. AI tools change frequently; the behaviours shown here are a snapshot at the time of testing. Always verify case law and legislation using authoritative legal databases and, where necessary, seek advice from a qualified legal practitioner. ============================ This video is not sponsored. ============================ Learn more: 📚 Grab my free law school resources: https://www.rowenamaxwell.com 🔔 Subscribe for tutorials, templates & student productivity tips: @LearnRowenaMaxwell ============================ Connect with Rowena on LinkedIn / rowena-maxwell-5411a6a #aiforlawyers #lawstudent #lawschool #chatgpt #large language models #ai