Following an incident where a trial court relied on fabricated AI-generated judgments, the Supreme Court of India has asked the Bar Council of India to establish an expert committee to guide AI’s role in legal proceedings. This move underscores emerging challenges in integrating AI tools with judicial processes.
- Supreme Court requests Bar Council of India to form AI expert panel
- Trial court cited four fake AI-generated Supreme Court judgments
- Court flagged accountability gaps and called for state-built AI system
What happened
In a property dispute case, a trial court in Andhra Pradesh referenced four Supreme Court judgments that were later identified as non-existent, having been generated by AI. The High Court acknowledged that these citations originated from AI but did not overturn the decision, issuing only a cautionary remark. The Supreme Court subsequently intervened, stayed further reliance on the reportedly fabricated judgments, and termed the issue one of significant institutional concern.
The Supreme Court has since asked the Bar Council of India to form an expert panel to assess AI’s role and impact in court proceedings. The court emphasized that citing AI-generated material without verification amounts to professional misconduct and that reliance on such content cannot be excused with after-the-fact apologies.
Why it matters
This incident spotlights the emerging risks and accountability challenges posed by AI integration in the legal domain. Indian courts are increasingly adopting AI tools for research and transcription, yet there are no binding regulations governing their use or safeguards to prevent the citation of fabricated legal precedents. The Supreme Court’s framing of AI citation as misconduct raises significant questions about how lawyers and judges will be held responsible for ensuring the authenticity of AI-derived content.
Moreover, India’s judiciary handles an enormous caseload with over 5 crore pending cases, intensifying the appeal of AI assistance. The court’s call for a sovereign large language model and an India-specific legal database indicates a preference for state-regulated AI resources, which could mitigate dependence on commercial systems prone to generating hallucinated outputs.
What to watch next
The Bar Council of India is expected to submit its report after constituting the expert panel, with the next Supreme Court hearing scheduled for May 26. Attorney General R Venkataramani will consult relevant government ministries, including MeitY, to determine whether formal regulatory frameworks for AI in courts should be introduced or if judicial self-governance will suffice.
The judiciary’s response to this issue will set important precedents on how AI tools are vetted and integrated into India’s legal practice. Monitoring developments in judicial discipline related to AI misconduct, as well as progress toward a sovereign AI model and legal database, will be crucial for understanding the trajectory of AI governance in the country’s justice system.