HC sets aside tax order after finding all AI-generated cases were fictitious

AI-generated fictitious case laws are increasingly putting lawyers and authorities in trouble. Multiple recent incidents show that case studies and judgments produced by Artificial Intelligence (AI) tools often do not exist, leading to serious consequences in legal proceedings.

- Charul Shah Joshi

Criminal lawyer Asif Naqvi said he uses AI only for drafting, never for research. "When you ask the tool for case law, it often provides a fictitious citation. When we later search for the actual judgment, it doesn't exist. Hence, we cannot depend on it," Naqvi said.

The problem was highlighted before the Bombay High Court during a hearing on an appeal against an Income Tax assessment order. The court found that all the case laws cited by the Income Tax officer in the notice were fictitious and had been generated using AI.