New AI Warning: Don’t Discuss Your Legal Problems With Claude Or ChatGPT
U.S. District Judge Jed S. Rakoff ruled that communications with AI chatbots like Anthropic’s Claude cannot be protected under attorney-client privilege, as seen in the case of Bradley Heppner, a Texas businessman convicted of securities fraud. The judge stated AI lacks the human relationship required for privilege, and Claude’s terms of service allow data sharing with authorities, raising risks for users discussing legal matters with AI tools.
A New York federal judge has set a precedent warning against using AI chatbots for legal advice. U.S. District Judge Jed S. Rakoff ruled in February that communications with AI systems like Anthropic’s Claude or OpenAI’s ChatGPT cannot be shielded under attorney-client privilege, treating them like any other non-privileged documents. The ruling stems from the case of Bradley Heppner, a 60-year-old Texas businessman and former CEO of GWG Holdings, who was convicted in May of defrauding investors out of over $150 million. After learning of federal investigations last year, Heppner turned to Claude for a defense strategy, saving 31 documents and conversations with the AI. When prosecutors seized his devices, they challenged whether these exchanges were protected under legal privilege. Rakoff’s 12-page order rejected Heppner’s claim, stating that since Claude is not an attorney, no privilege exists. The judge also noted that AI lacks the trusting human relationship required for confidentiality. Additionally, Anthropic’s terms of service, which Heppner agreed to, allow the company to share user data with authorities in legal disputes. Claude’s own response to queries about legal advice reinforces the risk: it explicitly states, ‘I’m not a lawyer and can’t provide formal legal advice,’ before directing users to consult licensed attorneys. Rakoff’s decision applies to both criminal and civil cases, marking the first such ruling in the U.S. The judge’s conclusion could have broader implications for how AI tools are used in legal preparation, particularly when freedom or financial stakes are high.
This content was automatically generated and/or translated by AI. It may contain inaccuracies. Please refer to the original sources for verification.