Not all data is equal before the law

Examining why publicly available legal data lacks depth for training legal‑expert LLMs, analyzing data quality issues and implications for the Qwen 2.5 72B model.

Overview

The premise of my business, Counsel Intelligence, is that legal training data currently available in public sources (regardless of copyright and licensing) is insufficient to train LLMs in become legal experts. This is different to hallucination, since I believe this is a problem that arises from the shallowness of legal data, rather than a probabilistic cause.

Tech stack