Z.ai launches GLM-Legal, a legal-domain model scoring 19.2% all-pass on Harvey LAB
- Z.ai released GLM-Legal, a legal model built on the lightweight GLM-5.3-Flash base, that scores 19.2% all-pass on Harvey LAB and improves on its base model by 12.5 percentage points.
- On Harvey LAB, which tests real law firm workflows across 24 practice areas, the model is graded under a strict all-pass standard that requires end-to-end task completion.
- Z.ai says GLM-Legal matches frontier closed-source models on LegalBench and PLawBench while running on a much smaller parameter footprint, though the post gives no parameter counts.
- Training runs in two stages: mid-training on an expanded legal corpus, then reinforcement learning across tens of thousands of legal environments alongside a co-evolving agent harness.
- The model is slated to come to AutoClaw, Z.ai's desktop agent platform, with examples for contract review, case preparation, and cross-border launch planning.
Hacker News 의견들
There should be laws requiring attorneys to disclose their AI use. Going to prison for years because some lawyer prompted badly sounds awful to me.
Pushing back on that, if you actually did the crime, the lawyer's prompt isn't the main problem. A lot of law is combing through rule sets and case files, and a model can speed that up a lot.
I'd limit lawyers to non-generative tools, at least for anything the client sees. Something that just finds relevant case law from a fixed set seems sane. Common law is hard to formalize, but tax law probably already is.
Tracked changes and human review are fine, but nothing in the post handles hallucinated cases. A judge is not going to buy 'you were right to call me out' from an AI.
Lawyers are going to get rich since human sign-off stays required. I suspect firms will push quantity though, so people end up signing without reading.
Paralegals already do the grunt work for much less than the lawyer's hourly rate. Court appearances and client contact are not going away.
Not an open model, so I'm curious how sentiment toward Chinese models shifts as labs go proprietary. Nobody will care much if they aren't open.
Next domain, GLM-Science? I think we'll see more specialized small models that run on consumer hardware. An LLM for UK income tax law sounds genuinely useful.
Liability is the weak spot here. Legal already tiers responsibility, with trainees and paralegals filtered through the lawyer who signs the filing.