Skip to main content
All articles

Data Extraction Tips

Why clause-level indexing beats full-text search for contracts

Full-text search finds the word "assignment" in ninety documents. Clause-level indexing finds the assignment clause in the one you need.

Written by
Marcus Feld
Extraction Lead, Datacoll8
Published
Reading time
6 minutes

Making a scanned archive searchable is usually described as the finish line. Text is embedded in the PDF, the index picks it up, and every document becomes findable. It is a genuine improvement over a store room, and it is still the wrong tool for contract work.

Search returns documents, questions are about clauses

A fee earner rarely wants a document. They want to know whether this agreement can be assigned on a change of control, when it renews if nobody serves notice, and which jurisdiction governs a dispute. Full-text search answers those questions with a list of files containing a keyword, and the reading work is left entirely with the person who asked.

Clause-level indexing stores the answer as a value on the record. Renewal date is a date. Governing law is an enumerated value. Assignment permitted on change of control is a boolean with a link to the clause it was read from. Those can be filtered, sorted, reported on and diaried, which a keyword hit cannot.

What it enables that search cannot

  • Every agreement renewing in the next ninety days, as a list rather than a reading exercise
  • All contracts with a counterparty across matters, compared clause by clause
  • Exposure reporting on indemnity and liability caps without opening a file
  • Portfolio review after a regulatory change, scoped to the clauses that actually changed

Keep the full text as well. It remains the right tool for the unanticipated question, and it costs nothing to retain alongside the structured values. The point is not to replace search but to stop asking it to do a job it was never built for.

Written byMarcus FeldExtraction Lead, Datacoll8

Book a demo

See it run against your own documents

Bring three or four representative agreements to the demo. We will run them through classification, extraction and verification live, and tell you plainly where the pipeline would need tuning for your paper.

Demos run Monday to Friday, 08:30 to 18:00 GMT