Glossary · Foundations

Deduplication

Deduplication is entity resolution applied within a single dataset: finding the rows that are the same thing and deciding which of them may safely be collapsed.
How to read this

The definition as the field writes it comes first, weaknesses and all. What Entity Bind does about it comes last, in its own paragraph, so you can take one without the other. Filed under foundations.

On this page
the full definition

What deduplication means

Deduplication is the case where the file is compared against itself. A CRM with four rows for the same customer, a supplier master with three vendor codes for the same legal entity, a marketing list assembled from six imports — all of them are the same problem, and all of them have the same trap, which is that collapsing is destructive and finding is not.

Separate the two halves. Finding duplicates is a retrieval and scoring problem with a tolerable error profile: a false candidate costs a reviewer a few seconds. Merging duplicates is a write, and a wrong merge is expensive to detect and often impossible to reverse cleanly once downstream systems have replicated the surviving id. Most deduplication disasters are not detection failures; they are detection successes that were applied automatically at a threshold nobody measured.

The two failure modes have names. Merging records that are not the same company is an over-merge; leaving records that are the same company in separate clusters is fragmentation. They trade off against each other, and any single-number 'match rate' hides which one a tool prefers.

Entity Bind makes the merge a decision with a receipt, refuses any binding below the 0.90 confidence floor, and writes nothing into your systems: a Merge Safety Sprint returns which rows are the same company, which of your existing matches it would not have made, and what it could not decide. It is an acceptance contract, not calibration evidence: it says what we refuse to return, not how often an accepted match is right. Read it with the coverage it costs.

see also

The terms next to this one

Each with its own sentence, because the next question is usually about the word beside this one.

Entity resolution

Entity resolution is the process of deciding which records, across one or many datasets, refer to the same real-world thing — and, when the evidence does not settle it, deciding that too.

Over-merge

An over-merge is a cluster containing records from more than one real entity — the failure that turns two customers, two suppliers or two counterparties into one.

Fragmentation

Fragmentation is the opposite failure to over-merging: one real entity split across several clusters, so the same company is counted, contracted with or invoiced more than once.

Golden record

A golden record is the single assembled view of an entity built by choosing one value per field from the records attached to it, ideally with the provenance of each choice carried alongside it.

Confidence floor

A confidence floor is the score below which a system refuses to return a match at all, expressed as an acceptance contract rather than as a promise about accuracy.

Decision receipt

A decision receipt is the durable, retrievable record of why a particular match was made — the features, the probability, the thresholds in force, the sources cited and the version of the pipeline that decided — addressable by an identifier returned with the answer.

Foundations

The other 9 terms on this shelf

What the problem is called, and what the objects in it are. Entity, record, cluster, and the four industry names for the same job.

evidence basis

Internal fixtures only. The historical 2026-08-29 per-tier recording covers 317 GB companies with identifier-rich arrivals seeding the catalogue first; the context tier includes country and registered-town prose. Its legacy replay has no full-prompt-verified calls and cannot certify current calibration. The September 5 CI reports cover 1,176 labelled pairs and 705 records over 250 companies using offline stubs. These are not independent customer holdouts or live production validation; the 99% minimum-input product target remains unmet. Scope is company and organisation identity only — not people, vessels, bank-account ownership, sanctions or emissions. Results may not be used for eligibility decisions about individuals, including employment, credit and tenancy.

the ask

Start with your own company records.

Create your workspace, verify your email and run your first company file. The Free plan needs no card. Create API keys in your workspace when you need an integration.

300 credits. No card.

For a guided review of your file, explore the Merge Safety Sprint →