Claim Deduplication Workflow
Starting point
For each candidate claim extracted from a new article:
- Normalize the claim.
- Search existing claim pages.
- Compare the candidate against the closest existing claims.
- Decide one of four outcomes:
MERGE INTO EXISTING CLAIM
CREATE NEW CLAIM
ADD AS DISSENT / COUNTERPOSITION
ADD AS RELATED CLAIM LINK ONLYStep 1: Normalize the candidate claim
Before comparing, rewrite the candidate claim into a clear canonical form.
A canonical claim must be:
- declarative,
- specific,
- debatable,
- source-grounded,
- not merely a topic,
- not merely a quote,
- not merely an implication.
Use this form:
[Actor/context] + [asserted relationship/change/problem] + [scope/condition if needed]If the article says something vague, convert it into the strongest fair proposition without overstating it.
If the result is not debatable or reusable, do not create a claim page. Keep it as a note on the article page.
After the canonical proposition is clear, rewrite the visible claim title and claim sentence using Plain-Language Style Guide. The working rule is: first make the claim precise, then make it usable for Clay’s future scanning. Do not change URL slugs merely to match friendlier wording.
Step 2: Search for possible existing matches
Search existing claims by:
- Shared nouns/entities.
- Shared verbs/relationships.
- Shared practical implications.
- Shared evidence type.
- Shared parent Big Idea or topic.
Only compare against plausible matches. Do not compare against the whole wiki manually unless needed.
Step 3: Classify the relationship
For each plausible existing claim, classify the candidate claim’s relationship to it.
The possible relationships are:
SAME CLAIM
NARROWER VERSION
BROADER VERSION
OVERLAPPING BUT DISTINCT
SUPPORTING EVIDENCE
DISSENTING / COUNTERCLAIM
ADJACENT / RELATED ONLY
UNRELATEDThen follow the decision tree below.
Decision tree
1. Is the candidate actually a reusable claim?
If no, do not create or merge a claim page.
Action:
Add it only to the article page as a note, implication, quote, or key idea.If yes, continue.
A reusable claim must satisfy all of these:
- it is debatable,
- it can be supported or challenged by multiple sources,
- it is useful outside the current article,
- it is not just a restatement of the article title,
- it is not merely a broad topic.
2. Is there an existing claim with the same core proposition?
Ask:
Would proving or disproving the existing claim also substantially prove or disprove the candidate claim?If yes, merge.
Action:
MERGE INTO EXISTING CLAIMThe new article is added to the existing claim page under the correct evidence relationship:
- support,
- dissent,
- nuance,
- example,
- implication,
- caveat.
Do not create a new claim page.
If no, continue.
3. Is the candidate only a narrower version of an existing claim?
Ask:
Is the candidate a more specific case, domain, example, population, tool, practice, or condition of an existing claim?If yes, apply the Distinct Evidence Test.
Distinct Evidence Test
Create a separate claim only if at least 2 of the following 4 are true:
- The narrower claim is likely to accumulate its own sources.
- The narrower claim requires different evidence than the broader claim.
- Accepting the narrower claim would lead to a different practical implication.
- The narrower claim is important enough to be discussed independently in synthesis pages.
If fewer than 2 are true:
MERGE INTO EXISTING CLAIMAdd the candidate as a subsection, nuance, example, or implication under the broader claim.
If 2 or more are true:
CREATE NEW CLAIMAnd add reciprocal related links between the broader and narrower claim.
4. Is the candidate a broader version of an existing claim?
Ask:
Does the candidate generalize one or more existing claims into a wider proposition?If yes, apply the Generalization Test.
Generalization Test
Create the broader claim only if all of the following are true:
- It can connect at least two existing or likely future narrower claims.
- It has synthesis value beyond simply renaming the narrower claim.
- It is not so broad that it becomes a topic or Big Idea.
- It changes how the evidence should be organized.
If all are true:
CREATE NEW CLAIMThen:
- link narrower claims as related or child claims,
- add the new article as support/nuance/etc.,
- do not erase the existing narrower claim.
If not all are true:
MERGE INTO THE BEST EXISTING CLAIMor keep as an article-level idea if no good target exists.
5. Does the candidate contradict or substantially challenge an existing claim?
Ask:
Is the candidate mainly arguing against the existing claim?If yes, apply the Counterclaim Test.
Counterclaim Test
Create a separate counterclaim only if at least 2 of the following 4 are true:
- The counterclaim is likely to recur in future sources.
- It has its own evidence base.
- It leads to meaningfully different practical implications.
- It represents a stable debate position, not just a caveat.
If fewer than 2 are true:
MERGE AS DISSENT / NUANCEAdd it to the existing claim page under:
## Dissenting or complicating sourcesIf 2 or more are true:
CREATE NEW CLAIMThen add reciprocal links.
6. Does the candidate overlap but produce a different decision implication?
Ask:
If someone accepted the candidate claim, would they do something materially different than if they accepted the existing claim?If yes:
CREATE NEW CLAIMAnd link the two as related claims.
If no, continue.
7. Does the candidate use the same evidence base as an existing claim?
Ask:
Would the same sources, data, examples, or arguments mostly support or challenge both claims?If yes, merge unless there is a strong reason to separate.
Action:
MERGE INTO EXISTING CLAIMIf no, continue.
8. Is the relationship mainly conceptual adjacency?
Ask:
Are the claims about related ideas, but neither one proves, disproves, narrows, broadens, or materially modifies the other?If yes:
CREATE NEW CLAIMand add a:
## Related claimslink between them.
Do not merge.
9. Is no existing claim close enough?
If no existing claim passes the merge, narrower/broader, counterclaim, shared-evidence, or adjacency tests:
CREATE NEW CLAIMLink it to at least one Big Idea, article, or topic if possible.
Outcome rules
Outcome A: Merge into existing claim
Use when:
- same core proposition,
- narrower case that does not pass the Distinct Evidence Test,
- broader framing that does not pass the Generalization Test,
- same evidence base and same practical implication,
- minor wording/framing difference.
Required action:
Update existing claim page.
Do not create a new claim page.
Add article B as support/dissent/nuance/example/implication.Outcome B: Create new claim
Use when:
- no existing claim is close enough,
- candidate passes the Distinct Evidence Test,
- candidate passes the Generalization Test,
- candidate passes the Counterclaim Test,
- candidate has a different practical implication,
- candidate has a distinct evidence base,
- candidate is overlapping but substantively distinct.
Required action:
Create a new claim page.
Link to source article.
Link to related Big Idea.
Add related-claim links where relevant.Outcome C: Merge as dissent / nuance
Use when:
- the candidate challenges an existing claim,
- but does not pass the Counterclaim Test,
- or the disagreement is a caveat rather than a stable opposing position.
Required action:
Add article B to the existing claim page under dissent, nuance, caveat, or complicating evidence.
Do not create a new claim page.Outcome D: Related claim link only
Use when:
- the candidate is a valid separate claim,
- it does not support or challenge the existing claim directly,
- neither claim is a narrower/broader version of the other,
- accepting one does not substantially prove or disprove the other,
- but readers would benefit from seeing the conceptual relationship.
Required action:
Create or update the candidate claim page separately.
Add reciprocal related-claim links.
Do not merge evidence sections.Short version
1. Is it reusable?
No → keep on article page only.
Yes → continue.
2. Same core proposition as existing claim?
Yes → merge.
3. Narrower version of existing claim?
Yes → separate only if it passes Distinct Evidence Test; otherwise merge.
4. Broader version of existing claim?
Yes → separate only if it passes Generalization Test; otherwise merge.
5. Counterclaim?
Yes → separate only if it passes Counterclaim Test; otherwise add as dissent/nuance.
6. Different practical implication?
Yes → create new claim + related link.
7. Same evidence base and same implication?
Yes → merge.
8. Adjacent but distinct?
Yes → create new claim + related link.
9. No close match?
Create new claim.Governing principle
Prefer merging over creating a new claim page unless the distinction changes the evidence, implication, or debate structure.
Do not merge merely because two claims share a topic. Shared topic alone creates a related link, not a merge.