Agent Skills › semantica-agi/semantica › deduplicate

deduplicate

GitHub

用于从知识图谱中检测并处理重复实体、分组及关系。支持模糊匹配与图相似度算法，提供去重策略、阈值设置及合并建议，帮助清理冗余数据并标准化关系表示。

plugins/skills/deduplicate/SKILL.md semantica-agi/semantica

Trigger Scenarios

用户要求清理知识图谱中的重复数据需要识别相似的实体或关系组执行图谱数据清洗与维护任务

Install

npx skills add semantica-agi/semantica --skill deduplicate -g -y

More Options

Non-standard path

npx skills add https://github.com/semantica-agi/semantica/tree/main/plugins/skills/deduplicate -g -y

Use without installing

npx skills use semantica-agi/semantica@deduplicate

指定 Agent (Claude Code)

npx skills add semantica-agi/semantica --skill deduplicate -a claude-code -g -y

安装 repo 全部 skill

npx skills add semantica-agi/semantica --all -g -y

预览 repo 内 skill

npx skills add semantica-agi/semantica --list

SKILL.md

Frontmatter

{
    "name": "deduplicate",
    "description": "Detect duplicate entities, duplicate groups, and relationship duplicates in Semantica using fuzzy matching, schema heuristics, and graph similarity."
}

/semantica:deduplicate

Remove duplicates from the knowledge graph. Usage: /semantica:deduplicate <strategy> [args]

$ARGUMENTS = deduplication strategy + optional entity or threshold.

`entities [--threshold <score>] [--field <name>]`

Detect duplicate entities and group them by similarity.

from semantica.deduplication import DuplicateDetector

finder = DuplicateDetector()
candidates = finder.detect_duplicates(entities, threshold=threshold)
groups = finder.detect_duplicate_groups(entities, threshold=threshold)

Output: duplicate candidate list, duplicate groups, and representative merge recommendations.

`relations [--similarity <score>]`

Detect duplicate relationships and normalize edge representations.

from semantica.deduplication import DuplicateDetector

finder = DuplicateDetector()
relations = finder.detect_duplicates(relation_list, threshold=similarity)

Result: duplicate relation candidates, normalized relationship groups, and cleanup summary.