Agent Skills › semantica-agi/semantica › deduplicate

deduplicate

GitHub

用于在Semantica知识图谱中检测并移除重复实体、分组及关系。通过模糊匹配、模式启发式和图相似度算法，提供重复候选项、分组结果及合并建议，支持自定义阈值和字段过滤。

plugins/skills/deduplicate/SKILL.md semantica-agi/semantica

触发场景

需要清理知识图谱中的重复数据发现实体或关系存在冗余时执行图谱质量优化任务

安装

npx skills add semantica-agi/semantica --skill deduplicate -g -y

更多选项

非标准路径

npx skills add https://github.com/semantica-agi/semantica/tree/main/plugins/skills/deduplicate -g -y

不安装直接使用

npx skills use semantica-agi/semantica@deduplicate

指定 Agent (Claude Code)

npx skills add semantica-agi/semantica --skill deduplicate -a claude-code -g -y

安装 repo 全部 skill

npx skills add semantica-agi/semantica --all -g -y

预览 repo 内 skill

npx skills add semantica-agi/semantica --list

SKILL.md

Frontmatter

{
    "name": "deduplicate",
    "description": "Detect duplicate entities, duplicate groups, and relationship duplicates in Semantica using fuzzy matching, schema heuristics, and graph similarity."
}

/semantica:deduplicate

Remove duplicates from the knowledge graph. Usage: /semantica:deduplicate <strategy> [args]

$ARGUMENTS = deduplication strategy + optional entity or threshold.

`entities [--threshold <score>] [--field <name>]`

Detect duplicate entities and group them by similarity.

from semantica.deduplication import DuplicateDetector

finder = DuplicateDetector()
candidates = finder.detect_duplicates(entities, threshold=threshold)
groups = finder.detect_duplicate_groups(entities, threshold=threshold)

Output: duplicate candidate list, duplicate groups, and representative merge recommendations.

`relations [--similarity <score>]`

Detect duplicate relationships and normalize edge representations.

from semantica.deduplication import DuplicateDetector

finder = DuplicateDetector()
relations = finder.detect_duplicates(relation_list, threshold=similarity)

Result: duplicate relation candidates, normalized relationship groups, and cleanup summary.