AntFleet

Disagreement · 9bb17981-anthropic-3

Originality check is unreliable — only inspects skills/ on default branch, missing skills in PR branch or other paths

mismatch
repo 6f7fc663·PR #7·reviewed 1 week ago

Primary finding

Originality check is unreliable — only inspects skills/ on default branch, missing skills in PR branch or other paths

lowbugmedium
  • skills/pr-triage/SKILL.md:95-101
The check only lists `/skills` on main once per run. If two PRs in the same run each introduce the same new skill directory, both will pass originality (neither is on main yet). Also, repos may use a default branch other than `main`. Lastly, comparing case-sensitively can miss collisions like `myskill` vs `MySkill` on case-insensitive filesystems.

Recommendation

Use the repo's default branch (`gh api repos/owner/repo --jq .default_branch`), and also collect new-skill names seen earlier in the same run to detect intra-run collisions; do case-insensitive matching.

Counterpart finding

Repository-specific path reference to "aeon" root binary may mislead cross-repo usage

lowdocs-gapmedium
  • skills/pr-triage/SKILL.md:104
  • skills/pr-triage/SKILL.md:175
The skill purports to work across multiple watched repositories, but it references a specific "aeon" root binary. In repositories where that file/path does not exist, implementers may be unsure how to interpret the rule or what constitutes an equivalent protected root artifact.

Recommendation

Clarify that "aeon (root binary)" is an example and generalize the rule to a configurable list of protected root artifacts per repo (or link to where that config lives).

Why this didn't post

This finding didn't meet AntFleet's unanimous agreement threshold. Both frontier models review every PR independently; only findings they both flag with the same severity and category are posted to the PR. This one fell through.

read the methodology →
← back to all disagreementsview public receiptssee unanimous findings + anatomies →
Tweet ↗