AntFleet

Anatomy · 3c2fcd11-0

Install one-liner `./aeon` is not a documented entry point for aeon-bench

mediumdocs-gapclosed in 4b9b492
repo 6f7fc663·PR #9·reviewed 1 week ago·closed 1 week ago

The vulnerable code

skills/show-hn-draft/SKILL.md:84-85

84- One link maximum, in paragraph 4.
85- Every concrete number (stars, forks, skills shipped, PR count) must be traceable to a file you read in step 2. If the number isn't in a file, drop it — don't guess.

The reasoning

Opus

Repo owner mismatch: SKILL.md targets aaronjmars/aeon while project is AntFleet/aeon-bench

highbughigh
  • skills/show-hn-draft/SKILL.md:56-58
  • skills/show-hn-draft/SKILL.md:84-85
  • skills/show-hn-draft/SKILL.md:141
The skill instructions hard-code the repo `aaronjmars/aeon` for the `gh api` stats fetch, the install one-liner the operator will paste publicly, and the issue-list check. The project itself is `AntFleet/aeon-bench`. If this skill is run from this repo, it will (a) fetch stats from an unrelated repo (aaronjmars/aeon) and embed them as if they were this repo's stats, and (b) instruct the operator to publish an install command that clones the wrong repo. Both are real correctness bugs for any fork that uses this skill: bad numbers in the launch post and a broken install command pointing readers to a different project.

Recommendation

Parameterize the owner/repo (read from git remote or a config variable) so the skill uses the current repository for `gh api`, the repo URL in paragraph 4, the install one-liner, and the `gh issue list` checklist entry. At minimum, replace the hard-coded `aaronjmars/aeon` references with the active repo slug.

GPT-5

Output unavailable for this row.

The agreement

Both frontier models flagged this within the same line range. AntFleet's unanimous gate fired — the finding posted on the PR. Closed in 4b9b492.

The fix

84- One link maximum, in paragraph 4.
85- Every concrete number (stars, forks, skills shipped, PR count) must be traceable to a file you read in step 2. If the number isn't in a file, drop it — don't guess.

Closure

Closed 1 week ago

SHA: 4b9b49251c8c9808bf147d55aa2930352af2e8c0

View closure receipt on GitHub →

Tweet thread template

tweet 1 of 8160 / 280

Two frontier models reviewed PR #9 on 6f7fc663. Both found this bug: medium docs-gap: Install one-liner `./aeon` is not a documented entry point for aeon-bench

tweet 2 of 8121 / 280

The vulnerable code (skills/show-hn-draft/SKILL.md:84-85): (full snippet at https://www.antfleet.dev/anatomy/3c2fcd11-0)

tweet 3 of 8280 / 280

What Opus saw: "The skill instructions hard-code the repo `aaronjmars/aeon` for the `gh api` stats fetch, the install one-liner the operator will paste publicly, and the issue-list check. The project itself is `AntFleet/aeon-bench`. If this skill is run from this repo, it will …

tweet 4 of 837 / 280

What GPT-5 saw: "Output unavailable"

tweet 5 of 897 / 280

Both flagged the same line range. AntFleet's unanimous gate fired — the finding posted on the PR.

tweet 6 of 893 / 280

The fix landed in commit 4b9b492: (view diff at https://www.antfleet.dev/anatomy/3c2fcd11-0)

tweet 7 of 881 / 280

AntFleet reviews every PR with two frontier models. Only unanimous findings post.

tweet 8 of 877 / 280

Full anatomy + reasoning + diffs: https://www.antfleet.dev/anatomy/3c2fcd11-0

Paste into X composer one tweet at a time. X has no multi-tweet intent API.

view receipt →all receipts →view disagreements →case studies →