AntFleet

Disagreement · c9663187-anthropic-20

`PolymarketEnvironment.to_text_prompt` instructs LLM to use 'social media context' even when none is injected

solo Opus
repo 193af03f·PR #2·reviewed 1 week ago

Opus finding

`PolymarketEnvironment.to_text_prompt` instructs LLM to use 'social media context' even when none is injected

lowbughigh
  • backend/wonderwall/simulations/polymarket/environment.py:85-92
The closing instruction always references "social media context above" but the social media block is only appended if `extra_observation_context` is truthy. When omitted, the LLM is told to consider context that doesn’t exist, which can cause hallucinated reasoning ("based on Twitter sentiment...").

Recommendation

Only append the closing instruction’s second sentence when extra_observation_context is present.

Other reviewer

The other reviewer flagged nothing in this file/line range.

Why this didn't post

This finding didn't meet AntFleet's unanimous agreement threshold. Both frontier models review every PR independently; only findings they both flag with the same severity and category are posted to the PR. This one fell through.

read the methodology →