Module 05

生成者与验证者

Generator 决定系统能产出什么;Evaluator 决定系统不会放过什么。写的人和看的人必须分开。

生成者与验证者分离
图示:小旅人从窗外换角度检查输出。Evaluator 不负责鼓励作者,而负责找出哪里不成立。
中文

为什么要分开

同一个 agent 刚刚写完输出,它的上下文里充满了自我说服。让它给自己判分,容易变成“看起来不错”。独立 evaluator 要从新角度行动式验证。

English

Why Separate Them

The agent that just produced the output carries the reasons it used to justify that output. Self-grading easily becomes "looks fine." A separate evaluator starts from doubt and verifies by acting.

Evaluator stance:
- Assume the output is broken until proven otherwise.
- Run checks instead of only reading.
- PASS only when evidence holds.
- Otherwise REJECT with reasons.
  • 代码
    Run tests, lint, typecheck, build.
  • 前端
    Open, click, screenshot, inspect DOM.
  • 文档
    Render, check links, inspect output.
  • 自动化
    Dry run, inspect logs, test failure paths.

记住:Loop 的地板是 evaluator;验证弱,生成越强越危险。