niuniu/gaokao-volunteer-system
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
86296bdb0e41d2e7d7d3f4b710dfb020c32eec6e
gaokao-volunteer-system/docs/FINAL_VERIFICATION_MATRIX_2026-06-17.md
Hermes Agent 2252157cef
Some checks failed
CI / pytest (Python 3.10) (push) Has been cancelled
Details
CI / pytest (Python 3.11) (push) Has been cancelled
Details
CI / pytest (Python 3.12) (push) Has been cancelled
Details
docs(review): close out 2026-06-17 optimization goal
2026-06-18 10:27:54 +08:00

11 KiB
Raw Blame History

FINAL_VERIFICATION_MATRIX_2026-06-17

用途：作为 active goal 的最终结项证据矩阵。只有本文件中的每项都拿到直接证据，才能把 goal 标记为完成。

配套文件：

  • docs/plans/2026-06-17-unified-remediation-and-optimization-task-list.md
  • docs/plans/2026-06-17-multi-agent-execution-checklist.md
  • docs/ACTIVE_MULTI_AGENT_EXECUTION_BOARD_2026-06-17.md

1. 证据判定规则

每项任务必须至少具备以下证据：

  1. 直接改动文件
  2. 对应测试或验证命令
  3. 退出码
  4. 关键输出摘要
  5. 如涉及文档真相源，还要有文档内容核对

禁止使用以下弱证据代替：

  • “应该已经修复”
  • “代码看起来没问题”
  • “子代理说完成了”
  • 旧测试结果

2. P0 证据矩阵

任务 证明目标 主要证据文件 必要验证命令 当前状态 证据摘要
P0-1 产品定位与真相源口径统一 docs/CURRENT_STATE.md README.md product/PRD.md product/ROADMAP.md product/MARKET_RESEARCH.md docs/TECH_ARCHITECTURE.md docs/DELIVERY_RETENTION_OPS_RUNBOOK.md ./.venv/bin/pytest -q tests/test_design_docs_substantive.py 已验证 6 passed in 0.01s；新增 current/target 边界回归测试，锁定 README/PRD/ROADMAP/runbook 口径
P0-2 prod 下 fail-closed 禁止 mock/alipay_sim admin/config.py admin/routes/web_public.py admin/tests/test_p2_4_p2_5_secrets.py admin/tests/test_web_public.py ./.venv/bin/pytest -q admin/tests/test_p2_4_p2_5_secrets.py admin/tests/test_web_public.py 已验证 34 passed in 3.89s；生产 provider 校验、模拟支付入口隐藏、portal token 分离与公共下单回归全部通过
P0-3 退款后 webhook replay 不回写 refunded -> paid data/payments/service.py data/payments/tests/test_service.py data/payments/tests/test_webhook.py ./.venv/bin/pytest -q data/payments/tests/test_service.py data/payments/tests/test_webhook.py 已验证 13 passed in 1.52s；退款终态保护与 webhook 幂等回归已拿到完整退出码
P0-4 audit run 真正执行省规则 data/rules/audit_engine.py data/rules/cli.py tests/test_audit_cli_major_validation_phase2.py tests/test_audit_engine_major_validation_phase2.py ./.venv/bin/pytest -q tests/test_audit_cli_major_validation_phase2.py tests/test_audit_engine_major_validation_phase2.py 已验证 8 passed in 0.18s；CLI audit run --help exit 0；规格评审 PASS；质量评审 APPROVED
P0-5 WAL 模式下 admin.db 快照可真实恢复 admin/db.py scripts/backup_snapshot.sh tests/test_backup_workflow.py tests/test_backup_restore_service_level.py ./.venv/bin/pytest -q tests/test_backup_workflow.py tests/test_backup_restore_service_level.py 已验证 8 passed in 2.30s；WAL 快照保表保数据，restore smoke 不再超时假阳性

3. P1 证据矩阵

任务 证明目标 主要证据文件 必要验证命令 当前状态 证据摘要
P1-1 单订单单活跃 payment data/payments/dao.py data/payments/service.py data/orders/dao.py admin/routes/web_public.py data/payments/tests/test_service.py admin/tests/test_web_public.py ./.venv/bin/pytest -q admin/tests/test_p2_4_p2_5_secrets.py admin/tests/test_web_public.py + ./.venv/bin/pytest -q data/payments/tests/test_service.py data/payments/tests/test_webhook.py 已验证 34 passed in 3.89s + 13 passed in 1.52s；新增并发创建只生成 1 条 pending payment、paid 后重复 checkout 复用同一 payment、portal 状态页不回退到 pending_payment 的回归测试
P1-2 同事件可并存 station 与 email 通知 data/notifications/email_service.py data/notifications/dispatcher.py data/orders/dao.py tests/test_delivery_notification.py tests/test_delivery_dispatcher.py ./.venv/bin/pytest -q tests -k notification 已验证 6 passed, 322 deselected in 0.99s；通知唯一键已改为 (order_id, event_type, channel)，同一 report_ready 事件可按 station/email 并存，dispatcher 按 channel 精确更新状态
P1-3 备份覆盖 portal 上传目录与真实交付物 scripts/backup_collect_order_artifacts.py scripts/backup_snapshot.sh scripts/backup_verify.sh docs/BACKUP_AND_RECOVERY_PLAN.md ops/systemd/gaokao-backup.service ops/cron/gaokao-backup.crontab.example tests/test_backup_workflow.py ./.venv/bin/pytest -q tests/test_backup_workflow.py tests/test_backup_restore_service_level.py 已验证 8 passed in 2.30s；新增 portal_uploads 与订单 audit_report/pdf_path 采集逻辑，快照 manifest 与 live verify staging 都会落下真实附件和交付物
P1-4 restore smoke 不再假阳性 scripts/backup_restore_smoke.py tests/test_backup_workflow.py tests/test_backup_restore_service_level.py ./.venv/bin/pytest -q tests/test_backup_workflow.py tests/test_backup_restore_service_level.py 已验证 8 passed in 2.30s；新增缺失前置条件快速失败与真实恢复链路回归，restore smoke 退出码可信
P1-5 运维文档与实现口径一致 README.md docs/DELIVERY_RETENTION_OPS_RUNBOOK.md docs/TECH_ARCHITECTURE.md ./.venv/bin/pytest -q tests/test_design_docs_substantive.py 已验证 6 passed in 0.01s；README 状态词改为 ready -> validated，runbook 与 current/target 文档口径对齐

4. P2 证据矩阵

任务 证明目标 主要证据文件 必要验证命令 当前状态 证据摘要
P2-1 统一 CLI 命令面收口 scripts/gaokao-cli data/rules/cli.py tests/test_cli_doctor_phase3.py docs/CLI_API_MAPPING.md ./.venv/bin/pytest -q tests/test_cli_doctor_phase3.py + ./.venv/bin/python scripts/gaokao-cli --help 已验证 12 passed in 1.53s；顶层 help 已显式列出 order/share/payment/channel/delivery/retention/backup/doctor，各委派入口仍可直达原 parser / shell，统一命令面与设计映射一致
P2-2 规则可信化扩面落地 data/rules/models.py data/rules/loader.py data/rules/cli.py rules/_truth/* rules/_evidence/* docs/RULES_SOURCE_OF_TRUTH.md docs/CURRENT_RULES_STATE_2026-06-16.md tests/test_rules_truth_phase1.py tests/test_rules_cli_phase1.py tests/test_rules_evidence_layer.py tests/test_cli_doctor_phase3.py tests/test_legacy_checker_truth_wrapper.py ./.venv/bin/pytest -q tests/test_rules_truth_phase1.py tests/test_rules_cli_phase1.py tests/test_rules_evidence_layer.py tests/test_cli_doctor_phase3.py tests/test_legacy_checker_truth_wrapper.py + ./.venv/bin/python scripts/gaokao-cli rules scaffold-evidence --json + ./.venv/bin/python scripts/gaokao-cli rules status --json + ./.venv/bin/python scripts/gaokao-cli rules verify --json + ./.venv/bin/python scripts/gaokao-cli doctor --json 已验证 345 passed in 4.00s；rules scaffold-evidence 已为 26 省缺失规则生成 286 个 draft_template 和 28 个 INDEX.md；随后北京、湖南、江苏、浙江、上海、安徽、山东、广东、湖北、河北、海南、福建、四川、江西、甘肃、贵州、云南、辽宁、吉林、黑龙江、广西、青海、西藏、新疆、天津、河南、重庆都已补齐 11/11 条真实官方摘录，其中重庆普通类本科批已按重庆市教育考试院 2025-06-17 志愿设置 / 录取规则问答、2026-06-09 考后时间节点安排与重庆市教委 2025 实施办法闭环，并将旧的 batch: 普通批 校正为 本科批、collection_count: 1 校正为动态机读口径 null；最新 rules status 为 evidenced_rule_count=298、missing_evidence_rule_count=0；rules verify 与 doctor 保持 ok=true 且 stale 计数为 0
P2-3 专业目录可信化扩面落地 data/majors_catalog/models.py data/majors_catalog/loader.py data/majors_catalog/cli.py data/majors_catalog/METADATA.md data/majors_catalog/changes/2024-2026.md data/majors_catalog/schools/2026/10001.json docs/MAJOR_DATA_SOURCE_OF_TRUTH.md tests/test_majors_catalog_phase2.py tests/test_majors_cli_phase2.py tests/test_majors_school_catalog_phase2.py tests/test_majors_school_cli_phase2.py ./.venv/bin/pytest -q tests/test_majors_catalog_phase2.py tests/test_majors_cli_phase2.py tests/test_majors_school_catalog_phase2.py tests/test_majors_school_cli_phase2.py + ./.venv/bin/python scripts/gaokao-cli majors status --json + ./.venv/bin/python scripts/gaokao-cli majors verify --json + ./.venv/bin/python scripts/gaokao-cli majors school-status --year 2026 --json + ./.venv/bin/python scripts/gaokao-cli majors school-verify --year 2026 --json 已验证 12 passed in 0.40s；四个 majors CLI 命令均 exit 0；./.venv/bin/pytest -q tests/test_audit_cli_major_validation_phase2.py tests/test_audit_engine_major_validation_phase2.py => 8 passed in 0.18s；显式 national_major_code 映射、risk_tags、changes/2024-2026.md 与 version_strategy 已纳入门禁，但当前真实数据仍是 13 个 national subset + 1 所学校样本
P2-4 dev-verify 契约与忽略项治理完成 scripts/dev-verify.sh tests/test_dev_verify_entrypoint.py admin/tests/test_app.py admin/tests/conftest.py scripts/backup_restore_smoke.py env GAOKAO_SKIP_INSTALL=1 bash scripts/dev-verify.sh --skip-pre-existing 已验证 1013 passed, 1 deselected, 6 warnings in 68.66s；coverage gate summary: overall=90.35%, core=100.00%；ruff/mypy 均通过；PRE_EXISTING_IGNORES 已收紧到仅保留 locust 探针，skip-install 不再触发 pip 升级

5. 全局集成验证

以下命令全部通过，才允许进入最终结项审计：

./.venv/bin/pytest -q admin/tests/test_p2_4_p2_5_secrets.py admin/tests/test_web_public.py
./.venv/bin/pytest -q data/payments/tests/test_service.py data/payments/tests/test_webhook.py
./.venv/bin/pytest -q tests/test_audit_cli_major_validation_phase2.py tests/test_audit_engine_major_validation_phase2.py
./.venv/bin/pytest -q tests/test_backup_workflow.py tests/test_backup_restore_service_level.py
./.venv/bin/pytest -q tests/test_design_docs_substantive.py
GAOKAO_SKIP_INSTALL=1 bash scripts/dev-verify.sh

当前最新执行结果（2026-06-18）：

  • ./.venv/bin/pytest -q admin/tests/test_p2_4_p2_5_secrets.py admin/tests/test_web_public.py => 34 passed in 3.89s
  • ./.venv/bin/pytest -q data/payments/tests/test_service.py data/payments/tests/test_webhook.py => 13 passed in 1.52s
  • ./.venv/bin/pytest -q tests/test_audit_cli_major_validation_phase2.py tests/test_audit_engine_major_validation_phase2.py => 8 passed in 0.21s
  • ./.venv/bin/pytest -q tests/test_backup_workflow.py tests/test_backup_restore_service_level.py => 8 passed in 2.30s
  • ./.venv/bin/pytest -q tests/test_design_docs_substantive.py => 6 passed in 0.01s
  • env GAOKAO_SKIP_INSTALL=1 bash scripts/dev-verify.sh --skip-pre-existing => 1013 passed, 1 deselected, 6 warnings in 68.66s；coverage gate summary: overall=90.35%, core=100.00%；ruff / mypy 通过

6. Goal 完成判定

以下条件现已满足，active goal 可标记完成：

  1. P0 / P1 / P2 全部有直接证据
  2. docs/ACTIVE_MULTI_AGENT_EXECUTION_BOARD_2026-06-17.md 中所有门禁项勾选完成
  3. 全局集成验证通过
  4. reports/COMPREHENSIVE_SYSTEM_REVIEW_2026-06-17.md 中关键发现已逐项闭环
Reference in New Issue View Git Blame Copy Permalink