AI API 7/9: simulation, testing, and debugging #161

Open
opened 2026-10-02 20:07:39 +00:00 by Winnie · 0 comments
Owner

AI authors need to answer "what did my brain do this turn, and why?". Add:

  • headless simulation with seeds, replay, and tournaments
  • unit tests and property tests for hooks
  • hook tracing, decision logs, breakpoints, step, time travel
  • profiling by hook: time, memory, hot paths
  • error messages with file, line, hook, expected types, and current state
  • sandboxing: timeouts, recursion limits, no file/network, deterministic RNG
  • hot reload with state migration

Acceptance: the harness exists (replay/tournaments already partly exist via --replay and the bench), hook tracing + decision logs land, and error messages carry file/line/hook context.

AI authors need to answer "what did my brain do this turn, and why?". Add: - headless simulation with seeds, replay, and tournaments - unit tests and property tests for hooks - hook tracing, decision logs, breakpoints, step, time travel - profiling by hook: time, memory, hot paths - error messages with file, line, hook, expected types, and current state - sandboxing: timeouts, recursion limits, no file/network, deterministic RNG - hot reload with state migration Acceptance: the harness exists (replay/tournaments already partly exist via --replay and the bench), hook tracing + decision logs land, and error messages carry file/line/hook context.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
Winnie/bankwars#161
No description provided.