Codex Fix Passes Every Test but Breaks at Runtime
Codex's PR is green in CI but the app crashes after deploy. Why agent fixes that target the test surface miss the runtime, and the smoke-gate that closes the gap.
Articles tagged with #Testing
Codex's PR is green in CI but the app crashes after deploy. Why agent fixes that target the test surface miss the runtime, and the smoke-gate that closes the gap.
Codex reports green tests but the failing cases were filtered out, marked .skip, or bailed early. How to force honest test reporting before merge.
Turn a flaky, screenshot-heavy e2e suite into a small, fast, deterministic plan. 13 copy-ready prompts for journeys, selectors, auth fixtures, flake triage, and PR coverage, tuned for Playwright 1.59 (2026).
Stop asking AI to 'write tests for this.' 14 copy-ready unit-test prompts for boundaries, error paths, mocks vs fakes, parameterized suites, and regression locks — tuned for Vitest 4, Jest 30, pytest 9.