Skip to content

docs: add benchmark segmentation guidance to prevent agent timeouts#163

Merged
LeeCampbell merged 1 commit intoHdrHistogram:mainfrom
LeeCampbell:chore/benchmark-timeout-guidance
Mar 23, 2026
Merged

docs: add benchmark segmentation guidance to prevent agent timeouts#163
LeeCampbell merged 1 commit intoHdrHistogram:mainfrom
LeeCampbell:chore/benchmark-timeout-guidance

Conversation

@LeeCampbell
Copy link
Collaborator

Summary

  • Add timeout warning to testing standards: full benchmark suites exceed the 30-minute agent iteration timeout
  • Document three segmentation strategies (by class, by runtime, or combined) with concrete command examples
  • Add timeout keyword to spec README index for discoverability

Test plan

  • Verify the documented --filter and --runtimes flags work with dotnet run commands
  • Confirm a single-class, single-runtime benchmark run completes well within 30 minutes

🤖 Generated with Claude Code

Full benchmark suites (3 classes × 3 runtimes) exceed the 30-minute
agent iteration timeout. Document segmentation strategies so agents
run benchmarks by class, by runtime, or both.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@LeeCampbell LeeCampbell merged commit fdea5d3 into HdrHistogram:main Mar 23, 2026
2 checks passed
@LeeCampbell LeeCampbell deleted the chore/benchmark-timeout-guidance branch March 23, 2026 01:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant