Benchmark Latency and Throughput

testingChallenge

Prompt Content

Create a benchmark script that simulates high-frequency incoming tasks for your agent system. Measure average latency and throughput. Analyze the results and identify potential bottlenecks, proposing optimization strategies based on hardware (e.g., GPU scheduling, memory access patterns) and software (e.g., prompt caching, batching).

Try this prompt

Open the workspace to execute this prompt with free credits, or use your own API keys for unlimited usage.

Usage Tips

Copy the prompt and paste it into your preferred AI tool (Claude, ChatGPT, Gemini)

Customize placeholder values with your specific requirements and context

For best results, provide clear examples and test different variations