Skip to main content
Loading navigation
Back to prompt library

Configure CrewAI & Agno KV Cache Planner

Linked challenge: CrewAI & Agno Long-Context KV-Cache Capacity Planner

Prompt source

implementation7 lines4 sectionsNo variables0 checklist items
from crewai import Agent, Crew, Task
from agno.agent import Agent as AgnoAgent

# Define Agno telemetry agent
telemetry_agent = AgnoAgent(name='VRAM Monitor', instructions='Track GPU memory fragmentation and KV-cache blocks')

# Define CrewAI capacity planning agent
planner_agent = Agent(role='Capacity Planner', goal='Compute precise KV-cache bounds for GQA models', backstory='Expert in LLM VRAM allocation')

# Create task to evaluate context scaling up to 1M tokens