Implement Real-time Data Ingestion with Kafka/Pulsar

implementationChallenge

Prompt Content

Set up a local Kafka or Pulsar instance (e.g., using Docker Compose) to simulate a live stream of sports event data. Implement a Python producer that pushes simulated `event_transcript` and `highlight_type` messages to a topic. Then, implement a consumer that feeds these messages into your DSPy content generation pipeline in real-time.

Try this prompt

Open the workspace to execute this prompt with free credits, or use your own API keys for unlimited usage.

Related Prompts

Explore similar prompts from our community

Design DSPy Pipeline for Sports Highlights

planning

Integrate Laminar Security for Policy Enforcement

implementation

Configure MLflow for Experiment Tracking and Model Versioning

evaluation

Usage Tips

Copy the prompt and paste it into your preferred AI tool (Claude, ChatGPT, Gemini)

Customize placeholder values with your specific requirements and context

For best results, provide clear examples and test different variations