Data Ingestion and Preprocessing Strategy

implementationChallengeNovember 27, 2025

Prompt Content

Describe your strategy for ingesting real-time data from various sources (e.g., news RSS feeds, social media APIs). How will you handle data cleaning, deduplication, and chunking to optimize input for Claude Sonnet 4 and the DSPy pipeline? Consider error handling and rate limiting for external API calls.

Related Prompts

Explore similar prompts from our community

Design a DSPy Pipeline for ESG Information Extraction

planning

Integrating Ax for Prompt Optimization

implementation

Designing the ESG Risk Scoring and Alerting System

implementation

Usage Tips

Copy the prompt and paste it into your preferred AI tool (Claude, ChatGPT, Gemini)

Customize placeholder values with your specific requirements and context

For best results, provide clear examples and test different variations