Back to prompt library
Design Airflow Data Pipeline for EDR Logs
Linked challenge: AI-Driven Stealthy Threat Detection
Prompt source
planning1 lines1 sectionsNo variables0 checklist items
Design an `Apache Airflow` DAG that simulates an EDR log processing pipeline. It should include tasks for data ingestion (e.g., from a file or simulated stream), initial parsing, and a placeholder for anomaly detection. Outline the structure of your DAG, including task dependencies and potential branching. How will your pipeline handle different types of EDR logs or potential data volume?