Skip to main content
Challenge

Proactive Smart Home Security Agent

Inspired by Amazon's latest Ring cameras and Alexa+ integrations, this challenge tasks developers with building an advanced agentic system for proactive smart home security. The system will leverage a team of specialized agents to monitor simulated smart home data (security camera feeds, sensor data), detect anomalies, analyze potential threats, and trigger intelligent, contextual responses. This involves sophisticated multimodal reasoning and tool integration. The core of the challenge lies in orchestrating a CrewAI like (you could use any other multi-agent framework) team of agents, where each agent contributes to a holistic security posture. One agent might be responsible for visual anomaly detection, another for contextual reasoning based on user preferences and historical data, and a third for dispatching alerts or controlling smart devices (e.g., flashing lights, playing an audio warning via Alexa+). The system should prioritize adaptive decision-making and efficient resource utilization, mimicking a human security operations center but at machine speed.

Special Purpose AgentsHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Build a multi-agent system using Claude Sonnet 4.5 for proactive smart home security and adaptive response.

Delivery guide

How work is evaluated

Evaluation

The solution will be evaluated on its ability to accurately detect simulated security incidents, generate contextual alerts, and demonstrate intelligent, proactive responses using its CrewAI agent team and MCP-enabled tools. Code quality, modularity, and adherence to specified frameworks will also be assessed.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Learning goals

What you should walk away with

  • Design and implement a multi-agent system using CrewAI for security monitoring.

  • Implement adaptive thinking within agents to handle varying levels of threat complexity.

  • Integrate Claude Opus 4.1 for advanced multimodal anomaly detection and reasoning.

  • Develop MCP-enabled tools for simulating smart device control and alert dispatch.

Resources and assets

Reference links and supporting material

Dataset notes

Sample data for 1 tasks

Challenge setup

The solution will be evaluated on its ability to accurately detect simulated security incidents, generate contextual alerts, and demonstrate intelligent, proactive responses using its CrewAI agent team and MCP-enabled...

Challenge input

{'event_type': 'str', 'timestamp': 'str', 'simulated_video_description': 'str', 'simulated_sensor_data': {'door_status': 'str', 'motion_detected':...

Agent execution

No agent tool is listed for this challenge.

Evaluated output

{'detection_status': 'bool', 'threat_level': 'str', 'alert_message': 'str', 'actions_taken': ['str']}

Evaluation checks
  • The system must successfully detect 100% of critical threat incidents (e.g., intrusion, suspicious activity).
  • At least 80% of detected incidents must have the correct threat level (High, Medium, Low).
  • For high-threat incidents, at least 2 predefined proactive actions must be taken.
Configured evaluation evidence
  • FalsePositiveRate target: 5%
Configured runtime
  • Python execution harness

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

No tool records are attached.

Evaluation contract

  • The system must successfully detect 100% of critical threat incidents (e.g., intrusion, suspicious activity).
  • At least 80% of detected incidents must have the correct threat level (High, Medium, Low).
  • For high-threat incidents, at least 2 predefined proactive actions must be taken.

Metrics

  • FalsePositiveRate · Target 0.05
  • ContextualAlertQuality · Target 0.85

Workflow tasks

  1. Task 1

    Input: {'event_type': 'str', 'timestamp': 'str', 'simulated_video_description': 'str', 'simulated_sensor_data': {'door_status': 'str', 'motion_detected': 'bool'}}

    Output: {'detection_status': 'bool', 'threat_level': 'str', 'alert_message': 'str', 'actions_taken': ['str']}

    Execution harness: Python

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Proactive Smart Home Security Agent