Implement Ablated Models & Evaluation Framework

implementationChallenge

Prompt Content

Implement the necessary modifications for each ablation scenario you designed, creating distinct model versions or a configurable model. Ensure each ablated model can be trained and evaluated using the Criteo dataset and your robust AUC evaluation harness. Develop an automated script or framework that orchestrates the training and AUC evaluation for the full agent and each ablated version, collecting and storing the AUC scores for subsequent analysis.

Try this prompt

Open the workspace to execute this prompt with free credits, or use your own API keys for unlimited usage.

Usage Tips

Copy the prompt and paste it into your preferred AI tool (Claude, ChatGPT, Gemini)

Customize placeholder values with your specific requirements and context

For best results, provide clear examples and test different variations