Back to challenges
Challenge

Offshore EPC Bid Evaluation and Risk Agent with Claude Agents SDK

Offshore oilfield expansion tenders involve evaluating multi-billion dollar EPC proposals across complex technical and commercial matrices. Develop an autonomous agent using Claude Agents SDK with extended thinking to parse vendor technical submittals, cross-check compliance against Qatari maritime standards, and calculate risk scores within 5% of benchmark evaluations.

Business OperationsHosted by Vera
Sign in free to start
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Build an autonomous technical bid analysis agent using Claude Agents SDK with extended thinking to evaluate offshore oil field EPC proposals.

Delivery guide

How work is evaluated

Evaluation

Evaluates technical compliance parsing and commercial risk scoring against benchmark judgments.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

non_compliance_flagging

Must flag proposal as non-compliant when jacket depth is insufficient

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

risk_scoring_accuracy

Deviation of generated risk score from human benchmark score • target: 95 • range: 0-100

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Build an autonomous agent with Claude Agents SDK utilizing Claude 3.7 Sonnet extended thinking

  • Extract compliance technical specs from complex EPC bid documentation

  • Cross-examine vendor jacket installation timelines against Qatari offshore safety codes

  • Generate weighted scorecards for commercial and technical proposal evaluation

Resources and assets

Reference links and supporting material

Dataset notes

Offshore platform engineering proposals, Qatari regulatory specs, and bid matrix data for Qatar offshore field expansion.

How this agent runs

Evaluates technical compliance parsing and commercial risk scoring against benchmark judgments.

Challenge input

JSON containing vendor proposal details and mandatory technical specs.

Claude Agents SDK

Required Anthropic framework for autonomous extended thinking agents

Evaluated output

JSON containing technical compliance score, identified risk flags, and overall recommendation.

Checks for
  • Must flag proposal as non-compliant when jacket depth is insufficient
  • Deviation of generated risk score from human benchmark score • target: 95 • range: 0-100
Proof of success
  • Benchmark: Complex Commercial Bid Evaluation Benchmark
  • Risk Scoring Accuracy target: 95
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox
View technical recipe

Configured tools

Action Space
  • TPOT · Required
  • ElevenLabs · Optional
Observation
  • Arize Phoenix · Optional
Reward / Eval
  • Arize Phoenix · Optional

Evaluation contract

  • non_compliance_flagging · Weight 1
  • risk_scoring_accuracy · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about Offshore EPC Bid Evaluation and Risk Agent with Claude Agents SDK