Skip to main content
Challenge

GovTech Passkey Migration Workflow Automation with Mastra AI and Ellipsis

GovTech Singapore is accelerating the transition from legacy password logins to FIDO2 passkeys across government digital services. Build a Mastra AI workflow combined with Ellipsis agent tools to audit legacy authentication logs, identify migration bottlenecks, and trigger automated developer guidance notifications for passkey adoption.

Workflow AutomationHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Create a TypeScript workflow in Mastra AI using Ellipsis integration tools to audit authentication infrastructure and automate GovTech passkey migration.

Delivery guide

How work is evaluated

Evaluation

Evaluates Mastra AI workflow execution in assessing application passkey compliance and generating developer pull request suggestions.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

pr_trigger_check

Ensures workflow triggered Ellipsis refactoring actions

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

audit_coverage

Percentage of legacy endpoints correctly flagged • target: 1 • range: 0-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Construct Mastra AI TypeScript agents with tool-calling capabilities

  • Utilize Ellipsis interface tools to generate automated code refactoring guidance

  • Audit service authentication endpoints for WebAuthn / Passkey readiness

  • Automate public sector application upgrade workflows for zero-trust security

Resources and assets

Reference links and supporting material

Dataset notes

Configuration metadata and code structures of simulated legacy government authentication services.

Challenge setup

Evaluates Mastra AI workflow execution in assessing application passkey compliance and generating developer pull request suggestions.

Challenge input

JSON containing application service inventory and authentication configuration JSON

Mastra AI

Provides typed workflows, step execution, and agent memory management

Ellipsis

Automates developer pull requests and guidance snippets for passkey adoption

Evaluated output

JSON containing passkey_readiness_score, deprecated_endpoints, and recommended_actions

Evaluation checks
  • Ensures workflow triggered Ellipsis refactoring actions
  • Percentage of legacy endpoints correctly flagged • target: 1 • range: 0-1
Configured evaluation evidence
  • Benchmark: Software Refactoring and Security Benchmark
  • Audit Coverage target: 1
  • 1 public reference case
Configured runtime
  • JavaScript execution harness
  • javascript sandbox (unavailable on Versalist)

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Mastra AI · Required
  • Ellipsis · Optional
  • Guidance · Optional
Orchestration
  • Mastra AI · Required

Evaluation contract

  • pr_trigger_check · Weight 1
  • audit_coverage · Weight 1

Metrics

  • audit_coverage · Target 1

Benchmarks

  • Software Refactoring and Security Benchmark
  • security

Reference cases

  • 1 public reference case

Workflow tasks

  1. Task 1

    Input: JSON containing application service inventory and authentication configuration JSON

    Output: JSON containing passkey_readiness_score, deprecated_endpoints, and recommended_actions

    Execution harness: JavaScript

Evaluation tools

  • Mastra AI · TypeScript Agent Framework
  • Ellipsis · Assistants & Code Generation

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about GovTech Passkey Migration Workflow Automation with Mastra AI and Ellipsis