Frequently Asked Questions
Common questions about challenges, evaluations, and the platform.
Choose a brief from the directory, review the required tools and eval harnesses, then click Start Challenge. You'll authenticate with Google or GitHub, after which the full workflow, resources, and submission forms unlock.
Every challenge pairs real or production-like datasets with Model Context Protocol toolchains and automated scoring. You'll implement agents, run evaluations locally, and document decisions exactly how engineering teams expect.
Each brief ships with automated evals that validate functionality, edge cases, and safety. Completing those checks unlocks peer review, where community mentors provide qualitative feedback. Leaderboards reflect both eval scores and review sign-off.
The challenge detail page displays every required step: research, implementation, eval runs, and retros. Progress bars update as you submit artifacts or pass evals, and your dashboard shows completion across all active challenges.
Join live office hours, drop questions in the Discord build channels, or review the guide linked inside each brief. Maintainers and alumni regularly share tooling tips, dataset primers, and eval debugging walkthroughs.
Yes. If you've already implemented a comparable solution, document the repo link, eval evidence, and a summary of what you would improve. Facilitators verify it before marking the step complete.
Leaderboards update once automated eval logs are uploaded and peer reviews are approved. Double-check that you've synced your eval run output and requested review; pending reviews are visible in the submissions tab.
Head to My Challenges from the navigation. You'll see active, scheduled, and completed briefs along with certificates, eval histories, and downloadable portfolio summaries.
Update the Email for notifications setting inside your profile. You can opt into shipping reminders, review alerts, and new challenge announcements individually.
Each challenge includes a sponsor contact. For platform-wide rewards, message the Versalist team via support@versalist.com and include your submission details.