Solumn AI
Jul 2026 to present, part-timeAI Data Engineer
- Coding-agent evaluation data, part-time. Each task rebuilds an open-source project at a historical commit in a digest-pinned Docker image, checks that the project's own tests fail before the fix and pass after it, and ships with a reference solution and an automated grader.
- I keep the tooling around it running: a registry of candidate repositories, a pre-check against the acceptance bar, duplicate detection, build caching and an audit step before anything is submitted.
- Part of the pipeline runs through model agents in separate lanes; I write the protocols they follow, set their budgets and check what they produce.
- Each reviewer return is logged and read back into the pre-check, so the same miss is not made twice. Submissions so far have all been accepted.