The Knowledge LedgerThe Knowledge LedgerFollow on WhatsApp

A curated stream of high-signal insights across Technology, Healthcare, Lifesciences, AI, Oncology, Business, Entrepreneurship, Leadership, Philosophy and beyond.

Thoughtful, cross-disciplinary content designed to expand how you think, not just what you know.

No noise. Only substance.

Filtered by #benchmarksClear filter
Sep 14, 2026ยทarxiv.org

FrogNano: Training a 4B Coding Agent via Online Task Synthesis

A 4B coding agent, post-trained only with RL on synthetic software tasks, reaches 61.5% on SWE-bench Verified and beats models many times larger. No distillation from a frontier teacher. The missing ingredient is not a bigger model. It is tasks calibrated to what the current checkpoint can almost, but not quite, solve.

The pipeline estimates how often the agent already resolves a candidate task, then rewrites the ones that are too easy or too hard until they sit in a learnable band. As the policy improves, the curriculum moves: from heavily scaffolded bug fixes toward shorter statements and more diverse change types. A simple tool harness (read, write, edit, glob, bash) lifts the same 4B base far more than it lifts large models. Failures remain mostly reasoning, not tool use. Effective reward hacking is held at zero by the harness, not by hoping the agent is honest.

Aug 24, 2026ยทarxiv.org

Evaluating Skills, Not Just Agents - Skill Lift

Most review processes for agent skills still treat them as documents. They check structure, style, and security. They do not answer the deployment Liftquestion: does this skill actually help a live agent complete real tasks under the same model, sandbox, and grading policy?

ACES (Agentic Continuous Evaluation of Skills) answers that question with paired live trials. For each task the system runs the agent once with the target skill and once without it. Trajectories are normalized, graded on multiple runtime metrics, and compared. The central measure is Skill Lift: the measured improvement the skill produces under fixed conditions.