PaperBench: Can AI Agents Actually Replicate AI Research?
Model's Replication Scores
Average Replication Scores on PaperBench
research paper
OS-HARM: The AI Safety Benchmark That Puts LLM Agents Through Hell
Language models have come a long way. From playing autocomplete in your email to writing decent Python scripts, they’ve now levelled up into agents: full-blown task-doers who can click, scroll, type, and wreak havoc across your desktop. These “computer use agents” are smart enough to open your emails, edit
Tool Chaos No More: How We’re Measuring Model-Tool Accuracy in the Age of MCP
Introduction
Picture this scenario: you’ve built an AI agent, given it access to dozens of tools, and deployed it to handle a complex workflow. But instead of executing queries crisply, it’s making redundant tool calls, burning API credits needlessly, and overcomplicating straightforward processes.
This isn’t just an
Your Horrible Code is Making LLMs Evil: Exploring Emergent Misalignment
What is Emergent Misalignment?
One bad apple can spoil the bunch. Apparently this stands true when speaking of finetuning tasks too. A recent paper uncovered a quite interesting phenomenon: finetuning an LLM on insecure code led it to show homicidal tendencies in conversations. And this is not just a fluke,
Making Language Models Unbiased, One Vector At a Time
Introduction
AI has officially broken out of the tech bubble and into everyday workflows, boosting productivity but also raising safety concerns, especially around bias in large language models. These models inherit societal biases from internet data, and debiasing efforts by frontier labs can sometimes go too far (remember the racially
User Simulation in AI: From Rule-Based Models to LLM-Powered Realism
What if you could test your AI system with thousands of diverse users without recruiting a single person? User Simulation makes this possible. Simulating human users - a fundamental application of AI has driven progress in both research and industry. By allowing machines to imitate real user interactions, user simulation
Do Language Models Know That They're Being Evaluated?
Picture this scenario: You’re very new to AI, exploring chatgpt by testing its capabilities on various topics, expecting honest answers unaware that behind the scenes, it already figured out that it’s being tested and is subtly changing its behaviour to ace your tests.
This feels like a subtle