|a Futurum companyCoverage
Cloud NativeCI/CDDevSecOpsPlatform EngineeringDataOpsContinuous TestingLow-Code / No-CodeIT as CodeEnterprise DevOpsMedia
Techstrong TV LiveVideo InterviewsTech Field DayTechstrong GangAgents of DevSecurity BoulevardCloud Native NowDigital CxO
Contributing Writer
Graham Neubig is a co-founder and Chief Scientist of All Hands AI, and an Associate Professor at the Language Technologies Institute at Carnegie Mellon University. One of the leading academic voices in AI agents and natural language processing, Graham has been responsible for core advances in the field โ including foundational work on open-source large language models for code and among the first agents designed to complete tasks on the open web.
AI coding agents are becoming more capable, but evaluating them is harder than it looks. Most benchmarks focus on a single dimension of agent capabilities; for instance, the popular SWE-Bench benchmark only focuses on fixing issues on open source Python repositories. Real-world software engineering involves fixing bugs of course, but it is a lot more [โฆ]
Apr 28, 2026 ยท 3 min