LIVE
Google Introduces "Gemini 4 Carbon" as Next Step in Its Model Lineup28/10/26 · Google|DeepMind unveils Genie 4, a new generation of world model27/10/26 · Google DeepMind|Anthropic files IPO prospectus, with risk disclosures taking center stage26/10/26 · Anthropic|Robot policy trained only in simulation matches top real-world systems26/10/26|OpenAI unveils GPT-6.1 Terra, a model built for computer use26/10/26 · OpenAI|Google's AI gives evasive answers about who won the 2020 US election28/10/26 · Google|NVIDIA introduces Nemotron 3.5 Transcribe, a promptable multilingual transcription model28/10/26 · NVIDIA|OpenAI and ServiceNow deepen partnership on enterprise workflows28/10/26 · OpenAI|Failed startups' data finds a second life training AI models28/10/26|Anthropic expands AI for Science program to 20 foundations and research institutions28/10/26 · Anthropic|Anthropic shares early results on using Claude to accelerate drug development27/10/26 · Anthropic|GEPA-Curator: Filtering Failures to Better Train LLM Agents27/10/26|Google Introduces "Gemini 4 Carbon" as Next Step in Its Model Lineup28/10/26 · Google|DeepMind unveils Genie 4, a new generation of world model27/10/26 · Google DeepMind|Anthropic files IPO prospectus, with risk disclosures taking center stage26/10/26 · Anthropic|Robot policy trained only in simulation matches top real-world systems26/10/26|OpenAI unveils GPT-6.1 Terra, a model built for computer use26/10/26 · OpenAI|Google's AI gives evasive answers about who won the 2020 US election28/10/26 · Google|NVIDIA introduces Nemotron 3.5 Transcribe, a promptable multilingual transcription model28/10/26 · NVIDIA|OpenAI and ServiceNow deepen partnership on enterprise workflows28/10/26 · OpenAI|Failed startups' data finds a second life training AI models28/10/26|Anthropic expands AI for Science program to 20 foundations and research institutions28/10/26 · Anthropic|Anthropic shares early results on using Claude to accelerate drug development27/10/26 · Anthropic|GEPA-Curator: Filtering Failures to Better Train LLM Agents27/10/26|
Research

GEPA-Curator: Filtering Failures to Better Train LLM Agents

A new method selects which agent experiences are genuinely useful for prompt optimization, filtering out noisy failures, with gains of up to 21% across several benchmarks.

October 27, 20263 min readPublished byarXiv

Reflective prompt optimizers such as GEPA rely on analyzing an agent's failures to refine its instructions over successive iterations. But in complex agentic environments, a failure does not always point to a weakness in the prompt itself—it can instead stem from harness limitations, stochastic execution, or an unreliable automated judge. The researchers argue that such failures provide little useful learning signal, and can even be harmful, making it important to filter which tasks are fed into the optimizer in the first place.

GEPA-Curator adds two components to this type of pipeline. Task curation screens out cases likely to generate noisy or unreliable signal before they can skew optimization. Prior success retrieval selectively pulls past successful trajectories for a given task and feeds them as additional context to the optimizer, steering prompt improvement beyond simply reacting to recent failures.

The authors test the framework on four agentic benchmarks—GoBrowse, ALFWorld, AppWorld, and τ-bench—using Gemini 3.1 Pro and Claude Opus 5 as the underlying optimizer models. GEPA-Curator consistently matches or outperforms baseline methods, with reported gains of up to 20.7% over GEPA and 21.2% over ACE.

The work fits a broader push to make LLM agents self-improving without costly retraining, by acting purely on prompts and contextual information. The underlying premise—that not all agent experiences are equally valuable for reflective learning—is a reasonable one, though its robustness on real-world production tasks, beyond controlled benchmarks, remains to be seen.

Tags
agentsprompt-optimizationself-improvementreflective-learningbenchmarksllm

Read also

GEPA-Curator: Filtering Failures to Better Train LLM Agents · nAIvigate