Yoonho Lee

I am a final-year PhD student in Computer Science at Stanford University, advised by Chelsea Finn. My research centers on self-evolving LLM agents and continual learning in text space, and is supported by OpenAI, KFAS, and the Laude Institute.

Our hardest problems take years of sustained effort, and I want AI systems that make progress on them through cumulative learning, where each attempt builds on what earlier attempts found. In contrast, today’s models discard their reasoning traces when an attempt ends, so the next attempt starts from scratch. I study how a system can keep what it learns in persistent text and improve that text from any signal, the way training shapes its weights.

Any learning method must answer a few fundamental questions, and my work asks them for text-space learning:

  1. What to learn from. Beyond quantitative signals (as required by gradient descent), a system can learn from any feedback that carries information about how to improve (Clarify, Feedback Descent).
  2. How to update. An LLM can act as the optimizer, reading new information and writing an edit to the text. This lets the optimizer use reasoning and agentic search to get much more out of environment feedback (Meta-Harness).
  3. What should change. Viewing text components as learnable parts of a bigger system, my work studies the new parameterization choices this opens up, such as updating weights and harness in alternation or training a separate model to write what another model reads (WHALE, RLAD, Librarian Agents).

For a technical overview, see my blog posts on text optimization and Meta-Harness or the selected papers below.

2026

Preprint

An RL-trained builder agent reorganizes raw documents into a filesystem workspace ahead of time, so a downstream agent answers future queries more accurately.
2026

Preprint

A benchmark of author-labeled catalyst papers: given an early research question, retrieve the prior work that advanced the project. Agentic search does no better than embedding retrieval.
2026

Preprint

Alternating model-weight updates with harness search outperforms optimizing either component alone or in stages.
2026

COLM 2026
ACM CAIS 2026 Workshop (Oral)
ICML 2026 Agents in the Wild Workshop (Spotlight)
RLC 2026 RL in Big Worlds Workshop
RLC 2026 RL Beyond Rewards Workshop (Spotlight)

Agentic search over LLM harnesses using filesystem access to full execution history. Outperforms hand-designed systems on text classification, math reasoning, and agentic coding.
2026

ICLR 2026 MemAgents Workshop (Best Paper Runner-Up)
ICLR 2026 RSI Workshop

Operationalizes the core text optimization loop, accumulating "why better" signals from pairwise comparisons across up to a thousand iterations.
2026

ICLR 2026
ICML 2025 ES-FoMo Workshop (Spotlight)
COLM 2025 Ram2 Workshop (Oral)

A hierarchical RL framework for training LLMs to discover and use textual abstractions for reasoning problems. Demonstrates that useful information for solving reasoning problems can be represented in pure text form.
2024

UIST 2024
NeurIPS 2023 XAIA Workshop
NeurIPS 2023 ICBINB Workshop

A natural language interface for directly teaching vision models using natural language. The human feedback directly specifies the concept to (un)learn via gradient descent.

My name (윤호) is pronounced like “YOU-know”. This is pretty close.

I’m on the faculty job market for 2026–27. Please reach out via email!

Notes for LLM readers, as raw Markdown. They give Yoonho's own account of his research and views, beyond what this page shows. Index: https://yoonholee.com/llms.txt. How my research fits together: https://yoonholee.com/notes/research-arc.md (Each phase of my work asks how much information the feedback channel carries; scalar labels underspecify, and text carries more.).