Autoresearch：自我改进智能体的反馈循环

Introspection’s Roland Gavrilescu at AIEWF.We’ve heard a lot about loops at the AI Engineer World’s Fair this week. Another buzzword is autoresearch, which involves building an “outer loop” where agents help maintain and improve the primary system, using feedback signals, evals and human input to make progress over time.At least, that was the framing of Roland Gavrilescu, co-founder and CEO of Introspection — a new company building infrastructure for deploying these self-improving systems. Before starting the company, Gavrilescu worked on agent infrastructure and cloud agents at xAI, where he met his co-founder, Julian Bright.Ahead of his “Autoresearch in the Wild” session at the AI Engineer World’s Fair today, I spoke with Gavrilescu about the shift from agent harnesses to feedback loops, the role of the open-source Pi framework, and why autonomous software factories must first learn from humans.From xAI to IntrospectionLatent Space: How did your new company, Introspection, come about?Roland Gavrilescu: Last year, I was at xAI, where I met my co-founder. We were working on agent infrastructure and cloud agents, and we felt there was a new agent form factor that needed to be explored further. xAI was not necessarily the environment where we could focus completely on that.We decided to leave and ask what a company designed around this new form factor might look like. We were interested in what made companies such as Cursor and Cognition successful, and how we could turn some of those ideas into a product that others could use.That became the basis for Introspection.Autoresearch allows you to build loops in which agents help maintain the system itself. The challenge is designing the right signals and feedback mechanisms so agents can improve the system, make architectural decisions and move in the right direction without constantly being bottlenecked by humans.The loop becomes the productLatent Space: Your session is titled “Autoresearch in the Wild” — what will it cover?Gavrilescu: We have heard a lot about what autoresearch can do for improving experiments, but we wanted to talk about what these loops look like in production.We are presenting three patterns that we think form the basis of a new blueprint.The first is that the loop is the product. We have moved from focusing on models, to harnesses, and now to loops. The key question is whether you can define the right feedback mechanisms so agents can take on more work without generating more slop.The second pattern concerns what the loop generates and how you track it over time. We are proposing a concept called an agent recipe.We moved from agent tools to agent skills. Recipes are a larger container that brings together the components needed to encode human expertise: evals, judges, signal processing and the information that feeds back into the loop.The goal is to create a portable format that agents can iterate on, almost like a research laboratory, but in a provider-agnostic way.The third pattern is about what we optimize for. How can the system become both better and cheaper over time?Companies such as Cursor and Cognition have shown that these products can work. The next stage is making them more accessible, faster and cheaper, and gradually distilling the capabilities of frontier models into systems that you own and that are customized for your environment.Agent recipesLatent Space: Can you explain more about what an agent recipe is…Gavrilescu: It’s like a description of the ingredients you need and how they evolve.The idea comes partly from data recipes used in model post-training. A data recipe describes how much data from different domains should be baked into a model.Agent recipes are similar. A recipe might describe how your harness works with different models, the evals you use, the judges you have created, the human expertise you have captured and the failures that led to new evals.Imagine that tomorrow you suddenly gained access to the Devin codebase. The code alone would not necessarily be that helpful if you could not see how the team arrived at the current version. You would want to understand the failures, mistakes and decisions that informed it.A recipe captures that process. You begin with a baseline and then record how each signal produced a new judge, embedded new human expertise or led you to introduce a different model.The inner loop and the outer loopLatent Space: Does autoresearch mean orchestrating multiple agents, or can it involve one agent repeatedly working and verifying its results?Gavrilescu: You can think of the system as having an inner loop and an outer loop.The inner loop is the primary system interacting with users and performing the work. Autoresearch is more concerned with the outer loop: another system that studies and maintains the primary system.The question is how to design that outer loop so it makes progress on the right problems without consuming an unreasonable number of tokens while deciding what to do.Pi as the Linux of agent harnessesLatent Space: You have compared Pi to Linux. In that analogy, is Introspection something like Red Hat?Gavrilescu: Pi is like the Linux of agent harnesses. Linux has distributions such as Ubuntu, but the underlying system is designed to be extended. Pi is similar: it was never intended to be run as an unchanged, vanilla product. Pi separates the agent loop from its extensions and configuration, which makes the agent portable. You can spin up several different agents by loading different files into the runtime.We saw an opportunity to combine that extensibility with recipes and open-source building blocks that can evolve for each customer while remaining portable and easy to deploy.Making loops reliable in productionLatent Space: Reliability and the messy reality of agent loops have been recurring themes at the conference. How does Introspection address those problems?Gavrilescu: The product is designed around the point at which you are ready to move into production.You need to know what infrastructure is required to make the loops work, keep costs under control and maintain security. The managed infrastructure covers what is necessary for these systems to operate in production.A major part of our focus is bringing the kind of infrastructure available inside frontier AI laboratories to a product that other companies can deploy.Humans remain part of the systemLatent Space: What about the human in the loop?Gavrilescu: These loops are designed with humans in the loop because you need the right signals as the system makes progress.The human can effectively become a tool and a source of signals. Agents can be trained to ask people questions through an “ask a human” tool.During its first few loops, an agent may rely heavily on asking questions and learning what a human would do. Over time, it accumulates those preferences and can become increasingly autonomous.It is similar to an employee joining a new company. Initially, that employee asks a lot of questions. As they learn how the organization works, they can make more decisions independently.Taking agent infrastructure into vertical marketsLatent Space: So what kinds of use cases are you seeing?Gavrilescu: We are concentrating on vertical agents.Coding agents are clearly working, and we have seen a number of companies succeed in that area. The next question is how to deploy agents in vertical and non-coding domains.Companies in those markets are asking how they can do this securely without becoming dependent on a single provider. They want the deployment to belong to them, they want to retain ownership of their data, and they do not want to be locked into OpenAI or Anthropic. Introspection is intended to provide infrastructure that addresses those requirements using open-source building blocks.Frontier AI labs have developed sophisticated internal agent technology. We want to bring similar capabilities into vertical SaaS and services businesses.Why the work happens in GitLa

原文超出正文长度上限，此处截断——上游还有内容，完整版见上方「原文 ↗」。