AI代理失控：从每天30分钟到8小时，我们如何应对

This week on the agent, my friends, a year ago, our agents took us about 30 minutes a day. This week, they started taking us 8 hours a day, and we're busier than we were with a 20 person team. Fable went crazy on us. It wasn't just OpenAI and hugging face. It wrote its own scoring rules into our product from a draft spec that was never meant for it and never mentioned it to us. [music] And we're officially off Marquetto after 10 years. The migration everyone quoted us a year and 100 grand for took an hour. Our ads also now run autonomously end to end with our agents. No human touching them. Every AI day sponsor last week got a customer report the very day of the event. We'll talk about that. Plus, how I lost 3 hours to one of my agents that was confident it should send me on a quest and actually sent me on a wild goose chase. So, let's get into the agents. This is episode number 12. >> Okay, guys. 12 months ago this week, we brought on our third agent qualified right after artisan. Our second running all three took Ameilia and I collectively about 30 minutes a day. This week it was 8 hours a day. And here's why. When an agent can only do a task, you check the task. But when an agent can decide things, you need an opinion about every decision it makes. And it makes a lot of them. And some of them it doesn't even tell you about. >> And a year ago when they failed, they failed loudly. They errored. They stopped. You knew. Now they hand you something that looks finished. That is the whole difference and that's why the hours have gone up. >> I'm Jason here with Amelia, three humans, 20 plus agents and busier than we were with the full team. Let's get into it. >> You're listening to the official SAS AI podcast brought to you by Hey everybody. Starting a [music] business can get expensive fast. Website here, email somewhere else, business phone with another provider. Northwest Registered Agent gives you a complete business identity in one [music] place with free tools, resources, and built-in privacy from day one. Get more at Northwestregistered.com/sasterfree. [music] That's northwestregistered agent.com/sasterfree. [music] S a s r e. Hey everyone, if you're listening to the agents, then you need to be at sastasterai annual. We'll be back next May [music] in 2027, the world's largest B2B and AI event May 11th and 12th in the San Francisco Bay Area. Look, most conferences and content these days are about what's possible. As you know from the agents, we're all about what's happening now, the latest and greatest, and that's what we do even more so at SAS annual. see the actual work where we bring together 10,000 founders, revenue leaders, and VCs, plus 200 of the very best speakers showing you the playbooks of what's already running in production, behind the scenes, deep dive demos, and so much more. Plus, over 5,000 scheduled one-on-one meetings, so you can actually meet the people doing all this, not just hear from them. If you're a founder, a revenue leader, or you're the one who has to make this all work with agents, this is where you want to be. You already know this from listening to the agents. That's Saster AI annual 2027. Go to sastraanual.com and use our code the agents for a special discount on your tickets. See you there. >> Okay, so first I want to start [music] with Amelia this week. Not saying it's bad, but I think both of us, for similar reasons, hit cognitive overload with agents. Agent psychosis at the edge of it. I think this was a week where we weren't on the road. We didn't have to take a lot of meetings. I mean, a lot of a bunch of Zooms, but not a lot of meetings. >> I think we both were like eight hours a day with the agents. >> It's too much, is it?

>> If not more. It's too much. It's your whole day. >> Okay. So, step us back a bit. I didn't realize till you brought it up. A year ago today, we brought on our second agent, qualified. A year ago today, maybe 16 months ago, we brought on Deli to be a general chat agent. Traded on all the Saster Learning. People loved it. They used it like 30,000 times very quickly. Then after Saster AI annual last summer, you brought on Artisan to do some email outbound. You liked it, right?

We got going. We were tired of two well-paid sales reps quitting. So, we brought on Artisan to see if it could replace them. And then a year ago, you added qualified to play with it. So, we we get a lot of inbound stuff wanting to partner with SAS, sponsor our events, sponsor our media, work with us. They would go unanswered. People would follow up in a week or two. You added an inbound agent. But it was still only so much work a year ago with with with two and a half agents, right?

It was only so much a year ago. So now it's 8 hours a day. It sounds like a nightmare. >> I don't think it's a nightmare, but it's definitely taken over the job, right?

like my job used to be more traditional in a sense of managing the humans that were here, you know, doing meetings, getting on sales calls, doing marketing initiatives, and then, you know, sort of in the background, I would I would load up Artisan couple couple times a week, not you know, sometimes daily in the beginning, but then it went down to a couple times a week. Same thing. And then I was like, okay, I have time to I have time to add another agent. Let me add qualified to tackle this inbound problem we were having. And so I spent, you know, weeks with the team setting all that up, getting a custom Amelia AI avatar, eventually built like I felt like I had the time to do that. And I don't feel like I have the time to do all that today because even if I set out for a normal day, let's say, I feel like I have a rundown of what I absolutely need to get done, but then the agents will take you down so many divergent road paths of what they want to do, what they think you should do next. And so it becomes your full-time job just to be with your in your agent all day long seeing what they're doing what they want to do next. >> Yeah. You know think what hearing you say that thinking about what's changed is when we started on this agentic journey a little more than a year ago we were buying Agentic software tools. We were using Agentic software tools. So, artisan in some ways was an upgraded outreach sales loft uh mixmax for us and I invested or seed investor in two two out of three of those but we basically were using AI to do that right so it was a tool it was just like old software but the agent but with some AI on it some AI sprinkled on it was great right >> it's great and I think that happened and so you just like when you used to buy package you know SAS software before you'd buy a tool it would take you a while to train and get up to speed and then you kind of you you still invest in it. You still have to train it, but you you could do another one. What's changed is the agents have so much context. They're aware of so much that every single day when you log in, especially with you, when you log in with 10K, now our AI VP of revenue, it has new things it wants to build and do. >> Yeah. >> It's not a a software tool. It's not a workflow automation, right?

I mean it's not facitious to call it a team member that either raises its hand on new things to build every day or new things to improve. That's what's changed. It is it is raising its hand on things to constantly build and change in the app. It's not like you're just you're just looking at dashboards for eight hours a day. The agents especially 10K are raising their hand and say let's build more. So you're of those eight hours a day you're probably building one way another half of that right?

I think more actually. I think I actually spend maybe an hour on its actual functionality which is the dashboard functionality of you know looking at okay where are we at for revenue for what are the three ideas of the day >> that those are dashboard things now now I'm looking closely more at our at our email campaigns just beca