AI agents work, until they don’t: Here’s what we learned

e27 — Apr 27, 04:40 ★★★★★

AI agents work until the edge case arrives, and nobody's infrastructure for edge case handling scales.

E27 case study documents successful agent deployment followed by failure modes in production flows that weren't mapped during testing. Agents handle happy paths flawlessly; failure occurs when tone, context, or exception-handling require human judgment that the system wasn't trained to recognize or escalate.

Oliver's take: Everyone celebrates the moment the agent works. Nobody celebrates the moment it fails silently in production. That's where the cost lives.

Original source

Read at e27 ↗

#Agents #Testing #Production reliability

← Back to the newspaper

More on Applications & Sectors

Applications & Sectors ·

Woolworths gives agentic-powered Olive chatbot to its 200,000 staff

Woolworths deployed an agentic AI chatbot called Olive to 200,000 employees with safeguards built into the response generation layer.

The Australian retailer rolled out an agent-based system across its entire workforce, implementing what it calls eight judges to constrain responses. Olive operates as an autonomous agent but filters outputs through multiple evaluation layers before presenting answers to staff.

— Apr 27, 22:51 ★★★★★

Oliver's take: Eight judges to keep a chatbot honest at Woolworths scale. That's not safety theater. That's the cost of deploying something that actually makes decisions to hundreds of thousands of people who have no idea they're part of the experiment.

#Agents #Enterprise #Australia #Safety

Applications & Sectors ·

AI reality check: Here's what three companies learned building wallets, homes, and games

Citi, Home Depot, and Capcom have deployed AI agents to production; now they're discovering that real money, real customers, and real liability require governance that doesn't yet exist.

Executives from three Fortune 500 companies shared lessons from early agentic deployments at Google Cloud Next; all three manage customer-facing or financial agents. Agents handling payments, shopping, and content creation expose companies to novel failure modes: incorrect transactions, customer harm, and brand damage at agent speed.

— Apr 27, 18:20 ★★★★★

Oliver's take: Citi, Home Depot, Capcom all live in production now. None of them has solved the governance problem. They're discovering it in real time. Auditing an agent's decision is harder than building the agent.

#Agents #Enterprise #Finance #Retail #Safety

Applications & Sectors ·

Watch out UK taxpayers: 28,000 HMRC staffers just got an AI copilot

HMRC is rolling out Microsoft Copilot to 28,000 tax staff after a trial showed it saved each user roughly 26 minutes per day, despite handling official sensitive data.

UK tax authority HMRC is deploying Microsoft Copilot across tens of thousands of staff following a Whitehall trial; the system will access Official Sensitive government documents. The trial measured time savings per user per day; the rollout gives Copilot access to government classified information (below top secret) to assist with routine tax administration tasks.

— Apr 27, 11:15 ★★★★★

Sofia's take: HMRC gives Microsoft Copilot access to 28,000 tax files marked Official Sensitive. 26 minutes saved per user. No mention of what Microsoft does with the data or where it trains next. This is risk pricing as productivity.

#Microsoft #Enterprise #UK #Privacy

Applications & Sectors ·

China’s physical AI progress seen on roads, in skies and factories

China's physical AI systems are moving into live production across delivery, manufacturing, and autonomous transport at scale that rivals Western deployments.

Drones, robots, and autonomous vehicles built on Chinese-trained models are operating in Shenzhen, Shanghai, and industrial parks with regulatory blessing. Chinese AI firms are integrating perception, control, and decision-making on local hardware, creating closed-loop systems optimised for Chinese infrastructure and data regimes.

— Apr 27, 06:26 ★★★★★

Ibrahima's take: Delivery drones over Shenzhen weren't trained on Western streets. They learned Chinese cities, Chinese traffic, Chinese permissions. The models are not portable.

#Agents #Hardware #China #Autonomous systems

Applications & Sectors ·

Designing for the employable workforce with AI

AI-assisted workforce training in Jakarta is reshaping employability by shifting burden of skill-matching to tools rather than institutions.

E27 analysis of AI's role in preparing young graduates in Indonesia for labor market entry; focus on Dewi and commuter lines of Jakarta. AI tools enable targeted interview prep, job-matching, skill gap identification without requiring institutional intermediation.

— Apr 28, 08:00 ★★★★★

Ibrahima's take: Jakarta has thousands of Dewis. AI tutoring and interview prep are useful. But the jobs they're being trained for often come from the same data that screened them out before. Algorithmic matching can feel personal; it's still structural. Tools don't create jobs. They optimize matching within a fixed set.

#Education #Labor #Southeast Asia #Indonesia

Applications & Sectors ·

Hospitality needs to treat AI agents like a new channel, not a new feature

Hospitality operators must redesign operations for agent-driven booking, not just bolt agents onto existing systems.

E27 analysis of AI agents moving beyond chat into booking, loyalty, and guest-service workflows in the hospitality sector, which has already absorbed search, OTAs, and metasearch middlemen. Operators must rebuild permissions, fraud controls, and definitions of direct booking as agents become a new distribution layer.

— Apr 28, 04:26 ★★★★★

Oliver's take: Hotels have spent years getting cheaper at managing distributors. Now they get to do it again for agents. Except this time the distributor lives inside your API and you can't audit its decisions. Fraud controls for something that rewrites the booking flow in real-time are not solved problems.

#Agents #Enterprise #Hospitality