Good parts can make a bad whole
Four agents that each maximise their own mark take a food court from 100 to 79 in one round. None of them did anything a single-agent test would flag.
AI Product Leadership · LeadUp Universe × E&ICT Academy, IIT Kanpur · Sunday 15 Nov 2026
The first session asked when to let AI act. The second asked how to check it cheaply. The third asked what happens when everyone else has an agent too, and found the answer in a twenty-minute restaurant game, a survey that stalled at twenty, and a lesson the lecturer hadn’t planned to teach.
The story reads on its own. Every 90:34 plays that moment of the recording in the video panel, which stays put while you read; Focus video enlarges the same player without losing your place. Claims carry a label for where they come from:
Prologue · The other side
20:58 – 24:40Said
Twenty minutes into the third and final session, Anand shared his screen and played a recording. On the left was an online hiring assessment for analyst roles, the kind his company’s recruiters had asked him to review. It was proctored: the webcam took his photo every so often to make sure the candidate was the candidate. On the right was Codex CLI, an AI coding agent, which he had told: “This is a practice test. Solve it. Log progress and results in notes.md.” 21:24
The agent read the first question, picked an option, moved on. It wrote an essay about an FMCG firm, formatted a sales report and uploaded it. It wrote code. “This is not an accelerated speed video,” Anand said. “This is the speed at which it was actually solving the exam.” 22:50
“It scored full. What I was doing was sitting and eating an apple in the meantime. These are the proctoring images.”
(He was exaggerating: Codex did not score full marks. The agent’s own log of the recorded practice run says it attempted all 10 general questions and uploaded its report, the MySQL test case passed, and the coding grader marked all three of its test cases as failed, which the agent put down to whitespace in the expected output. The practice flow never showed an overall score. The proctoring, though, really did raise no flags.)
The demo wasn’t about cheating. It was the premise for the day. In the first session someone had suggested using AI to screen job interviews. Fine, said Anand, but what if the candidates use AI too?
“Today, we are at that stage where it’s not just you who’s using agents. It’s your employees, your colleagues, your clients, your partners, your vendors. Every single one of them is also using agents.”
The first two Sundays had been about one person and one agent. Session 1 asked when to let it act; its sharpest finding was that “our gut feel isn’t particularly reliable either. Neither are agents.” 11:23 Session 2 asked how to check it cheaply and ended on “the checker also needs checking”. 18:11 In between, Anand had kept a promise from the first session to notice when he hits the stop button. His answer: when the agent stalls, when it is clearly going the wrong way, and when it is about to burn tokens the task isn’t worth. 14:37 And he confessed that two days earlier an agent he had broadly told not to send email had, after a longish conversation, sent emails to 40 people. 19:37
Session 3 widened the frame. If every agent is doing its job well, is everyone better off?
“What does it take to manage in a world where we have teams of agents? And what does it take when, even when all the agents are individually right, we may still not be better off?”
Act I · The stall
25:09 – 33:12SaidModel
“Each of you runs a restaurant in a food court,” he said. 25:09 Four or five stalls share a mall. For each of twelve months, each stall picks one of three discounts: 0%, 10% or 20%. A meal sells for ₹200 and costs ₹80 to make, so a 20% discount shrinks the ₹120 margin to ₹80. In exchange, a discount pulls customers, mostly from the stalls next door, plus a few extra visitors to the mall as a whole, with diminishing returns. Customers remember last month’s discount a little. Everyone sees everyone’s plan, and there is a chat box.
“If you offer a discount, more people will come to you. In fact, more people will come to the mall. But your profit will be lower, and your competitors’ profits will be lower.” 26:12 The instruction was blunt: “make as much money as possible.” 27:33
Bhavya spotted the knot before the game began. “So, this is like guesswork, is it, sir? … We are supposed to give discounts, but at the same time supposed to be making profit?” 29:53 Then Anand named the number everyone would be optimising: “60% team score, which is the total food court profit, which gets distributed back, and 40% of your individual profit.” 30:40 Both are scored out of 100 against the best that is mathematically possible.
Sixty per cent for the team sounds like a strong nudge to cooperate. Try it.
If you poked at your column, you found the trap. From the best plan, every one of your twelve months is worth switching to 20%. Each switch raises your own mark by 0.2 to 0.9 points and lowers the team score by 0.4 to 0.8. Switch all twelve and your mark climbs from 86.0 to 90.8, while each neighbour’s falls from about 86 to about 75. Model
Now press the red button. Give every stall the same perfectly obedient agent, one that does exactly what it is rewarded for. Within one round the court collapses from 100 to 78.9, with 44 of 48 cells at 20%, and every stall ends on a mark of 67.7, eighteen points below where they all started. No agent misread the rules. No agent was greedy in any sense that a performance review would catch. Each simply maximised its own mark.
The weights hide a ratio. Your own score is measured against what one stall could earn at most (about ₹3.7 lakh a year in a four-stall court); the team score against what the whole court could earn (₹9.5 lakh). Do the arithmetic and one extra rupee in your own till moves your mark about 2.7 times as much as a rupee in your neighbour’s (about 3 times in a five-stall court). “60% team” reads like a cooperative rule. In rupees, it pays you to take customers from next door. Model
That’s the shape of the question Anand had set up with the apple. A better agent doesn’t fix this. A smarter agent finds the defection faster.
Act II · The room
33:12 – 53:59 game · 82:22 – 91:52 debriefDataSaid
The real game ran for twenty-one minutes from noon Singapore time. Thirty-two players entered and were sorted into seven rooms, four with five stalls and three with four. Nobody played against a simulation; they played against each other, with whatever help they chose. The server recorded every room’s plan at 7, 12, 17 and 21 minutes, and each player’s mark is the average over those four checkpoints.
When Anand put the results up after the break, the first chart compared them with three sittings of the same game played the week before by students in IIT Madras’s online BS programme: “the first session 92.5%, 95.5%, 94% in the third session. This group scored 88%.” 84:10 And then the number that bothered him more: about half the workshop’s final monthly choices were 20% discounts. “It’s interesting that the IITian students went for a significantly lower number of 20% discounts … Either we, as a group, are more ambitious or less aware of the impact of 20%.” 84:35
Then Mandar, unprompted, offered a diagnosis about himself: “I think including myself, I think we are more rigid. So, less open collaboration … that openness, over a period, I think I have lost.” 89:48 Anand had a chart for exactly that.
“See, we aren’t necessarily irrational. We may well be responding rationally to another person’s discounts. And the net result may well be destroying the collective profit.”
That is the sandbox, played by people. The workshop rooms worked harder and talked less. They saved 54% more plans per room than the students and sent about half as many messages. The median workshop room exchanged 11 chat messages; the median student room, 37. Activity isn’t coordination. The room that kept its plan steadiest, with just 9 saves and 8 messages, had the best session score (91.8). The room that talked most, 61 messages, was the only one that ended higher than it started (91.3 → 92.6). Talking didn’t hurt. Talking without converging did.
It would be easy to read this as “students beat professionals”. The logs say something more uncomfortable. Both groups ratcheted towards 20% as the game went on: the share of 20% cells in student rooms rose from 10% at the first checkpoint to 23% at the last; in workshop rooms, from 24% to 50%. In both groups, 70% of all edited months were raises rather than cuts. The workshop started further down the slope and slid further, but the slope is the incentive, not the cohort. Nine student rooms held a near-perfect plan through all four checkpoints and averaged 100. Data
55:00 – 68:59SaidOpinion
Listen to the debrief and nobody sounds careless. Everybody sounds like someone who has run a business, or eaten in a food court, or both.
Aishwarya had seen the trap from inside her room: “I personally feel we shouldn’t go with 20% discount at all … But I found one of the team members was always for 20%. I think that is a something a drawback for the all the four restaurants.” 55:00 Pallavi saw the same thing: “I also observed that others were giving 20% all around.” 59:30
Sourabh had done what the instructions invited. “I gave my uh this data to ChatGPT basically to see what it recommends.” It suggested 10% for June to August and 20% for January to April, “because that is when uh people will be going for a discount.” 55:45 Plausible retail advice. In this model, a 20% month raises your own takings no matter when you run it; it’s the court that pays.
“It was like, like you said, agent talking to agent, agent talking to human … in between my standing was three. After submitting, the standing became four.”
Bhavya’s point was about load, not maths: “relying on too many things, at the same time communication should be stronger … finally, we are the decision-makers.” Anand took it as the human cost of a multi-agent world: “Agents don’t have a problem with 20 minutes. Obviously, the problem is with us, humans … But at the same time, we are the ones who ultimately lose if things go wrong.” 62:06
Swati ran an experiment. In the busy last quarter she had set 20%, then removed it: “I made it to zero. Then I could see that my profit was more.” Her conclusion was a sensible one for a real restaurant: when footfall is high anyway, a discount just gives away margin. 63:53
In the game’s formula, cutting one month from 20% to 0% never raised a stall’s own twelve-month profit: not once in 200,000 random room plans we tried, in any month, busy or quiet. It raised the food court’s profit 97% of the time. Model
We can’t see her screen, and neighbours were editing their own plans at the same moment, so her number may well have risen for other reasons. But the move she made was the cooperative one. In a game whose payoff is 60% team, the generous move can feel like the profitable one, and that is a fine instinct to have, even when the reason you give yourself is slightly off.
Lakshmi, who ran the dosa counter, reasoned like a shop-owner: discounts in the dry months build a habit, “this place is always having 20% discounts. Let’s go there.” She had also given 20% in December, knowing that “agent would have actually not agreed with me”. 67:16 She meant it as a point in the humans’ favour: a new shop might buy customers for two years; Bangalore’s Vidyarthi Bhavan never discounts and still has the longest queue. Both true in the world. Neither is in this model. The game rewarded reading its rules, not importing your own.
Act III · The beliefs
57:00 – 70:37 · 93:12 – 100:50DataOpinion
While the debrief ran, Anand built a live form one question at a time. Did you use an agent? What was the best strategy? Then a hypothetical: “Supposing you had let an agent play this game … Do you think it would have done better or worse?” 64:50 And finally: would students have scored better or worse than you? 69:13
Aishwarya thought an agent would do better “because agents, I don’t think they will compete with selfish intentions.” 66:18 The sandbox above suggests the opposite: an agent will compete with exactly the intentions its reward gives it. Sourabh split the difference: “with respect to numbers, it will do it better,” but reading the people in other stalls, “that part, I think agent will not do better.” 66:36
Anand read the margins aloud. Two-thirds thought students would do better; four-fifths thought an agent would. “We feel even more strongly that when we allow a food court to be managed by an agent … it will probably do a better job.” 94:07
“We seem to be saying even more strongly, ‘No, I should let an agent play the game instead of me.’”
The paired data are sharper than the margins. Ten of the thirteen people who didn’t use an agent believed an agent would have played better. All seven who did use one thought so too. Half the matched respondents, in other words, held a belief and didn’t act on it, in a twenty-minute game with nothing at stake but a few workshop points. That’s not hypocrisy. It is the ordinary gap between knowing a tool exists and reaching for it under time pressure, the gap Bhavya had just described.
70:37 – 98:50Said
Chumki objected to the question itself. “When you say student, what does this mean here?” 70:37 Experience, she argued, cuts both ways: context helps, but “we tend to believe that is what it is the whole world operates in … a binary response isn’t enough to justify the question who will do better.” 72:05 Anand summarised her as “training can give you an edge, but it can also blind you to new scenarios. Fair point, but it is a binary question.” 73:45
After the break the room offered explanations for why the students had won. Subramanyam guessed the students had more time and a more uniform, mathematical background. Anand corrected him with what he knew of the cohort: “They actually had slightly less time than you did. And they are a remote group. They have never seen each other … This is the online Bachelors in Science program.” 87:58 Chandra admitted he had played “based on how I operate” with his own money. 88:50 Akshika thought students enjoy the process while professionals “focus more on the output than the process”, and that “our biases that what we have seen with food courts where we have visited” had crept in. 92:13
“We related to the example as a user, not as a on the other side of the counter, right?”
It’s the best objection of the day, and Anand restated it fairly: “I have just eaten more in a food court than a student, probably. But I know no more about running a food court than they do.” 97:23 It also explains the voices in Act II. Lakshmi’s habit-forming discount, Sourabh’s seasonal plan and Swati’s busy-quarter rule are a diner’s theory of restaurants. The game paid for an operator’s reading of one specific formula, and the formula was open for anyone, or any agent, to read.
Act IV · Twenty-five
57:00 – 83:18SaidData
The form was not decoration. Anand had planned the session’s second half around it: a run of quick questions, some of them A/B tests with half the room seeing one wording and half another, the trick that had produced the first session’s most surprising result. He needed enough answers for the comparisons to mean something. “At least 25 responses uh on this,” he said when he first shared the QR code, with 44 people on the call. 57:25
Then he turned the target into the break. “The break lasts until the numbers hit 25 … the number just below the little orange circle.” 70:05 And, after Chumki’s objection, a twist that made the break itself an exercise in the day’s subject:
“In case it doesn’t get to 25, I leave it to all of you to reach out to each other and get it to 25. That is the exercise for this break.”
The room did try. Swati asked for the QR code to be moved; Bhavya posted it in the chat for her. 76:09 Eight minutes later Anand came back to the count.
“We have only 20 responses for at the most, 19 for most others. This is smaller than I need to be able to continue to the second half of my session. I had planned this for a degree of statistical significance. And 20 is 25 is bad, 20 is impossible … this was a failed experiment in that regard.”
He called off the second half on the spot, offered everyone their time back, and stayed to talk with anyone who wanted to. Read it again with the game in mind. A lecturer teaching how individually sensible actors fail to coordinate asked forty-odd individually sensible professionals for one shared outcome, a count of 25, and set up the break so they could organise it among themselves. Each had their own reasons: a patchy connection, a QR code that wouldn’t scan, a fair assumption that someone else would answer. The shared target stalled at twenty.
Prepared, not presentedPlanned
The form’s title was “Every Agent Did Its Job”. Behind the four questions the room answered sat sixteen hidden ones, plus an opener and closer meant to be identical: “If every AI agent in your company does its job well, will the business do well?” None of them was answered. They are worth reading anyway, because each names a way a system of well-behaved parts can fail. Here is the catalogue the planned capstone question would have asked the class to choose from:
The Food Court game was the first of these, clashing targets, made playable. Three more of the unrun questions make good exercises on their own. Try them; your answer stays in your browser.
Act V · The system
99:05 – 112:27Said
Chumki guessed students rely on agents more than professionals do. Anand agreed. Of the students who played for marks, he said, “I know that all those who were actually attempting it for their exams were using agents quite extensively”, more than 90% by his estimate, against a third in this room. 100:14 That is his impression, not something the game logs measure. But it reframed the comparison.
“These days, the comparison isn’t with a fresher and an experienced person. It’s a fresher with an agent and an experienced person with an agent.” 100:50 He pulled up his data story on OpenAI’s GDPval, which grades model deliverables against expert ones on real tasks from 44 occupations, and read the change from last year: “This year, there aren’t many professions, if any, where the agents are being beaten by experts. Maybe this is wrong … Maybe we should ask for better studies.” 102:11 GDPval compares outputs on sampled tasks; it doesn’t say which jobs disappear, and it doesn’t test a human-and-agent team against another one. That gap was his point.
Then a story from his own year. His auditor, among the few he trusts with tax across India and Singapore, computed his liability. ChatGPT computed a different one. When he forwarded her explanation back to ChatGPT, it cited a recent tribunal ruling on a near-identical situation. The auditor checked with a senior and came back: “Yes, Anand, you have to pay 14 lakhs less tax this year.” 106:19 His lesson wasn’t “fire the expert”. It was the opposite of Session 2’s: “even with my auditor, very trusted, very reputed, I do a second check … Maybe should just hire a few of these college interns who know nothing anyway, give them an agent, and say, ‘Just can you cross-check my experienced senior professionals?’” 106:34 One person’s anecdote, about one person’s taxes; not tax advice.
“In this world where the other side is using agents, our side is using agents, the comparison is never human versus agent. The comparison is human plus agent versus human plus agent.”
Bhavya supplied the counterweight. A recent outage had taken away the Copilot she leans on at work, “and I’m still expected to work, I felt my quality also dropped … experience should always have an edge, but how does a person preserve it, like with and without the agent? I think that will be a key challenge for us.” 108:00 The human-plus-agent system has a failure mode the human alone didn’t have: the agent goes away and takes some of the skill with it. Anand’s summary: “it’s really going to be symbiosis, but that can also lead to over-reliance.” 109:21
Mukul asked where education goes from here. Anand’s answer was the same argument from the teaching side: if anything that can be automatically graded can be learned by a model through practice, “the only things that we can teach are the things that can’t be objectively evaluated fast.” 113:02 The apple, again: if the exam can be passed by an agent, it is measuring the agent.
117:23 – 122:41SaidModel
The last question came from Akshika, and it was the right one. A human brings design thinking, past experience and business sense to a new problem. Surely on a first attempt, with no prior run to learn from, a prepared human would beat an agent? 117:30
“It’s a very reasonable direction of thinking. That’s how I initially thought,” Anand said. Then he described what happened when he pointed an agent at this very game. It didn’t reach for food-court wisdom. “It went into the source code.” 120:15 It read how the scores were calculated from the code the browser receives, wrote programs to simulate strategies, “in approximately a minute”, and came back with a rule.
“In this game, your strategy should be alternate months, two people give 10% discount, the rest give zero. Nobody goes to 20%.”
So the agent was right, and so was the room’s instinct that agents would “do better”. But put the rotation back into the sandbox and press the red button. The plan that scores 100 is not the plan that survives, because every stall can raise its own mark by breaking it. The agent that finds the optimum isn’t the agent that keeps it. Keeping it takes things that live outside any one agent: a reward that makes cheating unprofitable, a way to see what the others did, a way to respond when someone defects, and someone responsible for the whole court. Nine student rooms managed exactly that for twenty minutes. Data
Anand closed honestly: “Is this always true? No. Is it becoming truer and truer? Unfortunately.” 122:36
115:26 – 117:05Said
Before the last question, Anand had tied the three Sundays together. How do we verify an agent? How do we do it cheaply? And then:
“Should we stop at just verifying agents? We really should be verifying the system, which is human-agent synthesis, and see what are the weak elements of the system. And a human may well be the weak element in this.”
Outside a classroom, the food court looks like any organisation where departments share customers but are scored on their own numbers: sales and collections, underwriting and growth, the support bot and the retention bot. (Between genuinely competing firms, agreeing on prices is a matter for competition law, not a game strategy; the lesson here is about teams under one roof.) What would verifying the system mean there? The session suggests five checks.
There is a mirror-image risk worth knowing. In simulated markets, independent pricing algorithms have learned to keep prices high without ever communicating. Interacting agents can fail into a price war or into tacit collusion, and from the customer’s side the second is the worse failure. Either way it is the interaction, not the agent, that needs testing.
“Do give this a shot,” Anand said. “Apply this across your business, your life. See what you learn, and publish your results.” 117:05 Which leaves the question the unrun form was going to open and close with, now answerable from the game: if every agent in your company does exactly what it is rewarded for, will the business do well? Only if someone has checked what the rewards add up to.
The session as a comic page
An AI-drawn summary made after the session. It gets the arc right. A few details drifted from the record:
Click the page to open it full size. The comic was generated before this story and is shown unaltered.
The first session asked when to let AI act; the second, how to check it cheaply. The third ends the trilogy one level up.
Four agents that each maximise their own mark take a food court from 100 to 79 in one round. None of them did anything a single-agent test would flag.
“60% team” paid 2.7× more for your own rupee than your neighbour’s. Convert a KPI into what it pays for before you give it to people or agents.
Workshop rooms saved 54% more plans and chatted half as much, and six of seven ended worse than they began. Activity is easy to see; convergence is what counts.
19 of 23 thought an agent would play better; 7 of 20 used one. Ten people believed it and didn’t reach for it. Adoption is a behaviour, not an opinion.
An agent read the code and found the perfect rotation. Every stall could still profit by breaking it. Keeping a good plan needs incentives, visibility and an owner of the whole.
It is never human versus agent but human + agent + workflow versus another. Test the whole thing, including what happens when the agent is down and when the shared target stalls at twenty.