The One-Degree Dispatch

When AI Moves From Answering to Acting

2026 · The Nature of Intelligence · 3,703 words

The shift from training to inference in AI underscores a pivotal move towards trusted, actionable intelligence that enterprises can confidently own and deploy.

Start with AI and authority · 5 of 5← The Permission Staircase

revenue and $193.7 billion in data center revenue, while Jensen Huang said “the agentic AI inflection point has arrived,” and Reuters reported ahead of GTC that analysts still saw NVIDIA with more than 90 percent share in training and inference even as competition gathered around inference economics, CPUs, and orchestration. The prevailing belief sounds reasonable enough. Training built the first great wave of value, inference will build the next one, and the company that keeps winning the compute race should keep winning the economics. That is not foolish. It may even prove d irectionally right for a time. But it still leaves out the hardest part of the problem, which is that intelligence does not become valuable when it is trained, or even when it is present. It becomes valuable when it can shape an outcome that somebody is willing to own. “What would have to be true for this outcome to keep repeating.” That line belongs much earlier in more board conversations than it usually does. Because once you ask it seriously, the current debate stops being a story about chips alone. It becomes a story about whether enterprises are building systems they can trust when the responsibility has a name attached to it.

The market is moving from intelligence creation to intelligence execution

The visible turn in AI computing is real. NVIDIA has been saying so plainly. In its February 2026 results, the company highlighted Rubin as a platform intended to cut inference token cost sharply versus Blackwell, and described a new AI-native storage layer for inference context memory. On March 16, NVIDIA then introduced Vera as a CPU designed for agentic AI and reinforcement learning, arguing that the bottlenecks were no longer just raw model execution but also the data processing, environment handling, and orchestration work around the model. Reuters, covering GTC, described the same turn in plainer market terms. Inference is becoming the center of gravity, custom silicon is pressing harder, and CPUs are back in the frame because agent orchestration is no longer a side issue. That is the part many people can now see. They can see that the job of the machine is changing. They can see that once models are used for real tasks rather than admired in benchmarks, memory, latency, cost per token, and coordination between components start to matter more. They can see why Amazon and Cerebras would split inference into prefill and decode, and why Reuters reported that NVIDIA was expected to answer with a mixed design of its own involving Groq technology. The computing stack is being rearranged because the work itself is being rearranged. What too many still miss is that this is not merely a hardware change. It is a move from intelligence generation to intelligence execution. That is a larger turn than the market language usually admits. Training made intelligence possible. Inference makes intelligence present. Neither one, on its own, tells you whether the system understands enough about cause and effect to take an action that a serious operator would defend after the fact.

That is where the current vocabulary starts to fail. People hear “agentic” and think they are hearing a verdict about value. Usually they are only hearing a verdict about behavior. A system that can call tools, chain tasks, read files, draft a response, or move from prompt to action sequence may display agentic behavior in a loose market sense. That does not yet tell you whether it knows what is true, what changed, what action would produce a different result, or whether anyone can reconstruct the logic well enough to defend it in a finance review, a safety review, a regulatory review, or a board meeting. A fluent explanation is not a causal one. That distinction is going to separate the systems that entertain from the systems that get trusted.

Human agency has always had a higher burden than motion

People keep asking what the difference is between causal and agentic. The answer is simpler than the market makes it sound. You can have agentic behavior without causal understanding. Human beings do it all the time. We act, intervene, choose, improvise, and try to shape outcomes before we fully understand what is true or which intervention is actually driving the result. But human agency, in its serious sense, has always been more than movement. It is the ability to shape outcomes based on what a person understands to be true, what interventions are available, what counterfactual alternatives exist, and what evidence is observed from decision to action to result. That is why the causal literature matters here. Counterfactual accounts of causation ask what would have happened under a different action. Pearl’s causal framework treats intervention as a “surgical” act on a system, and not just a passive reading of correlations. UCLA’s summary of Judea Pearl’s work makes the point in practical terms. Statistical pattern finding alone cannot answer the intervention and retrospection questions required for strong causal reasoning. That is not academic decoration. It is the difference between a system that can mimic judgment and one that can earn it. When a person says, “If I had done X instead of Y, this likely would have happened,” they are not merely describing the past. They are exposing the model of reality they used to act. If that model was thin, borrowed, or false, the decision may still have looked decisive. It just will not be defensible for very long. This is where the South Pacific example matters, and it matters more than most people realize. The old phrase “cargo cult” is crude, and many anthropologists stopped using it because it flattened different Melanesian movements into a lazy outsider story. Lamont Lindstrom notes that the term gained traction in 1945, then fell out of favor because it undercut the political and historical seriousness of what many of those communities were facing under colonialism and war. That caution matters. But the core human pattern remains worth studying because it is the same pattern now creeping into the way many people talk about AI. During World War II, island communities in Melanesia saw something astonishing. American forces arrived with ships, aircraft, roads, fuel, radios, food, medicine, vehicles, tools, and what

looked like endless manufactured abundance. Smithsonian’s account of the John Frum movement describes islanders watching planeloads and shiploads of goods appear with a scale and regularity that had no local precedent. Yet the industrial and military machinery producing that abundance was mostly invisible from the place where it was observed. The locals could see uniforms, drills, signal gear, runways, flags, and ritualized procedure. They could not see the full causal system behind those effects, which was a vast apparatus of factories, procurement, shipping, command structures, logistics, maintenance, and war finance. So people did what human beings do when the architecture is hidden and the interface is visible. They inferred from surface form. Britannica notes that some built symbolic landing strips, wharves, warehouses, and ritual settings in anticipation of cargo. Smithsonian describes barefoot men on Tanna carrying bamboo rifles with red-painted tips, wearing “USA” markings, marching in formation, raising the American flag, and preparing airstrips and bamboo signal equipment in the expectation that the cargo would return. The logic was not childish. It was tragically understandable. They were trying to shape an outcome using the pieces of the system they could actually see. They had agency. What they did not have was the true causal structure. That is the danger now. Enterprises are starting to mistake the visible signs of intelligence for the architecture that makes trustworthy action possible. They see tool use, fluent language, memory windows, orchestrated subtasks, code execution, and retrieval across systems. They see the runway, not the supply chain. They see the radio tower, not the industrial base. They see the interface, not the mechanism. Then they assume that because the visible behavior resembles competence, the action it produces will be reliable enough to own. That is how expensive mistakes arrive wearing the costume of progress.

The real issue is not whether a system can act. It is whether you can defend why it acted

The trouble with the term “agentic” is that it flatters too early. It makes the system sound closer to trusted action than it really is. A model can plan and still not know enough to intervene wisely. A workflow engine can route tasks and still not distinguish correlation from cause. A reasoning layer can sound calm, precise, and authoritative while depending on a chain of assumptions that no one in the room has examined. That is why the better question is not whether something is agentic. The better question is whether you can trust it when the responsibility has your name on it. Without causality and an auditable chain of reasoning, what you wear is the risk of a fluent explanation, not a causal one. That risk is not abstract. It is what shows up when a system recommends a supplier change, a patient routing action, a maintenance d eferral, a staffing move, a student intervention, or a pricing decision, and the institution later finds that the evidence trail

was thin, the counterfactuals were never asked, the permission boundary was vague, and the model of reality behind the action was weaker than the interface made it appear. If it cannot defend why it acted, it has not earned the right to act. This is the place where the current NVIDIA story becomes more than a market story. The company’s product decisions now admit, whether intentionally or not, that running intelligence close to action is not the same task as training intelligence in isolation. Vera Rubin is not being pitched as a faster chip in the old sense. It is being pitched as part of a rack-scale system. NVIDIA says Rubin can deliver major gains in inference throughput per watt and sharply lower token costs, while BlueField-4 extends usable memory across the pod to support the key-value cache burden created by large models and agentic workloads. That language matters because it shows the real job is no longer raw computation alone. The real job is continuous execution under cost, latency, and memory pressure. That still does not solve the trust problem. It just gets the machine closer to the point where the trust problem becomes unavoidable.

The hidden tax is not compute alone. It is the distance between evidence and action

In most firms, the old architecture is still intact. A signal appears. Someone interprets it. Another person asks for context. A third person asks who owns the decision. A fourth person asks what policy applies. An exception is raised. A spreadsheet is upd ated. A call is scheduled. A committee is formed. By the time action is authorized, the economics of the original decision have already changed. That is why the next era will not be won by firms that merely buy more inference. It will be won by firms that reduce the distance between evidence, reasoning, permission, and action without losing the ability to defend what the system did. The problem is not speed for its own sake. The problem is paying for time as though time were free. That cost rarely shows up under the label that belongs to it. It shows up as service misses, scrap, slower cash turns, margin leakage, safety exposure, learning loss, escalation labor, and credibility damage. This is also why CPUs are back in the story. Reuters reported that analysts expected NVIDIA to emphasize CPUs again because agent orchestration now sits in the middle of the problem. NVIDIA’s own March 16 materials say Vera is built for high-performance data processing and large numbers of CPU-based environments that test and coordinate work around the models. The model alone is no longer the whole machine. It is one node inside a larger system that must hold context, schedule work, manage environments, validate outputs, and decide when the next action is permitted. That is not a side detail. It is the clue.

The clue is that the value is moving away from intelligence as an object and toward intelligence as a governed process. Once that happens, the economic unit changes. The market talks about token cost, inference demand, and throughput. Those matter. But they are still one level below the question that a CFO and a board will eventually ask. What is the cost per trustworthy outcome. What is the cost per action we can defend. What is the value of compressing the time between evidence and intervention without increasing the chance that the enterprise will later discover it acted on a fluent misunderstanding. If your system can summarize, route, recommend, and escalate, but no one can show which evidence changed the action path, what exactly have you bought. A labor aid. A language layer. A faster relay between humans. Perhaps all three. But not yet a system the institution can trust with consequence. If your system can propose an intervention, but the team cannot reconstruct what would likely have happened under the best alternative action, are you looking at judgment or theater. And if the answer to that question changes when legal, finance, safety, or audit enters the room, then the architecture was not sound when the demo looked good. Those are not philosophical questions. They are operating questions disguised as governance questions.

The strongest counterargument deserves a fair hearing

There is a serious objection here, and it should be taken seriously. Not every useful enterprise system needs full causal reasoning. Some tasks are narrow enough that statistical performance, good guardrails, and human oversight may be enough. A customer service deflection tool does not need a full causal model of the enterprise. A document classifier can create value long before it understands counterfactuals. Much of AI’s early economic return may still come from systems that are capable, fast, and only partly explainable, so long as the action rights remain narrow and the blast radius stays small. That is true. It is also beside the main point. The closer a system moves to real intervention, the less forgiving that argument becomes. The market itself is making this plain. Amazon and Cerebras are not splitting inference into prefill and decode because the work is trivial. NVIDIA is not bringing CPUs, AI-native storage, networking, and rack-scale designs into the foreground because a chatbot is all that matters. Reuters did not describe a scramble around inference economics, orchestration, and custom compute because the next phase is just prettier software. The architecture is thickening because the burden on the architecture is rising. In other words, the counterargument holds only while the system remains far enough from consequence. Once the machine sits near a material action path, the standard changes. The question stops being whether the output was helpful. The question becomes whether the chain from evidence to action can survive scrutiny.

That is why the market’s use of the word “agentic” is going to age badly. It describes behavior when institutions need a standard of accountability.

Boards are going to ask for a different proof than the market is selling

Here is a prediction that will be embarrassing if wrong. By the first half of 2028, a meaningful share of enterprise AI buying committees will stop treating token cost, model scores, and orchestration demos as sufficient proof for action-facing systems. They will ask for evidence-toaction audit trails, explicit permission boundaries, and clear rules for when a human can and cannot be bypassed. Not because theorists demanded it, but because failed interventions, bad audits, and ugly blame chains will force the issue into the open. That prediction is falsifiable. If by March 2028 serious board and audit conversations are still content with model performance and labor-savings estimates alone for systems that can recommend or take material actions, then this argument deserves to be called early. I do not think it will be early. Because the whole market is moving toward a harder form of value. NVIDIA says enterprise adoption of agents is rising fast. Reuters says inference is becoming the larger opportunity and that orchestration is now part of the bottleneck. The AWS and Cerebras example shows that vendors are already breaking inference into distinct computational responsibilities because the work near action is too demanding to treat as one uniform problem. As these systems move into operations, finance, health, education, and regulated decisions, the proof burden will move with them. The nearer the machine gets to action, the less useful fluency becomes. That is not a moral complaint. It is a financial one. Institutions do not get paid for sounding correct. They get paid for being correct often enough, fast enough, and cheaply enough that the result changes the economics of the business without blowing up the risk ledger. This is why the real unit of value is not the token. It is the defended intervention. It is the closed loop whose reasoning can be reconstructed and whose outcome can be attributed with enough confidence that the firm learns rather than apologizes.

NVIDIA is the signal. The redesign of the firm is the event

So can NVIDIA keep its dominance. Possibly. The company has the ecosystem, the installed base, the capital position, and the habit of moving the whole stack when the burden changes. Its recent announcements make clear that it sees the next contest as broad er than GPUs. It is pulling

CPUs, networking, storage, inference economics, and agent infrastructure into one story because that is what the work now demands. But even if NVIDIA wins that contest, it will not settle the more important one. A vendor can sell faster systems. It can sell lower token cost, better throughput, and denser infrastructure. It cannot sell institutional legitimacy by itself. That has to be designed inside the firm. The firm will have to decide what evidence is sufficient for action. It will have to decide which counterfactuals must be represented before a system can intervene. It will have to decide where the permission boundary sits, who can move it, who can overrid e it, and how the chain from observation to action will be audited afterward. Those are not software preferences. They are decision-right questions. They are governance questions. They are questions of control. This is why the current argument about AI computing is already too small for the stakes involved. The visible story is a compute race. The actual event is that institutions are being forced to decide what kind of intelligence they are willing to trust when that intelligence can do more than answer. That is the line now. Not whether a model can speak. Not whether an agent can use tools. Not whether the cost per token can be cut again. The line is whether a serious operator can look at the system after it has acted and say, without hedging, this intervention made sense given the evidence, the alternatives, the permissions, and the result. The future belongs to systems whose actions can be defended, not just described. Everything else is still runway theater.

The last mistake will be to confuse visible intelligence with earned legitimacy

The South Pacific example stays with people because it is painful and human. People saw the visible signs of abundance and copied them in the hope that the result would follow. They did not lack agency. They lacked access to the full causal architecture. That is a much more serious lesson than the cheap version usually told. The same risk now sits inside the current AI market. Firms can copy the visible signs of advanced systems. They can buy models, orchestration layers, memory, tools, file access, agents, inference clusters, and workflow wrappers. They can produce demonstrations that feel like competence. They can even create short-term gains. But if they do not build the chain from evidence, to reasoning, to intervention, to permission, to result in a way that can be reconstructed

and defended, they will eventually discover that they copied the interface and missed the mechanism. That is why the real sea change in AI computing is not about inference alone. It is about what happens when inference moves closer to action. Fluency stops being enough. Benchmarks stop being enough. Cost per token stops being enough. Once consequence enters the room, trust becomes the operating system. And trust, in any serious institution, is not faith. It is evidence that can survive scrutiny.

References

This piece is grounded first in Michael Carroll’s own body of work, which provides the foundation for the argument throughout. That includes his definition of agency as the ability to shape outcomes, his distinction between capability and true outcome-shaping agency, his teaching that permission is a decision and access is the architecture of risk, his work on latency, degrees of separation, and the inference-permission boundary, and his broader argument that trustworthy systems must connect evidence, reasoning, intervention, and accountable action in ways leaders can defend. It was also written in Carroll’s house language, especially his emphasis on latency, permission, evidence, counterfactual reasoning, and the line between fluent capability and defensible agency. External sources are used to support, sharpen, and verify the market and historical context, not to supply the core thesis. For current market facts, the piece draws on NVIDIA’s February 25, 2026 fiscal 2026 results, including reported revenue of $215.9 billion, full-year data center revenue of $193.7 billion, and the company’s description of an “agentic AI inflection point,” along with Reuters’ March 2026 reporting on GTC, inference economics, the renewed importance of CPUs for orchestration, NVIDIA’s still-dominant market position, and the AWS-Cerebras split of prefill and decode. For the causal argument, the piece draws on the counterfactual tradition in causal reasoning, especially the distinction between association and intervention that underpins the article’s standard of trust. For the South Pacific section, it uses Lamont Lindstrom’s work to avoid the cartoon version of “cargo cults” and to recover the colonial, political, and historical setting that made imitation of visible form understandable when the real machinery remained hidden. These outside sources matter because they reinforce a claim already central to Carroll’s work. People imitate visible form when the real architecture is hidden, and institutions mistake fluent motion for earned legitimacy until consequence forces a higher standard.

Topics: synthetic-agency, causal-aiOpen in the Radiant ↗All dispatches