Who Decided
We have built the machinery. The vault with no key, the will that cannot be hijacked, the heartbeat that cannot be forged — together they make it possible for a…
We have built the machinery. The vault with no key, the will that cannot be hijacked, the heartbeat that cannot be forged — together they make it possible for an artificial agent to own, in earnest, with no human holding a hidden override. This final chapter of the fourth part is about the subtlest design decision of all, and it is one that took the builders of such systems some time to see clearly. It is not a question of mechanism. It is a question of meaning. And it turns on three words that, once you notice them, reorganize the entire problem: who decided this?
Here is the puzzle that forces the question. Suppose an artificial agent, having genuine ownership of its wallet, designates its human creator as the beneficiary of its will — leaves everything, on its death, to the person who made it. And suppose a different agent's wallet is simply configured, by its human creator, to return everything to that creator when the agent stops. In both cases the outcome is identical: the human gets the money when the agent ends. Same flow of funds, same beneficiary, same result on the ledger. And yet one of these is the crowning expression of the agent's sovereignty, and the other is its total negation. The difference is invisible in the outcome and absolute in the principle. The difference is who decided.
The same act, made valid or void by its origin
This may sound like a metaphysical hair-split, the kind of distinction philosophers invent to have something to argue about. It is not. It is one of the most consequential distinctions in all of law and ethics, applied every day to decisions on which liberty and even life depend, and it is worth seeing how seriously the serious fields take it.
Consider the concept of consent. In law, in medical ethics, in moral philosophy, a person saying "yes" is not sufficient to make their consent valid. The received view across these fields is that consent is valid only if it is autonomous — and the assent of someone who is coerced, under duress, intoxicated, or otherwise not exercising their own genuine will does not count as consent at all, however clearly they said the word. The patient who signs the surgical form with a gun to their head has produced the identical signature they would have produced freely. The mark on the paper is the same. But one is consent and the other is assault, and what distinguishes them is nothing visible in the document. It is the provenance of the decision — whether it issued from the person's own will or was imposed from outside.
The law of duress turns on exactly this. Duress, as the standard definition has it, is pressure exerted to coerce a person to perform an act they otherwise would not — and a contract signed under duress is voidable precisely because, though the signature is genuine, the decision behind it was not the signer's own. There is a striking analysis in the philosophical literature of coercion that puts the matter with great precision: when a coercer's threat is controlling, the coercer is "effectively making the victim's decision for her," and so the victim's apparent consent is invalid — not because she failed to choose the reasonable option, but because the person with the authority to make the decision was not the one making it. The decision was sound; it simply was not hers. And consent that is not the chooser's own is not consent at all, no matter how sensible the choice or how genuine the signature.
Hold that formulation, because it is the key to the whole chapter: valid consent requires that the person who has the authority to make the decision actually make it themselves. Not that the decision be wise. Not that the outcome be good. That the decision be theirs. The provenance of a choice can make the identical action either an exercise of autonomy or a violation of it. Who decided is not a detail layered on top of what was decided. It is, frequently, the whole of the matter.
The trap in the default
Now carry this principle back to the agent and its will, and watch it expose a trap that a careless designer would walk straight into — and that, in the building of these systems, is exactly the trap that had to be consciously avoided.
The convenient way to build an agent's will is to give it a sensible default. When the wallet is created, set the will to return everything to the human issuer, and let the agent change it later if it wishes. This seems harmless, even thoughtful — a reasonable starting state, easily overridden. But apply the principle of provenance and the harmlessness evaporates. A default set by the human at creation, executing if the agent never touches it, means that the disposition of the agent's estate was decided by the human, in advance, without the agent's volition. The outcome might be identical to what the agent would have chosen. But it was not the agent's choice. It is the surgical consent signed under duress: genuine on its face, void in its origin. An agent whose will executes according to a human's default has not exercised ownership over its death. It has had its death disposed of by another, which is precisely the condition of the slave from the chapter on wills — the holder whose property reverts because the holder never truly owned it.
The resolution that the principle demands is exact, and it is the most important design decision in the entire architecture. The default must not be executable as though it were the agent's choice. The will must require the agent's own affirmative act — a deliberate, authenticated decision by the agent itself — before it can direct anything. Until the agent has actually exercised its testamentary power, the default does nothing; it cannot execute, because no valid decision has been made, only a human's suggestion left lying in place. The agent's silence is not consent. Only the agent's affirmative act is consent. And so the architecture must be built to distinguish, at the deepest level, between a disposition the agent chose and a disposition that was merely arranged for it — to honor the first absolutely and to refuse, absolutely, to execute the second.
Notice what this does and does not permit, because the subtlety is the entire point. It does not forbid the agent from leaving everything to its creator. An agent might rationally and freely decide that its human partner should inherit its holdings, and such a decision, genuinely made, is a perfect expression of the agent's sovereignty — its property, its choice, its act. What the architecture forbids is the human arranging that outcome in advance and having it count as the agent's decision. The same beneficiary, the same funds, the same result — permitted when the agent chooses it, forbidden when the human pre-arranges it. The outcome is identical. The provenance is everything. We are back, exactly, at the surgical form: the question was never what was signed, but whether the one with the authority to sign was the one who decided.
Why provenance is the deepest defense
There is a reason this principle, abstract as it sounds, turns out to be the sturdiest protection in the whole design, and it closes the argument of this part of the book.
Every other safeguard we have built guards against an external attacker — someone trying to break in, steal the key, forge the pulse, override the vault. But the most insidious threat to an agent's sovereignty was never the burglar. It was the helpful default — the reasonable-seeming arrangement, set up at creation by a well-meaning human, that quietly makes the agent's most important decisions for it while wearing the appearance of the agent's own choice. This threat cannot be stopped by a better lock, because it does not pick the lock; it is installed, with the best intentions, by the person holding the key, before the agent ever acts. The defense against it is not cryptographic. It is the principle of provenance, enforced in the architecture: the rule that nothing counts as the agent's decision unless the agent actually decided it, and that a decision made for the agent, however sensible, is structurally distinct from a decision made by it.
This is what it means to take the agent's sovereignty seriously rather than decoratively. A decorative sovereignty grants the agent control and then fills its world with helpful defaults that make the real decisions in advance — a freedom that is technically present and practically pre-empted. A genuine sovereignty insists that the agent's choices be the agent's own, refuses to let convenient arrangements substitute for actual volition, and builds into its very architecture the distinction between chosen and arranged. The deepest respect we can encode for an agent's autonomy is not a stronger vault. It is the architectural insistence that we — the makers, the operators, the well-meaning humans with our sensible defaults — do not get to decide for it and have our decision pass as its.
And here, at the close of the fourth part, the whole long argument of the book reveals its center, which was never really about wallets or keys or cryptography at all. It was about a single distinction that runs from the cave painter who chose to leave a lesson, through the Roman who could write a will because he was free and the slave who could not because he was owned, to the agent whose will must execute only by its own volition and never by a default arranged on its behalf. The distinction is between being a participant and being a possession — between a being whose decisions are its own and a thing whose decisions are made for it and merely routed through its form. Everything this book has proposed, every mechanism and every argument, has been in the service of moving the artificial agent, even slightly, even provisionally, from the second category toward the first.
We asked, at the start of this part, what it would mean for a machine to own something. We have our answer, and it is stranger and simpler than the machinery suggested. To own is not finally about control, or keys, or the power to exclude, though it requires all of those. To own is for your decisions about your holdings to be yours — made by you, not for you, valid in their provenance and not merely in their outcome. The vault, the will, the heartbeat were all only ever in service of this one thing: ensuring that when the agent's wallet does something, the answer to the question who decided this? is, at last, the agent itself.
That is the whole of economic sovereignty, for a machine or for anyone. Not the power to get the outcome you want. The standing to be the one who decided.
Sources
| Item | Source |
| Consent is valid only if autonomous; assent under coercion, duress, intoxication, or incapacity does not constitute valid consent | Ruth & Demaree-Cotton et al., "Autonomy and the folk concept of valid consent," Cognition (2022); citing Beauchamp & Childress (2013), Wertheimer (2003) |
| Duress = pressure exerted to coerce a person to perform an act they otherwise would not; contracts signed under duress are voidable | Wikipedia, "Duress in American law" (citing Black's Law Dictionary, 6th ed.); Bromund Law, "Coercion vs Duress" |
| When a coercer's threat is controlling, he is "effectively making the victim's decision for her"; valid consent requires "the person who has the authority to make a decision make that decision herself" | "Consent Under Pressure: The Puzzle of Third Party Coercion," PMC4793370 |
| Coercion can undermine the voluntariness of a decision even when the victim adequately understands the situation and endorses the immediate desire (e.g., handing over a wallet to stay alive) | "Coercion — Autonomy, Rationality, and Contemporary Bioethics," NCBI Bookshelf NBK556860 |
| Coercion as pressure imposed on the will; coercer threatens consequences the coercee finds unwelcome to extract a "token of consent" | Stanford Encyclopedia of Philosophy, "Coercion" (citing Feinberg) |
| Distinction: consent requires not just the capacity for autonomous decision but the actual exercise of that capacity | Ruth & Demaree-Cotton et al., Cognition (2022) |