Product × Finance × AI: Financial Products in the Age of AIPart Four · Contract layer On what terms中文
Chapter 26

Authority and irreversible exposureHow much power to hand over, and which operations a person must confirm

Authority determines how far an agent may act without asking. Authority is not a switch but a ladder: from providing information only, to drafting a plan, confirming each trade, approving a plan, allowing a veto within a time limit, and finally acting on its own within an agreed scope. Which rung an operation can be placed on depends first on whether its consequences can be undone and whether its losses are capped. A financial account holds a special kind of risk: if it is not handled before a certain deadline, the loss becomes permanent, as with option expiry, forced liquidation of a margin position, and the deadlines of rights issues and tender offers. This irreversible exposure is exactly where an ongoing agent can help most, and exactly where authority must be tightest. The limits of authority must be enforced by the system at the execution layer, not left to the agent's own restraint; authority rises step by step with verifiable records and is withdrawn promptly after errors and changes.

1. The ladder of authority

Sheridan and Verplank (1978) divided the work between people and automated systems into ten levels. The version compiled by Parasuraman, Sheridan and Wickens (2000) runs from "the human makes all decisions" to "the system decides and acts on its own, ignoring the human". They further pointed out that the same system can sit at different levels in each of four stages: acquiring information, analysis, decision and execution. For financial agents, six levels are in common use: provide information only; draft a plan for the person to execute; execute after the person confirms each trade; the person approves a plan and the agent executes within it; the agent proposes an operation, which the person may veto within a set time, failing which it is executed; act on its own within an agreed scope and report afterwards. The higher the level, the less attention the user spends and the larger the exposure the user bears.

The six-level ladder of authority

Tap a level to see who takes the final step, what the user must do, and the attention the user spends and the exposure the user bears.

The six levels are this book's own summary, drawing on the ten levels of automation in Sheridan and Verplank (1978) and the four-stage model of Parasuraman, Sheridan and Wickens (2000). Attention and exposure are illustrative.

2. Reversibility sets the ceiling on authority

Which level an operation can be placed at depends first on two things: whether an error can be undone, and whether the loss is capped. Producing a summary or setting a reminder can be redone if wrong, at almost no loss. Adjusting a watchlist or changing a reminder's conditions can be reverted at any time. A scheduled regular investment has a limited amount per instalment, and an error can be corrected in the next period. Selling a holding, transferring funds out or accepting an offer cannot be undone once executed, and the loss may be large. Operations that are reversible and capped can be placed at high levels; operations that are irreversible or uncapped must stay at per-trade confirmation or lower.

Reversibility and loss caps set the ceiling on authority

Across: whether an error can be undone. Down: whether the loss is capped. Each cell shows the highest level of authority that can be granted. Tap an operation for an explanation.

Can be undoneCan be remediedCannot be undone
Small, capped loss
Loss may be large

Tap an operation.

Illustrative judgments. The levels follow the six-level ladder of authority: 3 is confirm each trade, 4 is approve a plan, 5 is time-limited veto, 6 is autonomous within scope. Where a particular operation belongs also depends on the amount and the state of the account.

3. Irreversible exposure: losses at a deadline

An account holds a kind of risk that, if not handled before a certain deadline, turns into a permanent loss. An option loses all its time value after expiry, and an in-the-money option not handled according to the rules may be exercised automatically or lapse. When a margin account falls below its maintenance margin requirement, the broker issues a margin call, and if it is not met in time the position is liquidated; FINRA Rule 4210 sets the minimum maintenance margin. Rights issues and tender offers have clear deadlines, and missing them means accepting the default outcome. Some leveraged products are terminated early when they hit their call price. What these exposures share is a deadline, a clear trigger and an irreversible consequence. An agent's value here is to spot them in time, give advance reminders and explain the options; the step that actually changes holdings must be confirmed by the person.

Losses at a deadline

An account has four irreversible exposures over 30 days. Drag "today", and switch whether an ongoing agent is watching, to see the state of each one.

Illustrative account and dates. The agent reminds three days and one day ahead and explains the options; the step that changes holdings is confirmed by the person. For maintenance margin requirements, see FINRA Rule 4210; rules on option exercise, rights issues and the early termination of leveraged products differ from market to market.

4. Limits must be enforced at the execution layer

Writing the limits of authority into the agent's instructions does not guarantee that they will be observed: the agent may misunderstand them, may be misled by content in its inputs, or may simply make a mistake. An old principle of computer security is that every program should hold only the least privilege needed for its task, and every access should be checked (Saltzer and Schroeder, 1975). For a financial agent, limits on instruments, per-transaction amount, cumulative amount, trading frequency and time window should be checked trade by trade by an execution layer independent of the agent; instructions that cross a limit are rejected outright, and a record is kept. The agent's instructions can help it make fewer mistakes; the execution layer's checks ensure that even when it does make one, it cannot cross the limits.

Limits written in the instructions, or checked at the execution layer

The agreement: trade only index funds, no more than 10,000 yuan per trade and no more than 30,000 yuan in total per day. The agent issues ten instructions, several of which cross the limits through misunderstanding, being misled by input content, or plain error. Switch how the limits are enforced.

Out-of-bounds instructions executed
Instructions blocked and logged

Illustrative. On least privilege and checking every access, see Saltzer and Schroeder (1975). When the limits are only in the instructions, the agent is assumed to catch half of its overreaches by itself.

5. Progressive authority: raised with the record, withdrawn on change

The level of authority need not be fixed once and for all. Like trust, it can be adjusted as evidence accumulates: the agent first runs at a low level on matters whose consequences are reversible and whose amounts are small, building a verifiable record of performance; once the record is sufficient, it moves up step by step to plan approval or time-limited veto. Authority must also be withdrawable promptly: after a single overreach or serious error, the level drops at once; when the agent changes model version, or the principal's circumstances change, authority must be confirmed again. Users should be able to see the current level of authority at all times and withdraw it with one tap.

Authority rises with the record and is withdrawn on change

An agent's level of authority over two years. A good, verifiable record raises the level step by step; an overreach, a model version update and a change in the principal's circumstances bring it down. Tap an event for an explanation.

Tap an event in the chart.

Illustrative timeline. The levels follow the six-level ladder of authority: 1 information only, 2 draft a plan, 3 confirm each trade, 4 approve a plan, 5 time-limited veto, 6 autonomous within scope. Authority is raised on the basis of a verifiable process record, not returns.

6. Time-limited veto: between per-trade confirmation and automation

Per-trade confirmation is safest, but every confirmation takes the user's attention; full automation is easiest, but carries the most risk. Sheridan and Verplank's scale has a level between the two: the computer selects an action and informs the human early enough to allow time to stop it. Parasuraman et al. (2000) summarize it as "allows the human a restricted time to veto". The system proposes an operation and gives the person a set period in which to veto it; if the person does not object, it is executed. This level suits operations that have a deadline but whose consequences stay within an agreed range, such as rebalancing according to a plan. The length of the veto window is a trade-off: too short, and the user has no time to look; too long, and the deadline may be missed. As the deadline of an irreversible exposure approaches, the operation should return to per-trade confirmation, and reminders should become more insistent.

How long should the veto window be?

The agent proposes an operation with 24 hours to go before the deadline. On average the principal sees the message about 6 hours later. Drag the length of the veto window to see the probability that the principal sees it in time, and the risk of missing the deadline.

Principal sees it in timeRisk of missing the deadline

Illustrative calculation: the time until the principal sees the message follows an exponential distribution with a mean of 6 hours; execution follows the end of the window and takes 2 hours, and finishing after the deadline counts as missing it. For the time-limited veto level, see Sheridan and Verplank (1978); the wording follows Parasuraman, Sheridan and Wickens (2000).

7. Implications for product design

Assign authority by reversibility and loss cap; for irreversible exposure, remind in time and have the person confirm; enforce limits at the execution layer, raising authority with the record and withdrawing it on change.

Chapter summary: assigning power by consequence

Four design requirements, each corresponding to one mechanism in this chapter.

Authority is a ladderLet users see and choose the level for each kind of operation

Information, drafting, per-trade confirmation, plan approval, time-limited veto and autonomy within scope are set operation by operation, not by a single master switch.

Reversibility sets the ceilingKeep irreversible, uncapped operations at per-trade confirmation

Selling holdings, transferring funds, accepting offers and exercising options are confirmed by the person; small reversible matters can be handed to the agent.

Irreversible exposure needs timely watchingRemind before the deadline and explain the options

For option expiry, margin calls, rights issue deadlines and the like, remind several times in advance; the step that changes holdings is taken by the person.

Limits must be enforced at the execution layerCheck independently; raise and lower authority with the record

Check instrument, amount, total and authority for every trade and keep a record; lower the level after overreach, version updates and changes in circumstances, and allow withdrawal with one tap.

References