Orchestra AIBy Hyperdrift

The future of UI / UI and accessibility

Your work should survive a change of interface

Speak, inspect, correct and continue. A future interface should preserve the task when the person changes how they interact.

By Yann VR · 4 min readShare article ↓Discuss where your users lose their place →
Evidence reviewed 5 October 2026 · Method and maintenance

The future of UI is often pictured as a new surface. A conversation replaces a form. A voice replaces a keyboard. An agent replaces a sequence of clicks.

The more useful question is what happens when a person needs to change surfaces halfway through.

Our position is that a task should survive that change. Someone should be able to speak a request, inspect the result visually and correct it through the input they can use. The work should remain understandable and editable throughout. That is a direction for design, not a prediction that one interface will win.

Changing how you work should not mean starting again.

Change the input, keep the workA proposed scenario: a person speaks criteria and gets three grants with evidence, drops one by keyboard, hears the comparison through a screen reader, loses the voice session, then returns later. When the work lives in the conversation, each switch can mean starting again. When it lives in the task, the two remaining grants, the decision and the evidence survive every switch. A design goal, not an observed result.PART 6 OF 6 · UI & ACCESSIBILITYChange the input. Keep the work.A grant shortlist through speech, keyboard, a screen reader and a dropped session.INPUTSpeakthree grantsKeyboarddrop oneScreen readerhear the comparisonSession dropsReturn latersame shortlistWORK LIVES INTHE CONVERSATIONstart againstart againstart againstart againWORK LIVES INTHE TASKChanging how you work should not mean starting again.grant on the shortlistyour decisionits evidenceDESIGN GOAL · PROPOSED SCENARIO · NOT AN OBSERVED RESULTai.hyperdrift.io/articles/future-ui-keep-your-place
Change the input, keep the workA proposed scenario: a person speaks criteria and gets three grants with evidence, drops one by keyboard, hears the comparison through a screen reader, loses the voice session, then returns later. When the work lives in the conversation, each switch can mean starting again. When it lives in the task, the two remaining grants, the decision and the evidence survive every switch. A design goal, not an observed result.PART 6 OF 6 · UI & ACCESSIBILITYChange the input.Keep the work.A grant shortlist through speech, keyboard,a screen reader and a dropped session.WORK LIVES INTHE CONVERSATIONstart againstart againstart againstart againWORK LIVES INTHE TASKSpeakthree grantsKeyboarddrop oneScreen readerhear the comparisonSession dropsReturn latersame shortlistChanging how you work shouldnot mean starting again.grant on the shortlistyour decisionits evidenceDESIGN GOAL · PROPOSED SCENARIO · NOT AN OBSERVED RESULTai.hyperdrift.io/articles/future-ui-keep-your-place
Changing how you work should not mean starting again.
Explanation and sources

A proposed scenario: a person speaks criteria and gets three grants with evidence, drops one by keyboard, hears the comparison through a screen reader, loses the voice session, then returns later. When the work lives in the conversation, each switch can mean starting again. When it lives in the task, the two remaining grants, the decision and the evidence survive every switch. A design goal, not an observed result.

Sources reviewed 5 October 2026. Conceptual diagrams are labelled separately from the reported scan.

Keep the task when the conversation ends

Imagine preparing a shortlist of grants. You speak the initial criteria. The app shows three candidates with their deadlines and sources. You use a keyboard to remove one, then ask a screen reader to read the remaining comparison. Later, you return to the same shortlist.

This is a proposed scenario. Its value comes from continuity. The selected candidates, evidence and decisions belong to the task, rather than being trapped in whichever conversation created them.

The distinction becomes visible when something fails. If the voice session disconnects, the shortlist should remain. If an agent is replaced, the person's decisions should remain. If a generated explanation is wrong, the underlying evidence should still be available to inspect.

Our Radar exampleOrchestra · related articleStop making agents hunt for buttonsWebMCP lets a page expose actions to a browser agent. Radar shows how that can keep the person and agent working in the same place.Orchestra editorial summaryOpen original ↗ (new tab) offers a narrower building block: the person and browser agent work on a shared page state. It does not establish that the whole scenario above works across clients or access methods.

Even changing pages can break a tool's work. A 2 October WebMCP proposalWeb Machine Learning Community Group · merged 2 October 2026WebMCP continuations explainerProposes continuing a tool call across pages or frames on the same origin, with single-use, revocable tokens. A proposal, not a browser implementation.Orchestra editorial summary · reviewed 5 October 2026Open original ↗ (new tab) explores continuing a call across pages or frames on the same origin. It is a proposal, with limits on where and when it can resume. Keeping a call alive would address one interruption. Preserving the person's decisions, corrections and access remains work for the app.

More ways in, the same authority

Direct controls can be excellent for exploration and comparison. Speech can suit a request that would take several navigation steps. A command line can suit repeated operations with precise parameters. An assistant can help compose a task from available actions.

These routes need not have identical layouts. They need consistent meaning. Keeping an item through a button should have the same consequence as keeping it through a tool. A read-only permission should remain read-only when the person uses voice.

That is why the transition diagram in this series shows responsibilities rather than a ladder of progress. Event-driven controls, APIs, command lines, WebMCP and voice occupy different parts of the interaction. New routes can coexist with useful old ones.

The product question becomes more interesting: which part of this task should the person have to operate, and which part could the app handle without taking away their judgement?

Independence is a demanding ambition

W3C's natural-language accessibility workW3C · Group Draft Note · September 2022Natural Language Interface Accessibility User RequirementsDiscusses input and output choices, understanding and error recovery. This is work in progress, not an endorsed conformance standard.Orchestra editorial summary · reviewed 1 October 2026Open original ↗ (new tab) already describes the need to consider the wider interface and different means of input and output. Our proposal applies that concern to continuity across a task. It does not invent the idea of multimodal access.

The practical goal is that more people can finish independently. That requires more than exposing a new control. A person needs to discover what is possible, inspect an outcome and recover from a mistake using methods available to them.

There are costs to investigate. An agent may add delay, require a paid service or fail without connectivity. A useful direct route may be faster and more dependable. Those conditions should be part of the comparison, not hidden behind a polished recording.

Build a future you can check

The series leaves us with work to do. First OfficerOrchestra · related articleA spoken promise is not a completed actionA Cargo recovery request becomes an action, a checked result and a spoken report. What this bounded demonstration can teach app designers.Orchestra editorial summaryOpen original ↗ (new tab) supplies a bounded voice example. Voice through MCPOrchestra · related articleSay the job once. Keep control of the result.Dictating to an assistant can become a way to direct connected tools. Our proposed experiment starts with a scoped read and a draft.Orchestra editorial summaryOpen original ↗ (new tab) proposes a cross-app experiment. Neither settles the question of broader accessibility.

The next evidence should show a task moving between inputs without losing its state, including a correction and a failure. Compare it with the current route. Record where help was needed. Let people with relevant access needs shape the task and judge the experience.

If the new route adds more supervision than it removes, change the design. If it lets someone complete a task that previously required help, show exactly how and for whom.

That is a future worth pursuing. A person's ability to do the work should count for more than their ability to operate every app involved.

Discuss where your users lose their place.

Know someone working on this? Pass it on.

Put the idea to work

What would this look
like for you?

Tell us about one workflow and the tools involved. We’ll discuss where agents could help and which decisions should stay with your team.

A personal reply within one working day.

We’ll use these details to reply to your enquiry.