The Art of Interaction Design for Extended Reality: Embracing the Impossible

Every interaction design discipline is shaped by the constraints of its medium. Web design is constrained by the browser. Mobile design by the touchscreen. Both have produced rich design languages precisely because the constraints are clear and consistent.

XR interaction design operates with a different relationship to constraint. In spatial computing, many of the physical limitations that govern conventional interaction simply don’t apply. Objects can float in mid-air. Interfaces can scale to any size. The user can reach, grasp, and manipulate things that have no physical existence. This freedom is the opportunity — and the challenge.

Beyond Physical Constraints

The first instinct when designing for XR is often to replicate physical world metaphors: a virtual desk, virtual buttons, virtual drawers. These metaphors are useful as an on-ramp — they leverage existing mental models and reduce the learning curve for new users. But they also unnecessarily constrain what’s possible.

When you’re not bound by gravity, material properties, or the limits of physical manufacture, interaction can be redesigned from first principles. Data can be navigated spatially rather than scrolled through linearly. Complex systems can be explored architecturally rather than displayed hierarchically. The designer’s toolkit expands significantly — but so does the responsibility to use it well.

Gesture, Gaze, and Spatial UI

The input modalities of XR — hand tracking, gaze detection, voice, spatial controllers — each have different strengths and appropriate contexts. Gesture is intuitive for manipulation but fatiguing for extended selection tasks. Gaze is fast but private (you can’t always tell where someone is looking). Voice is natural but context-dependent.

Effective XR interface design uses these modalities in combination, assigning each to the tasks it handles best, and providing clear affordances so users understand what’s interactive and how to interact with it.

The concept of affordance — the visual or physical property of an object that signals how it should be used — is central to XR UX. In the physical world, affordances are often intrinsic to materials and forms. In XR, they must be deliberately designed.

Intuition as a Design Goal

The highest compliment an XR experience can receive from a new user is “it just felt natural.” That naturalness is not accidental — it’s the result of careful attention to how people instinctively want to move and interact in three-dimensional space, and designing to meet those instincts rather than overriding them.

headroom’s UX practice approaches XR interaction design with this goal at its centre: not impressive, not novel, but natural. The technology should disappear into the experience, leaving only the work.