OE-2.4 Haptics, Tracking & Interaction Devices

What this is and why it exists

Tracking is where the illusion is won or lost. Latency and drift are felt long before they are seen, which is why this unit matters more than its position in a syllabus suggests.

The organising fact is that each sensor family fails differently. Optical trackers need line of sight. Electromagnetic ones dislike metal. Inertial ones drift. Acoustic ones are slow.

So real systems fuse several. Knowing the failure modes is the point of this unit, rather than knowing the specifications.

The vocabulary

• Tactile feedback — a sensation on the skin, usually vibration.
• Force feedback — actual resistance against a hand or finger.
• Haptic illusion — timing or vibration that makes cheap hardware feel like force.
• Tracking — measuring where something is and how it is oriented.
• Latency — the delay between the movement and the system knowing.
• Drift — slow accumulation of error over time.
• Line of sight — an unobstructed view between sensor and target.
• Sensor fusion — combining several sensor families to cover each other's gaps.

The mental model

Start with the elegant part. Full force feedback — hardware that genuinely pushes back — is expensive and bulky. Haptic illusions are not: clever timing and vibration can make cheap hardware feel like resistance it never produced. That gap between what is felt and what is delivered is the most useful idea in this unit. It is why consumer devices feel better than their component cost suggests.

Then tracking, which is one problem with four answers. The three numbers to compare on are accuracy, latency and drift, and different families trade them differently.

Optical tracking uses cameras and known reference points. It is accurate, and it fails when something blocks the view — a hand, a body, a piece of furniture. Electromagnetic tracking works without line of sight and is disturbed by metal in the room. Inertial sensors are fast and self-contained and drift: small errors accumulate, so position slowly becomes wrong while nothing announces it. Acoustic sensing is slower than the others.

No single family is good enough alone. That is why sensor fusion exists, and why the sensible way to learn this is by failure mode rather than by specification table. A fused system is designed around which sensor covers which other one's weakness.

Interaction is the other half. Interacting in three dimensions when every habit you have is two-dimensional is genuinely hard. It is why many interfaces here feel awkward even when the hardware is good. The problem is not the tracking.

A manual interface matters more than it sounds. When the hands have nothing to do, the sense of being present drops. That is a design argument rather than a hardware one, and it decides whether an experience convinces.

Hand and gesture gloves and whole-body systems follow one trade throughout: the finer the resolution, the more it costs and the more it constrains movement. And the consumer end, gaming and entertainment, is where most of this hardware actually ships. That is why the mass market decides which of these technologies survive.

What you should now be able to explain or do

Distinguish tactile from force feedback, and say what a haptic illusion buys. Compare the four tracking families by how each one fails. Say why drift is dangerous in a way that occlusion is not. Explain why sensor fusion exists. Say why three-dimensional interaction feels awkward even with good hardware. Argue for a manual interface on presence grounds. State the trade that governs gloves and whole-body systems.

Check yourself