Back to Projects

The Force

Augmented Reality (AR) interactions feature users interacting with virtual objects registered in the physical world. With contemporary AR experiences increasingly featuring interactions at distances, we conceptualized The Force, a technique that allows users to clone distant objects and manipulate their replicas.

In this interaction technique, users can select multiple objects of interest and spawn miniature clones of them in their proximity. Manipulations performed on these clones are mirrored to the original objects, allowing for near-field manipulation of distant objects. Users can interact with these clones through a pinch gesture which allows to grab, translate, and rotate the objects. The clones were scaled down to a sixth of the original objects and a one-unit movement of the clones resulted in a six-unit movement of their original object counterparts, thus preserving the magnitude of translational gains across the three interaction techniques. To select objects to be miniaturized, the user extends their arm with an open palm, waving it across objects of interest.

Headshot of Isaac Wang

Isaac Wang

Alumni Ph.D. Student

Julia Woodward

Alumni Ph.D. Student

CAREER: Next Generation Multimodal Interfaces