Touch Interaction Tips

Kenny Raymond -

NOTE: Most of the tips shown below are only for Kinect sensors. To get the best interaction experience, we strongly recommend you use Ubi sensor.  

The Interaction Zone

With the Kinect for Windows v1 and Kinect for Xbox 360 sensor, Ubi has a 1-3 inch interaction zone, depending on how far away the Kinect is from the display. Whenever your hand or pen enters the interaction zone, it triggers the interaction. However, people with Kinect v2 and Xbox One sensors do not need to think about the interaction zone in order to have smooth interactions. With the Kinect for Windows v2 and Kinect for Xbox One sensors, this interaction zone is less than an inch because the depth sensor in these cameras are more precise. When using the Kinect v1, use your entire hand when interacting. With the Kinect v2, use one finger to interact.

When you use Ubi sensor, there is not interaction zone. The touch happens only when you touch the surface. It works like a touch screen.


Tip #1: Make sure that the Kinect can see your hand. It is very easy to forget that the Ubi solution is not a literal touch screen, like your phone or tablet. In order for the interaction to occur, the Kinect needs to be able to detect your hand. If your body is blocking the Kinect’s vision, it will not trigger any response to your touch gestures. If you mount the Kinect close to the display, it reduces the chance of this happening. When the Kinect has a top-down view, it can see more of the display when you are standing in front of it.

Ubi sensor has a much wider view angle compare to Kinect sensors, so you can put the camera much closer to the surface to avoid occlusion.

Tip #2: Take 5 minutes to learn the Windows touch gestures.

To interact with your favorite applications while using Ubi, you can use the Windows gestures like you would on a Windows tablet or touch device. While most of these gestures are intuitive touch controls, Windows included some additional gestures you may not know about yet. Some of these gestures can make what you’re trying to do a whole lot easier. You can read about the Windows gestures here.

Tip #3: Buy the Ubi Sensor

The Ubi Sensor allows for the best performance with Ubi. It is strongly recommended you use this sensor. It enables the mosts accurate, responsive, and fluid interaction experience.

Tip #4: Lift your hand away from the surface after touching the display.  

When interacting with your display, make sure to remove your hand from the interaction zone in order to trigger the touch event. A “touch event” triggers the interaction and simulates someone touching the touchscreen on the PC. Lifting your hand after touching is especially important if you are using an older sensor like the Kinect v1 or Xbox 360 sensor. With the Ubi sensors, this is less of a problem, but it is still recommended that you lift your finger a few millimeters away from the surface after tapping the screen to trigger the touch event.

Tip #5: To activate the charm bar, start from a couple inches outside the screen and continue a large gesture toward the middle of the screen.

On the right side of the display, swipe your hand starting from outside the display and make a long swipe motion toward the center of the screen to trigger the “charm bar.” The charm bar has many controls like returning to the Windows 8 metro menu, settings, a search bar and more. Some of the controls in the charm bar can also be found in the Ubi menu.

Have more questions? Submit a request