This talk covered the capabilities and features next generation apps require – and what it means to take advantage of the new 4th Generation Intel(R) Core(TM) processors.
Key Core Features;
- Intuitive – Perceptual computing
- Fluid – Iris high performance graphics
- Portable – Easier to hold thanks to lower power requirements and better thermals
- Faster – Integer performance for more physics
- Smoother – Lower latency touch subsystem with new processors and Windows 8.1
- Touch – Optimised for touch
- Display – WIDI for sharing on big screens
Highlights of the overview on next generation apps include;
Actions
- Give feedback of action triggered
- Provide a way to undo the action
- Actions to be commutative (any order)
- Physical ‘manipulation’ should be obvious and reversible (move, rotate, resize etc)
- Actions should be repeatable and reliable (don’t rely on gestures which the sensor cannot repeat)
- Reveal the gestures and their function (with hints)
NUI
- NUI is not a fixed toolkit like a GUI
- Don’t just mimic GUI or web apps
- NUI is still abstract, it’s not real world
- NUI should seem an extension of the body
- NUI can leverage previously learned skills
- Involves game aspects
- enjoyable interaction
- a path to skilled usage
- but NOT challenge
- Direct manipulation
- Gaze tracking with speech
- Aim for skilled and fluid actions
Challenges
- Touch has ‘action’ but no tracking
- 3D Gesture has tracking but no ‘action’
- Near touch and stylus with hover/proximity provide the best of both worlds
- Fingers, hands and arms obscuring the view of the screen
- You can drag objects beyond a physical constraint
- Right click is no good for touch/pen (can be replaced with a dwell if critical)
- DON’T generalise between devices and sensors