Introduction to HoloLens development
- 1. Introduction to Microsoft HoloLens Next generation of human computer interaction Mark Blomsma - Veenendaal - 11/10/2016
- 2. Agenda • Introduction • History of UI • AR versus VR • HoloLens Demo • Developing for HoloLens • Unity 3D • Visual Studio 2015 • Play time, try HoloLens
- 3. Introduction • Mark Blomsma • Software Architect @ Develop-One Inc. • Twitter @markblomsma • 25+ years of developing software • Started HoloLens development in 2016
- 6. History of UI • UI: The User Interface is the space where interactions between humans and machines occur. • 1945 -1968: Batch interface (input/output via paper) • 1969 - present: Command-line user interface (input via keys, output to screen) • 1985: Text-Based User Interface • 1968 – present: Graphical User Interface • Desktop Windows • Flat 3D • Phone / Touch (no more mouse!) • Virtual Reality • Holographic • ~1960s – present: Voice User Interface (no screen!) • Voice recognition research • Microsoft recently passed 94.9% speech recognition • Voicemail, Call center
- 7. AR versus VR • Virtual Reality • Takes a user into a computer generated world, generally an immersive experience • There is a disconnect between what the brain is processing and your body is experiencing • Augmented Reality • Adds computer generated elements to the real world. • Brain anchors to the real world, needs to be tricked into believing computer generated elements are real.
- 10. Building Applications User Interface • Layout • Elements • Interaction Logic Business Logic • Services • Algorithms • Validation / Rules • Processing • Connecting to External Services Data • Storage • Integrity Rules
- 11. Developing HoloLens • You’ll need: • Unity 3D HoloLens edition (beta, free edition available) • Visual Studio 2015 • HoloLens Emulator • 16GB memory is needed • HoloLens Toolkit (from GitHub)
- 12. Building Applications User Interface • Layout • Elements • Interaction Logic Business Logic • Services • Algorithms • Validation / Rules • Processing • Connecting to External Services Data • Storage • Integrity Rules
- 13. Windows Holographic • 3D • Visual Elements are 3D objects – even if they’re very thin! • World coordinates • Gaze input • Gesture input • Voice input • Spatial sound • Spatial mapping
- 14. What have I learned? • Thinking in 3D is not the same as web/desktop development • UI specialists are underestimated in web/desktop development • In HoloLens development you’ll need 3D gurus • Programming HoloLens has similarities with Windows XNA in that it works on an Update loop. • Understanding all the async features in C# is going to pay off! • I need a 16GB laptop (8GB will barely run simulator) • Patience with deploying and such