sixth sense technology by pranav mistery
- 1. SIXTH SENCE BY:- AMIT GAJERA
- 2. EVOLUTION OF SIXTH SENSE TECHNOLOGY • Steve Mann implemented the Sixth Sense technology as the neck worn projector with a camera system. • His work was carried forward by Pranav Mistry, an Indian research assistant in MIT Media Lab. • He came up with exciting new applications from this technology. Sixth sense technology was developed at media labs in MIT and coined as Wear Ur World (WUW).
- 3. Definition & Overview • Sixth Sense Technology integrates digital information into the physical world and its objects, making the entire world your computer. • It can turn any surface into a touch-screen for computing, controlled by simple hand gestures. • Sixth Sense device is a mini-projector coupled with a camera and a cell phone-which acts as the computer and your connection to the Cloud, all the information stored on the web.
- 4. • Portable gadget that is worn around neck. • The main concept of sixth Sense is interface two world physical world and logical world. • Two connect this two world the concept of gesture is use. • Gesture is a human sign for any purpose.
- 5. Sixth sense consists this component. Camera • Colored Markers • Projector • Microphone (It Is Optional) • a smart phone(Smart phone is in pocket of user) •
- 6. Camera • The camera is the key input device of the SixthSense system. The camera acts as a digital eye of the system. It basically captures the scene the user is looking at. • The video stream captured by the camera is passed to mobile computing device which does the appropriate computer vision computation. The major functions of the camera can be listed as: • Captures user’s hand movements and gestures • Captures the scene in front and objects the user is interacting with • Takes a photo of the scene in front when the user performs a ‘framing’ gesture • Captures the scene of projected interface
- 7. Projector • The projector is the key output device of the SixthSense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces. • The mobile computing device provides the projector with the content to be projected. The projector unit used in prototype runs on a rechargeable battery. The major functions of the projector can be listed as: • Projects graphical user interface of the selected application onto surfaces or walls in front • Augments the physical objects the user interacting with by projecting just-in-time and related information from the Internet
- 8. Mirror • The mirror reflects the projection coming out from the projector and thus helps in projecting onto the desired locations on walls or surfaces. The user manually can change the tilt of the mirror to change the location of the projection. • For example in application where the user wants the projection to go on the ground instead of the surface in front, he can change the tilt of the mirror to change the projection. Thus, the mirror in the SixthSense helps in overcoming the limitation of the limited projection space of the projector.
- 9. Microphone • The microphone is an optional component of the SixthSense. It is required when using a paper as a computing interface. When the user wants to use a sheet of paper as an interactive surface, he or she clips the microphone to the paper. • The microphone attached this way captures the sound signals of user’s touching the paper. This data is passed to computing device for processing. Later, combined with the tracking information about user’s finger, the system is able to identify precise touch events on the paper. Here, the sound signal captured by the microphone provides time information whereas the camera performs tracking. The applications enabled by this technique are explained earlier.
- 10. Mobile computing device • The SixthSense system uses a mobile computing device in user’s pocket as the processing device. The software program enabling all the features of the system runs on this computing device. • This device can be a mobile phone or a small laptop computer. The camera, the projector and the microphone are connected to this device using wired or wireless connection. • The mobile computing device is also connected to the Internet via 3G network or wireless connection.
- 11. Color Markers • Colored Markers: Red, blue, green, and yellow tape worn on the users fingertips for tracking purposes. • This color marker is used to trace the finger movement. • Using the color marker user can create a painting on the wall or any surface.
- 12. Arrangement Of The Component
- 13. WORKING
- 14. • First of all any picture, image or gestures is in front of user is captured by camera. • Then it send the picture for processing to mobile. • After processing mobile send information to the projector. • Projector is reflect the image or related information on desired surface.
- 15. Application • The Sixth Sense device has a huge number of applications. The following are few of the applications of Sixth Sense Technology • Make a call • Call up a map • Check the time • Create multimedia reading experience • Drawing application
- 16. • Zooming features • Get product information • Get book information • Get flight updates • Feed information on people • Take pictures • Check the email
- 17. Scope • To get rid of color markers • To incorporate camera and projector inside mobile computing device. • Whenever we place pendant- style wearable device on table, it should allow us to use the table as multi touch user interface. • Applying this technology in various interest like gaming, education systems etc. • To have 3D gesture tracking. • To make sixth sense work as fifth sense for disabled person.
- 18. Disadvantage • Sixth sense device is not configure in Linux, Mac or android. • Sixth sense is doesn't work without a Microsoft API.
- 19. LIMITATION • When the device is projecting on a hard surface, it is not private enough for • just the user. People around him can see the projection since it is very detailed. • Projection is better in the night time and dark areas rather than mornings • and bright areas. This is an issue because the vision of the user can be damaged when using this instrument. • Camera is not focus properly on any person and user doesn't like to take a picture of random person.
- 20. COST & SCOPE • Cost: ~300$ • Software will be open source • Many possible medical applications using the technology • Surgical procedures (using tracking capabilities)