36890126-Blue-Eyes.ppt
- 2. • BLUE EYES is a technology, which aims at creating computational machines that have perceptual and sensory abilities like those of human beings. • The basic idea behind this technology is to give computer human power. • It provides technical means for monitoring and recording human-operator’s physiological condition.
- 3. As the idea is to monitor and record operator’s basic physiological parameters, the most important physiological activity is the movement of eyes. For a computer to sense the eye movement, wiring between operator and the system is required. But, this is a serious limitation of the operator’s mobility and disables his operations in large control rooms. So utilization of wireless technology becomes essential which can be implemented through blue tooth technology.
- 4. Human error- A frequent reason of catastrophes and accidents. Weariness • Oversight • Temporal indisposition An aid to disabled persons. Availability of capable sensors.
- 5. The complex solution for human-operator monitoring: -conscious brain involvement monitoring -triggering user-defined actions -data recording - use of BIOMETRICS What is Blue Eyes not? Doesn’t predict nor interfere with operator’s thoughts. Cannot force directly the operator to work
- 6. Generic control rooms -Power station -Flight control centers Common application -A simpler system version for drivers -An aid to disabled people
- 7. It has the ability to gather information about you and interact with you through special techniques like facial recognition, speech recognition, etc. It can even understand your emotions at the touch of the mouse. It can verify your identity, feel your presence, and start interacting with you. The machine can understand what a user wants, where he is looking at, and even realize his physical or emotional states.
- 8. It realizes the urgency of the situation through the mouse. For instance if you ask the computer to dial to your friend at his office, it understands the situation and establishes a connection
- 9. Visual attention monitoring. Physiological condition monitoring. Operators position detection. Wireless data acquisition using Bluetooth technology. Real time user defined alarm triggering. Recorded data play back.
- 10. Affective Computing The process of making emotional computers with sensing abilities is known as affective computing. The steps used are: 1)Giving sensing abilities - to give machines the equivalent of the eyes, ears, and other sensory organs - voice-recognition software - cameras 2)Detecting human emotions -by biometric techniques 3)Respond properly
- 11. •Affect detection: detecting our emotional states from the expressions on our face •MAGIC pointing: Manual Acquisition with Gaze Tracking Technology •SUITOR: Simple User Interface Tracker •Emotion mouse: expected accuracy is 75%
- 12. Facial expression detection -face recognition -expression detection Speech Recognition Emotion Mouse -IR sensor, thermosister chip, galvanic sensor Eye Gaze Tracking Jazz Multi Sensor
- 14. Eye position measuring - direct infrared occulography Oxy- and deoxyhaemoglobin measurement Two axial accelerometer Ambient light sensor Jazz Multisensor
- 15. Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system. Bluetooth Bluetooth Connection manager Data analysis Visualization module Data logger Atmel 89C52 microcontroller Jazz Multisensor
- 16. Data Acquisition Unit Atmel 89C52 microcontroller - system core Bluetooth module (based on ROK101008) HD44780 - small LCD display 24C16 - I2C EEPROM (on a removable ID card) MC145483 - 13bit PCM codec Jazz Multisensor interface beeper and LED indicators 6 AA batteries and voltage level monitor
- 17. oLightweight oRuns on batteries - low power consumption oEasy to use - does not disturb the operator working oID cards for operator authorization oVoice transmission using hardware PCM codec Data Acquisition Unit Atmel 89C52 microcontroller Jazz Multisensor Bluetooth
- 18. Connection Manager Operator Manager Data Logger Module Data Analysis Module Alarm Dispatcher Module Visualization Module
- 19. • Connection management • Data processing • Visualization • Data recording • Access verification • System maintenance Data analysis Data logger Visualizatio n module Connection manager Bluetooth
- 20. • Raw and processed data visualization
- 21. Blue Eyes software is called “agent”. It analyzes and modifies the mother program, according to the user’s needs and moods.
- 22. Operators Supervisors System administrators
- 23. Operator is a person whose physiological parameters are supervised The operator wears the DAU The only functions offers to the operator are Authorization to the system and receiving alarm alerts. Authorization: Operator has to enter his personal PIN into DAU, if PIN is accepted, authorization is said to be complete. Receiving Alerts: This function supplies the operator with the most important alerts about his and his co- workers’ condition and mobile device state.
- 24. He is the person responsible for analyzing operators’ condition and performance. The supervisor receives tools for inspecting present values of the parameters (on-line browsing) as well as browsing the results of the long-term analysis (off- line browsing).
- 25. He is the user that maintains the system The administrator is delivered tools for adding new operators to the database. Defining alarm conditions. Configuring logging tools. Creating new analyzer modules.
- 26. POD The first blue Eye enabled mass production device It’s a car manufactured by TOYOTA It could keep the driver alert and active It could tell the driver to go slow if he is driving too fast It could hear the driver some sort of interesting music when he is getting bored.
- 27. PONG It’s a robot released by IBM designed for demonstrating the new technology Its equipped with a computer capable of analyzing a person's glances and other forms of expressions of feelings It smiles when the person calls his name It expresses loneliness when it loses sight of the person
- 28. SECURE PAD an electronic badge that can identify the wearer and track his movements and activities with an array of sensors It knows who you are and where you are, and it has a pretty good idea of what you are doing and when you are doing it. The device was designed for a major health-care provider to track the activities of doctors and other personnel at large medical facilities it's interchangeable
- 29. enables the computer to adapt a working style that fits users personality to increase his productivity The technology can also be incorporated into automobiles Blue Eyes is going to find its way in the routines of human beings with application such as TV, washing machine etc. In a company, the supervisor can be given the power to access the database containing his employees profile, which is linked with Blue Eyes technology. hereby he can evaluate the performance of his employees.
- 30. The wireless link between the sensors worn by the operator and the supervising system makes it possible to improve overall reliability, safety and assures proper quality of system performance. These new possibilities can cover areas such as industry, transportation, military command centers or operation theaters. Researchers are attempting to add more capabilities to computers that will allow them to interact like humans, recognize human presents, talk, listen, or even guess their feelings. It avoids potential threats resulting from human errors, such as weariness, oversight, tiredness.
- 31. THANK YOU FOR YOUR ATTENTION
- 32. ANY QUESTIONS?