SlideShare a Scribd company logo
SEMANTIC WEB FOR AAL
  Design & Deployment - Lessons Learned

               Thibaut Tiberghien
               January, 18th 2012




                www.ipal.cnrs.fr
CONTENTS

‣   Some background

‣   Our take on AAL: 2 thesis - 2 approaches - 1 convergence point

‣   Semantic web for AAL

      -   Requirements on technology

      -   Technology selection

‣   Our service platform, an integrated solution

‣   Next? Smart space composer



                                       2
SOME BACKGROUND




    3
SOME BACKGROUND

‣   Ambient Assisted Living (AAL)




                                    3
SOME BACKGROUND

‣   Ambient Assisted Living (AAL)

‣   AMUPADH deployment in Peacehaven nursing home
                                                                               iPhone/Android
                                                                                for nurse (3G)




                                                                                         IPTV
                                                                                        (Wi-Fi)
                                                      Shower
                  Bed




                            Cupboard                                             Nursing console
                                                                                     (Wi-Fi)
                        Shake sensor
                        Passive infrared        Speaker (Bluetooth)    RFID bracelet on resident
                        Pressure sensor        Tiny debian machine
                                                                       ZigBee gateway
                        RFID reader                     Wi-Fi router
                                 over ZigBee



                                                           3
OUR TAKE ON THIS!




    4
OUR TAKE ON THIS!



            End-user
            Services




                        Reasoning Engine
                       (Context Awareness)




        Sensors               Devices        Actuators




    4
OUR TAKE ON THIS!

‣   Service oriented architecture (SOA)

     -   dynamic class loading
                                              End-user
                                              Services

     -   publish & subscribe
                                                          Reasoning Engine
                                                         (Context Awareness)

                                                              OSGi container




                                          Sensors               Devices        Actuators




                                     4
OUR TAKE ON THIS!

‣   Service oriented architecture (SOA)

     -   dynamic class loading
                                               End-user                    SOA software representation
                                               Services                       of plug&play agents

     -   publish & subscribe
                                                           Reasoning Engine
‣   SOA based plug’n’play                                 (Context Awareness)

                                                               OSGi container


     -   loose coupling (mechanical)                                  plug & play




                                           Sensors               Devices                 Actuators




                                       4
OUR TAKE ON THIS!

‣   Service oriented architecture (SOA)

     -   dynamic class loading
                                                 End-user                    SOA software representation
                                                 Services                       of plug&play agents

     -   publish & subscribe
                                                             Reasoning Engine
‣   SOA based plug’n’play                                   (Context Awareness)

                                                                 OSGi container


     -   loose coupling (mechanical)                                    plug & play




‣   Semantics
                                             Sensors               Devices                 Actuators
     -   loose coupling (semantic)

     -   semantic reasoning, description logic (declarative)

                                         4
SEMANTIC WEB FOR AAL
  Requirements gathering




       5
SEMANTIC WEB FOR AAL
                                    Requirements gathering

‣   Retractability of information

      -   contextual information is dynamic & temporal

      -   ease to retract information: asserted & inferred




                                         5
SEMANTIC WEB FOR AAL
                                    Requirements gathering

‣   Retractability of information

      -   contextual information is dynamic & temporal

      -   ease to retract information: asserted & inferred

      -   opposition to RDF monotonicity assumption

      -   Solutions:

            -   higher complexity in reasoner’s language

            -   no live state reasoner



                                           5
SEMANTIC WEB FOR AAL
  Requirements gathering




       6
SEMANTIC WEB FOR AAL
                                  Requirements gathering

‣   Processing efficiency

      -   real-time constraints

      -   highly dynamic data

      -   embedded devices




                                       6
SEMANTIC WEB FOR AAL
                                   Requirements gathering

‣   Processing efficiency

      -   real-time constraints

      -   highly dynamic data

      -   embedded devices

‣   Scalability

      -   size of monitored space? room, building, smart city...

      -   keep linked data

      -   beware of the reasoner’s complexity

                                          6
SEMANTIC WEB FOR AAL
                                        The appropriate reasoner

                               Jena             Pellet          RacerPro            Euler
OWL-DL      entailment     incomplete            ✓                 ✓                 ✓
    Rule format                own              SWRL          own, powerful        N3++
   Retractability               ✓                ~                 ✓                 ✓
        Ease of use      average (manual)        easy           complex             easy
              100             783ms            442ms            ~ 503ms             4ms
Speed




             1,000          29,330ms          28,836ms         ~ 44,166ms           40ms
             10,000                         out of memory                          436ms
        Scalability             ✕                ~                 ✕                 ✓
 Size (download)             22.3Mb            24.3Mb            60.3Mb            12.9Mb
         Licensing       free, open-source free, open-source $, closed-source free, open-source

                                                  7
SEMANTIC WEB FOR AAL
                                        The appropriate reasoner

                               Jena             Pellet          RacerPro            Euler
OWL-DL      entailment     incomplete            ✓                 ✓                 ✓
    Rule format                own              SWRL          own, powerful        N3++
   Retractability               ✓                ~                 ✓                 ✓
        Ease of use      average (manual)        easy           complex             easy
              100             783ms            442ms            ~ 503ms             4ms
Speed




             1,000          29,330ms          28,836ms         ~ 44,166ms           40ms
             10,000                         out of memory                          436ms
        Scalability             ✕                ~                 ✕                 ✓
 Size (download)             22.3Mb            24.3Mb            60.3Mb            12.9Mb
         Licensing       free, open-source free, open-source $, closed-source free, open-source

                                                  7
SEMANTIC WEB FOR AAL
                                        The appropriate reasoner

                               Jena             Pellet          RacerPro            Euler
OWL-DL      entailment     incomplete            ✓                 ✓                 ✓
    Rule format                own              SWRL          own, powerful        N3++
   Retractability               ✓                ~                 ✓                 ✓
        Ease of use      average (manual)        easy           complex             easy
              100             783ms            442ms            ~ 503ms             4ms
Speed




             1,000          29,330ms          28,836ms         ~ 44,166ms           40ms
             10,000                         out of memory                          436ms
        Scalability             ✕                ~                 ✕                 ✓ ☻
 Size (download)             22.3Mb            24.3Mb            60.3Mb            12.9Mb
         Licensing       free, open-source free, open-source $, closed-source free, open-source

                                                  7
UBISMART SERVICE PLATFORM
                                     Architecture

‣   Semantic representation of entities in environment




                                      8
UBISMART SERVICE PLATFORM
                                                           Architecture

‣   Semantic representation of entities in environment
                 Context Producer

                        Sensor
                                            Knowledge Base [KB]                      Service
                        Module
                                                based on Euler                       Delivery
                                                                                                          UI Parser

                                                                                  User Interface
                                                                                    Plasticity
                                                 Context                             Module
          Acquisition                            Stream
           Module
                                                                                                     Interaction
                                                                                                       Handler
                  Context Synthetiser

                               Context
                            Understanding    Context
                                                    ss
                               Module       Awarene                    Service
                                                                      Selection
                                                                       Module
                                                                                                   Service
                                                                                         Service
                                                                    Service
                                                                                                          Service

                                                                          ment             Service
                                                                  Manage
                                                                                          Context Consumer




                                                           8
UBISMART SERVICE PLATFORM
                                                           Architecture

‣   Semantic representation of entities in environment
                 Context Producer

                        Sensor
                                            Knowledge Base [KB]                      Service
                        Module
                                                based on Euler                       Delivery
                                                                                                          UI Parser

                                                                                  User Interface
                                                                                    Plasticity
                                                 Context                             Module
          Acquisition                            Stream
           Module
                                                                                                     Interaction
                                                                                                       Handler
                  Context Synthetiser

                               Context
                            Understanding    Context
                                                    ss
                               Module       Awarene                    Service
                                                                      Selection
                                                                       Module
                                                                                                   Service
                                                                                         Service
                                                                    Service
                                                                                                          Service

                                                                          ment             Service
                                                                  Manage
                                                                                          Context Consumer




                                                           8
UBISMART SERVICE PLATFORM
                                                           Architecture

‣   Semantic representation of entities in environment
                 Context Producer

                        Sensor
                                            Knowledge Base [KB]                      Service
                        Module
                                                based on Euler                       Delivery
                                                                                                          UI Parser

                                                                                  User Interface
                                                                                    Plasticity
                                                 Context                             Module
          Acquisition                            Stream
           Module
                                                                                                     Interaction
                                                                                                       Handler
                  Context Synthetiser

                               Context
                            Understanding    Context
                                                    ss
                               Module       Awarene                    Service
                                                                      Selection
                                                                       Module
                                                                                                   Service
                                                                                         Service
                                                                    Service
                                                                                                          Service

                                                                          ment             Service
                                                                  Manage
                                                                                          Context Consumer




                                                           8
UBISMART SERVICE PLATFORM
                                                           Architecture

‣   Semantic representation of entities in environment
                 Context Producer

                        Sensor
                                            Knowledge Base [KB]                      Service
                        Module
                                                based on Euler                       Delivery
                                                                                                          UI Parser

                                                                                  User Interface
                                                                                    Plasticity
                                                 Context                             Module
          Acquisition                            Stream
           Module
                                                                                                     Interaction
                                                                                                       Handler
                  Context Synthetiser

                               Context
                            Understanding    Context
                                                    ss
                               Module       Awarene                    Service
                                                                      Selection
                                                                       Module
                                                                                                   Service
                                                                                         Service
                                                                    Service
                                                                                                          Service

                                                                          ment             Service
                                                                  Manage
                                                                                          Context Consumer




                                                           8
UBISMART SERVICE PLATFORM
Semantic web: plug’n’play & reasoning




             9
UBISMART SERVICE PLATFORM
                                                 Semantic web: plug’n’play & reasoning




                                                                      Sensors               Devices

                                                                  ZigBee                             Wi-Fi/3G/BT
HomeControlService




                                                        Euler (API)




                                                                                     DeviceManager
                                       ServiceControl
                     ReminderService




                                                                           WSMS




                                                            Apache Felix container



                                                                      9
UBISMART SERVICE PLATFORM
                                                              Semantic web: plug’n’play & reasoning

bundle auto-generation




                                                                                   Sensors                       Devices

                                                                               ZigBee                                     Wi-Fi/3G/BT
             HomeControlService




                                                                     Euler (API)




                                                                                                          DeviceManager
                                                    ServiceControl
                                  ReminderService




                                                                                        WSMS
                                                                                                    ors
                                                                                                 ns
                                                                                               Se




                                                                         Apache Felix container



                                                                                   9
UBISMART SERVICE PLATFORM
                                                              Semantic web: plug’n’play & reasoning

bundle auto-generation




                                                                                   Sensors                                               Devices

                                                                               ZigBee                     DPWS                                    Wi-Fi/3G/BT




                                                                                                           EnvironmentDiscovery
             HomeControlService




                                                                     Euler (API)




                                                                                                                                  DeviceManager
                                                    ServiceControl
                                  ReminderService




                                                                                        WSMS
                                                                                                    ors
                                                                                                 ns
                                                                                               Se




                                                                         Apache Felix container



                                                                                   9
UBISMART SERVICE PLATFORM
                                                              Semantic web: plug’n’play & reasoning

bundle auto-generation




                                                                                   Sensors                                                          Devices

                                                                               ZigBee                     DPWS                                               Wi-Fi/3G/BT




                                                                                                           EnvironmentDiscovery
             HomeControlService




                                                                     Euler (API)




                                                                                                                                             DeviceManager
                                                    ServiceControl
                                  ReminderService




                                                                                        WSMS
                                                                                                    ors                                 es
                                                                                                 ns                                 vic
                                                                                               Se                                 De




                                                                         Apache Felix container



                                                                                   9
UBISMART SERVICE PLATFORM
                                                              Semantic web: plug’n’play & reasoning

bundle auto-generation




                                                                                           Sensors                                                          Devices

                                                                                      ZigBee                      DPWS                                               Wi-Fi/3G/BT




                                                                                                                   EnvironmentDiscovery
             HomeControlService




                                                                          Euler (API)




                                                                                                                                                     DeviceManager
                                                    ServiceControl
                                  ReminderService




                                                                                                WSMS
                                                                     rules.n3 & query.n3                    ors                                 es
                                                                                                         ns                                 vic
                                                                       environment.n3                  Se                                 De
                                                                         skeleton.n3
                                                                           input.n3




                                                                                Apache Felix container



                                                                                           9
UBISMART SERVICE PLATFORM
                                                                         Semantic web: plug’n’play & reasoning

      bundle auto-generation
1. profiles of users, devices, sensors
2. context information, devices status
3. selected service and device
4. start/stop service on a device
5. services status                                                                                      Sensors                                                           Devices
6. service instantiation on device
                                                                                                     ZigBee                     DPWS                                               Wi-Fi/3G/BT




                                                                                                                                 EnvironmentDiscovery
                    HomeControlService




                                                                                         Euler (API)




                                                                                                                                                                   DeviceManager
                                                               ServiceControl
                                         ReminderService




                                                                                                              WSMS
                                                                                    rules.n3 & query.n3                   ors                                 es
                                                                                                                       ns                                 vic
                                                                                      environment.n3                 Se                                 De
                                                                                3       skeleton.n3     1
                                                                                          input.n3

                                                                                    5               2

                    6                                      4
                                                                                               Apache Felix container



                                                                                                        9
UBISMART SERVICE PLATFORM
                                                                        Semantic inference

[KB skeleton]
                                                                toPeople/aboutPeople
                                                                                                                                     usedByPeople
                                                                                                         Service
                      People                                                                           name              hasModel
                                                                                     generateService   model
               name                                                                                    repeat
               snoozeTime           hasContext                                                         id                     onDevice
                                                       Context
                                                                          hasModel                     timeSent                             Device
                                                     name                                              stage
                                                     model                                                                                name
                                                                                                                          hasAckService
    SuperUser                  User                                     hasSolvingContext
    busy                  stageForAlert                                                       Reminder
                                                                                                                    Notification              inLocation
                hasSuperUser                                 Activity                                              ackHandled
                                                                             Deviance          escalateTo          acknowledgement
                                          Location                          solved



                 Legend

           Class
      data property



      object property



       subClassOf




                                                                                 10
UBISMART SERVICE PLATFORM
                                                                        Semantic inference

[KB skeleton]
                                                                toPeople/aboutPeople
                                                                                                                                     usedByPeople
                                                                                                         Service
                      People                                                                           name              hasModel
                                                                                     generateService   model
               name                                                                                    repeat
               snoozeTime           hasContext                                                         id                     onDevice
                                                       Context
                                                                          hasModel                     timeSent                             Device
                                                     name                                              stage
                                                     model                                                                                name
                                                                                                                          hasAckService
    SuperUser                  User                                     hasSolvingContext
    busy                  stageForAlert                                                       Reminder
                                                                                                                    Notification              inLocation
                hasSuperUser                                 Activity                                              ackHandled
                                                                             Deviance          escalateTo          acknowledgement
                                          Location                          solved



                 Legend

           Class
      data property
                                                                                service s, people p, location l, device d, activity a
      object property
                                                 (s toP eople p) ^ (p hasContext l) ^ (d inLocation l) ) (s onDevice d)
       subClassOf                     (p hasContext a) ^ (a handsOn true) ^ (d handheld true) ) (d f itted f alse)



                                                                                 10
PERSPECTIVE WORK
Smart space composer




    11
PERSPECTIVE WORK
                                 Smart space composer

‣   Tackle heterogeneity of deployment environments

     -   configuration tool

     -   describe environment

     -   attach semantics to off-the-shelve hardware




                                       11
PERSPECTIVE WORK
                                   Smart space composer

‣   Tackle heterogeneity of deployment environments

      -   configuration tool

      -   describe environment

      -   attach semantics to off-the-shelve hardware

‣   Push forward the level of reasoning

      -   bind sensors, context, services through parameters

      -   parameters matching rules

      -   difficulty due to contextual data characteristics

                                         11
PERSPECTIVE WORK
                                                           Themes



Context Understanding
   + context approximation




                                                  y
                                                                           Service Selection


                                              int




                                                           Se ellin
                                                                           + service composition




                                                           Mo
                              rta

                                    de xt
                                            g



                                                             rvi
                                  Mo nte
                             ce




                                                              d
                                       llin




                                                                 ce
                             Un

                                    Co




                                                                    g
                                             Device
              SSC                           Modelling
                                                                        User Interface Plasticity
                                                                        multi-modality & polymorphism


   Smart Space Composer




                                                      12
QUESTIONS...




Thibaut Tiberghien
       Ph.D. student (2nd year)
  thibaut.tiberghien@ipal.cnrs.fr


                                    Image & Pervasive Access Lab
                                    International joint research unit - UMI CNRS 2955
                                    www.ipal.cnrs.fr

More Related Content

PPTX
OpenFlow Beyond the Data Centre at IP Expo
ADVA
 
PDF
OW2 Petals Dragon SOA Linuxtag09
Catherine Nuel
 
PDF
Mazer Road Show HP Networking Outubro 2012
Mazer Distribuidora
 
PDF
Gigamon U - You Will See, Content Monitoring, Alerting, and Forensic Analysis
Grant Swanson
 
PDF
Brokerage 2007 presentation wireless
imec.archive
 
PDF
Gigamon U - Missing Link TAP Technology
Grant Swanson
 
PDF
Gigamon U - Its Not The Network
Grant Swanson
 
PDF
SOA Galaxy
Inria
 
OpenFlow Beyond the Data Centre at IP Expo
ADVA
 
OW2 Petals Dragon SOA Linuxtag09
Catherine Nuel
 
Mazer Road Show HP Networking Outubro 2012
Mazer Distribuidora
 
Gigamon U - You Will See, Content Monitoring, Alerting, and Forensic Analysis
Grant Swanson
 
Brokerage 2007 presentation wireless
imec.archive
 
Gigamon U - Missing Link TAP Technology
Grant Swanson
 
Gigamon U - Its Not The Network
Grant Swanson
 
SOA Galaxy
Inria
 

Viewers also liked (17)

PDF
Low Fundae
Debasish Bhattacharjee
 
PDF
Semantic Reasoning in Context-Aware Assistive Environments to Support Ageing ...
IPALab
 
PPTX
Ciudades inteligentes
Mayerlíng Nova
 
PDF
Bio accent
Al Baha University
 
PDF
2015 JBUG KOREA MEETUP - spring4 width infinispan
YongHyuk Lee
 
PPTX
Hinduism Origins
ssclasstorremar
 
PDF
B2B Approach to Social Media
TIAA-CREF via Accrue Partners
 
PPTX
права детей
Светлана Коломиец
 
PPTX
My Educational Technology
Macmac Delos Santos
 
PPT
Chef Dave Parker Portfolio
chefparker1
 
PDF
الزعيم الثائر أحمد عرابى عبد الرحمن الرافعى
Ibrahimia Church Ftriends
 
PPTX
мистика и реальность
Светлана Коломиец
 
PDF
1 s2.0-0304386 x9500113u-main
Al Baha University
 
PPTX
Interface builder: Friend or foe
Zoltán Váradi
 
PPT
Tarea 1
10061985
 
Semantic Reasoning in Context-Aware Assistive Environments to Support Ageing ...
IPALab
 
Ciudades inteligentes
Mayerlíng Nova
 
Bio accent
Al Baha University
 
2015 JBUG KOREA MEETUP - spring4 width infinispan
YongHyuk Lee
 
Hinduism Origins
ssclasstorremar
 
B2B Approach to Social Media
TIAA-CREF via Accrue Partners
 
права детей
Светлана Коломиец
 
My Educational Technology
Macmac Delos Santos
 
Chef Dave Parker Portfolio
chefparker1
 
الزعيم الثائر أحمد عرابى عبد الرحمن الرافعى
Ibrahimia Church Ftriends
 
мистика и реальность
Светлана Коломиец
 
1 s2.0-0304386 x9500113u-main
Al Baha University
 
Interface builder: Friend or foe
Zoltán Váradi
 
Tarea 1
10061985
 
Ad

Similar to Semantic Web for AAL (20)

PPTX
Linked Sensor Data 101 (FIS2011)
Jean-Paul Calbimonte
 
PDF
On Semantics in Onto-DIY
European Patent Office
 
PDF
Research Talk at Bell Labs - IoT System Architecture and Interactions
Fahim Kawsar
 
PDF
SOFIA project INDRA NEO Publication
Sofia Eu
 
PDF
Smart Santander project Jose M. Hernandez Munoz
European Network of Living Labs (ENoLL)
 
PPTX
Application development for the internet of things
Pankesh Patel
 
PPTX
Enabling High Level Application Development In The Internet Of Things
Pankesh Patel
 
PPTX
Ubiquitous Computing and Context-Aware Services
Kuncoro Wastuwibowo
 
PPT
[PerCom'11] A ubiquitous activity monitor to prevent sedentariness (poster)
Josué Freelance
 
PPTX
Telecom trends 261112
Sharon Rozov
 
PPT
My Robot
Andreas Heil
 
PPTX
Lightweight Concurrency
Andreas Heil
 
PDF
Brochure co summit 2012
Smarcos Eu
 
PDF
Managing Massive data of the IoT through cooperative semantic nodes
Benoit Christophe
 
PPTX
Towards application development for the internet of things updated
Pankesh Patel
 
PDF
SEASR Overview
Loretta Auvil
 
PPT
SofwarøSfera Presentation
Diego López-de-Ipiña González-de-Artaza
 
PDF
Thesispresentatie November
Robin De Croon
 
PDF
Thesis presentation: Middleware for Ubicomp - A Model Driven Development Appr...
Till Riedel
 
PPTX
시스템 엔지니어가 바라보는 시맨틱웹과 빅데이터 기술
Haklae Kim
 
Linked Sensor Data 101 (FIS2011)
Jean-Paul Calbimonte
 
On Semantics in Onto-DIY
European Patent Office
 
Research Talk at Bell Labs - IoT System Architecture and Interactions
Fahim Kawsar
 
SOFIA project INDRA NEO Publication
Sofia Eu
 
Smart Santander project Jose M. Hernandez Munoz
European Network of Living Labs (ENoLL)
 
Application development for the internet of things
Pankesh Patel
 
Enabling High Level Application Development In The Internet Of Things
Pankesh Patel
 
Ubiquitous Computing and Context-Aware Services
Kuncoro Wastuwibowo
 
[PerCom'11] A ubiquitous activity monitor to prevent sedentariness (poster)
Josué Freelance
 
Telecom trends 261112
Sharon Rozov
 
My Robot
Andreas Heil
 
Lightweight Concurrency
Andreas Heil
 
Brochure co summit 2012
Smarcos Eu
 
Managing Massive data of the IoT through cooperative semantic nodes
Benoit Christophe
 
Towards application development for the internet of things updated
Pankesh Patel
 
SEASR Overview
Loretta Auvil
 
SofwarøSfera Presentation
Diego López-de-Ipiña González-de-Artaza
 
Thesispresentatie November
Robin De Croon
 
Thesis presentation: Middleware for Ubicomp - A Model Driven Development Appr...
Till Riedel
 
시스템 엔지니어가 바라보는 시맨틱웹과 빅데이터 기술
Haklae Kim
 
Ad

More from IPALab (6)

PPTX
C for Cuda - Small Introduction to GPU computing
IPALab
 
PDF
The MICO Project: COgnitive MIcroscopy For Breast Cancer Grading
IPALab
 
PDF
Using Formal Models For Analysis Of Biological Pathways
IPALab
 
PDF
Marked Point Process For Neurite Tracing
IPALab
 
PDF
A New In-Camera Imaging Model For Color Computer Vision And Its Application
IPALab
 
PDF
Creating Picture Legends For Group Photos
IPALab
 
C for Cuda - Small Introduction to GPU computing
IPALab
 
The MICO Project: COgnitive MIcroscopy For Breast Cancer Grading
IPALab
 
Using Formal Models For Analysis Of Biological Pathways
IPALab
 
Marked Point Process For Neurite Tracing
IPALab
 
A New In-Camera Imaging Model For Color Computer Vision And Its Application
IPALab
 
Creating Picture Legends For Group Photos
IPALab
 

Recently uploaded (20)

PPTX
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
PDF
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
PDF
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
PPTX
The-Ethical-Hackers-Imperative-Safeguarding-the-Digital-Frontier.pptx
sujalchauhan1305
 
PDF
The Evolution of KM Roles (Presented at Knowledge Summit Dublin 2025)
Enterprise Knowledge
 
PDF
Advances in Ultra High Voltage (UHV) Transmission and Distribution Systems.pdf
Nabajyoti Banik
 
PDF
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
PPTX
Dev Dives: Automate, test, and deploy in one place—with Unified Developer Exp...
AndreeaTom
 
PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
PDF
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
PDF
Orbitly Pitch Deck|A Mission-Driven Platform for Side Project Collaboration (...
zz41354899
 
PPTX
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
PDF
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Artjoker Software Development Company
 
PDF
How Open Source Changed My Career by abdelrahman ismail
a0m0rajab1
 
PDF
The Future of Artificial Intelligence (AI)
Mukul
 
PPTX
cloud computing vai.pptx for the project
vaibhavdobariyal79
 
PDF
Brief History of Internet - Early Days of Internet
sutharharshit158
 
PDF
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
The-Ethical-Hackers-Imperative-Safeguarding-the-Digital-Frontier.pptx
sujalchauhan1305
 
The Evolution of KM Roles (Presented at Knowledge Summit Dublin 2025)
Enterprise Knowledge
 
Advances in Ultra High Voltage (UHV) Transmission and Distribution Systems.pdf
Nabajyoti Banik
 
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
Dev Dives: Automate, test, and deploy in one place—with Unified Developer Exp...
AndreeaTom
 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
Orbitly Pitch Deck|A Mission-Driven Platform for Side Project Collaboration (...
zz41354899
 
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Artjoker Software Development Company
 
How Open Source Changed My Career by abdelrahman ismail
a0m0rajab1
 
The Future of Artificial Intelligence (AI)
Mukul
 
cloud computing vai.pptx for the project
vaibhavdobariyal79
 
Brief History of Internet - Early Days of Internet
sutharharshit158
 
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 

Semantic Web for AAL

  • 1. SEMANTIC WEB FOR AAL Design & Deployment - Lessons Learned Thibaut Tiberghien January, 18th 2012 www.ipal.cnrs.fr
  • 2. CONTENTS ‣ Some background ‣ Our take on AAL: 2 thesis - 2 approaches - 1 convergence point ‣ Semantic web for AAL - Requirements on technology - Technology selection ‣ Our service platform, an integrated solution ‣ Next? Smart space composer 2
  • 4. SOME BACKGROUND ‣ Ambient Assisted Living (AAL) 3
  • 5. SOME BACKGROUND ‣ Ambient Assisted Living (AAL) ‣ AMUPADH deployment in Peacehaven nursing home iPhone/Android for nurse (3G) IPTV (Wi-Fi) Shower Bed Cupboard Nursing console (Wi-Fi) Shake sensor Passive infrared Speaker (Bluetooth) RFID bracelet on resident Pressure sensor Tiny debian machine ZigBee gateway RFID reader Wi-Fi router over ZigBee 3
  • 6. OUR TAKE ON THIS! 4
  • 7. OUR TAKE ON THIS! End-user Services Reasoning Engine (Context Awareness) Sensors Devices Actuators 4
  • 8. OUR TAKE ON THIS! ‣ Service oriented architecture (SOA) - dynamic class loading End-user Services - publish & subscribe Reasoning Engine (Context Awareness) OSGi container Sensors Devices Actuators 4
  • 9. OUR TAKE ON THIS! ‣ Service oriented architecture (SOA) - dynamic class loading End-user SOA software representation Services of plug&play agents - publish & subscribe Reasoning Engine ‣ SOA based plug’n’play (Context Awareness) OSGi container - loose coupling (mechanical) plug & play Sensors Devices Actuators 4
  • 10. OUR TAKE ON THIS! ‣ Service oriented architecture (SOA) - dynamic class loading End-user SOA software representation Services of plug&play agents - publish & subscribe Reasoning Engine ‣ SOA based plug’n’play (Context Awareness) OSGi container - loose coupling (mechanical) plug & play ‣ Semantics Sensors Devices Actuators - loose coupling (semantic) - semantic reasoning, description logic (declarative) 4
  • 11. SEMANTIC WEB FOR AAL Requirements gathering 5
  • 12. SEMANTIC WEB FOR AAL Requirements gathering ‣ Retractability of information - contextual information is dynamic & temporal - ease to retract information: asserted & inferred 5
  • 13. SEMANTIC WEB FOR AAL Requirements gathering ‣ Retractability of information - contextual information is dynamic & temporal - ease to retract information: asserted & inferred - opposition to RDF monotonicity assumption - Solutions: - higher complexity in reasoner’s language - no live state reasoner 5
  • 14. SEMANTIC WEB FOR AAL Requirements gathering 6
  • 15. SEMANTIC WEB FOR AAL Requirements gathering ‣ Processing efficiency - real-time constraints - highly dynamic data - embedded devices 6
  • 16. SEMANTIC WEB FOR AAL Requirements gathering ‣ Processing efficiency - real-time constraints - highly dynamic data - embedded devices ‣ Scalability - size of monitored space? room, building, smart city... - keep linked data - beware of the reasoner’s complexity 6
  • 17. SEMANTIC WEB FOR AAL The appropriate reasoner Jena Pellet RacerPro Euler OWL-DL entailment incomplete ✓ ✓ ✓ Rule format own SWRL own, powerful N3++ Retractability ✓ ~ ✓ ✓ Ease of use average (manual) easy complex easy 100 783ms 442ms ~ 503ms 4ms Speed 1,000 29,330ms 28,836ms ~ 44,166ms 40ms 10,000 out of memory 436ms Scalability ✕ ~ ✕ ✓ Size (download) 22.3Mb 24.3Mb 60.3Mb 12.9Mb Licensing free, open-source free, open-source $, closed-source free, open-source 7
  • 18. SEMANTIC WEB FOR AAL The appropriate reasoner Jena Pellet RacerPro Euler OWL-DL entailment incomplete ✓ ✓ ✓ Rule format own SWRL own, powerful N3++ Retractability ✓ ~ ✓ ✓ Ease of use average (manual) easy complex easy 100 783ms 442ms ~ 503ms 4ms Speed 1,000 29,330ms 28,836ms ~ 44,166ms 40ms 10,000 out of memory 436ms Scalability ✕ ~ ✕ ✓ Size (download) 22.3Mb 24.3Mb 60.3Mb 12.9Mb Licensing free, open-source free, open-source $, closed-source free, open-source 7
  • 19. SEMANTIC WEB FOR AAL The appropriate reasoner Jena Pellet RacerPro Euler OWL-DL entailment incomplete ✓ ✓ ✓ Rule format own SWRL own, powerful N3++ Retractability ✓ ~ ✓ ✓ Ease of use average (manual) easy complex easy 100 783ms 442ms ~ 503ms 4ms Speed 1,000 29,330ms 28,836ms ~ 44,166ms 40ms 10,000 out of memory 436ms Scalability ✕ ~ ✕ ✓ ☻ Size (download) 22.3Mb 24.3Mb 60.3Mb 12.9Mb Licensing free, open-source free, open-source $, closed-source free, open-source 7
  • 20. UBISMART SERVICE PLATFORM Architecture ‣ Semantic representation of entities in environment 8
  • 21. UBISMART SERVICE PLATFORM Architecture ‣ Semantic representation of entities in environment Context Producer Sensor Knowledge Base [KB] Service Module based on Euler Delivery UI Parser User Interface Plasticity Context Module Acquisition Stream Module Interaction Handler Context Synthetiser Context Understanding Context ss Module Awarene Service Selection Module Service Service Service Service ment Service Manage Context Consumer 8
  • 22. UBISMART SERVICE PLATFORM Architecture ‣ Semantic representation of entities in environment Context Producer Sensor Knowledge Base [KB] Service Module based on Euler Delivery UI Parser User Interface Plasticity Context Module Acquisition Stream Module Interaction Handler Context Synthetiser Context Understanding Context ss Module Awarene Service Selection Module Service Service Service Service ment Service Manage Context Consumer 8
  • 23. UBISMART SERVICE PLATFORM Architecture ‣ Semantic representation of entities in environment Context Producer Sensor Knowledge Base [KB] Service Module based on Euler Delivery UI Parser User Interface Plasticity Context Module Acquisition Stream Module Interaction Handler Context Synthetiser Context Understanding Context ss Module Awarene Service Selection Module Service Service Service Service ment Service Manage Context Consumer 8
  • 24. UBISMART SERVICE PLATFORM Architecture ‣ Semantic representation of entities in environment Context Producer Sensor Knowledge Base [KB] Service Module based on Euler Delivery UI Parser User Interface Plasticity Context Module Acquisition Stream Module Interaction Handler Context Synthetiser Context Understanding Context ss Module Awarene Service Selection Module Service Service Service Service ment Service Manage Context Consumer 8
  • 25. UBISMART SERVICE PLATFORM Semantic web: plug’n’play & reasoning 9
  • 26. UBISMART SERVICE PLATFORM Semantic web: plug’n’play & reasoning Sensors Devices ZigBee Wi-Fi/3G/BT HomeControlService Euler (API) DeviceManager ServiceControl ReminderService WSMS Apache Felix container 9
  • 27. UBISMART SERVICE PLATFORM Semantic web: plug’n’play & reasoning bundle auto-generation Sensors Devices ZigBee Wi-Fi/3G/BT HomeControlService Euler (API) DeviceManager ServiceControl ReminderService WSMS ors ns Se Apache Felix container 9
  • 28. UBISMART SERVICE PLATFORM Semantic web: plug’n’play & reasoning bundle auto-generation Sensors Devices ZigBee DPWS Wi-Fi/3G/BT EnvironmentDiscovery HomeControlService Euler (API) DeviceManager ServiceControl ReminderService WSMS ors ns Se Apache Felix container 9
  • 29. UBISMART SERVICE PLATFORM Semantic web: plug’n’play & reasoning bundle auto-generation Sensors Devices ZigBee DPWS Wi-Fi/3G/BT EnvironmentDiscovery HomeControlService Euler (API) DeviceManager ServiceControl ReminderService WSMS ors es ns vic Se De Apache Felix container 9
  • 30. UBISMART SERVICE PLATFORM Semantic web: plug’n’play & reasoning bundle auto-generation Sensors Devices ZigBee DPWS Wi-Fi/3G/BT EnvironmentDiscovery HomeControlService Euler (API) DeviceManager ServiceControl ReminderService WSMS rules.n3 & query.n3 ors es ns vic environment.n3 Se De skeleton.n3 input.n3 Apache Felix container 9
  • 31. UBISMART SERVICE PLATFORM Semantic web: plug’n’play & reasoning bundle auto-generation 1. profiles of users, devices, sensors 2. context information, devices status 3. selected service and device 4. start/stop service on a device 5. services status Sensors Devices 6. service instantiation on device ZigBee DPWS Wi-Fi/3G/BT EnvironmentDiscovery HomeControlService Euler (API) DeviceManager ServiceControl ReminderService WSMS rules.n3 & query.n3 ors es ns vic environment.n3 Se De 3 skeleton.n3 1 input.n3 5 2 6 4 Apache Felix container 9
  • 32. UBISMART SERVICE PLATFORM Semantic inference [KB skeleton] toPeople/aboutPeople usedByPeople Service People name hasModel generateService model name repeat snoozeTime hasContext id onDevice Context hasModel timeSent Device name stage model name hasAckService SuperUser User hasSolvingContext busy stageForAlert Reminder Notification inLocation hasSuperUser Activity ackHandled Deviance escalateTo acknowledgement Location solved Legend Class data property object property subClassOf 10
  • 33. UBISMART SERVICE PLATFORM Semantic inference [KB skeleton] toPeople/aboutPeople usedByPeople Service People name hasModel generateService model name repeat snoozeTime hasContext id onDevice Context hasModel timeSent Device name stage model name hasAckService SuperUser User hasSolvingContext busy stageForAlert Reminder Notification inLocation hasSuperUser Activity ackHandled Deviance escalateTo acknowledgement Location solved Legend Class data property service s, people p, location l, device d, activity a object property (s toP eople p) ^ (p hasContext l) ^ (d inLocation l) ) (s onDevice d) subClassOf (p hasContext a) ^ (a handsOn true) ^ (d handheld true) ) (d f itted f alse) 10
  • 35. PERSPECTIVE WORK Smart space composer ‣ Tackle heterogeneity of deployment environments - configuration tool - describe environment - attach semantics to off-the-shelve hardware 11
  • 36. PERSPECTIVE WORK Smart space composer ‣ Tackle heterogeneity of deployment environments - configuration tool - describe environment - attach semantics to off-the-shelve hardware ‣ Push forward the level of reasoning - bind sensors, context, services through parameters - parameters matching rules - difficulty due to contextual data characteristics 11
  • 37. PERSPECTIVE WORK Themes Context Understanding + context approximation y Service Selection int Se ellin + service composition Mo rta de xt g rvi Mo nte ce d llin ce Un Co g Device SSC Modelling User Interface Plasticity multi-modality & polymorphism Smart Space Composer 12
  • 38. QUESTIONS... Thibaut Tiberghien Ph.D. student (2nd year) [email protected] Image & Pervasive Access Lab International joint research unit - UMI CNRS 2955 www.ipal.cnrs.fr

Editor's Notes

  • #2: \n
  • #3: \n
  • #4: AAL: set of ubiquitous technologies embedded in living space to provide pervasive access to context-aware assistive services. EX: enhance aging in place by helping elderly people with their ADL.\n[#]\nmap nh\n
  • #5: AAL: set of ubiquitous technologies embedded in living space to provide pervasive access to context-aware assistive services. EX: enhance aging in place by helping elderly people with their ADL.\n[#]\nmap nh\n
  • #6: AAL: set of ubiquitous technologies embedded in living space to provide pervasive access to context-aware assistive services. EX: enhance aging in place by helping elderly people with their ADL.\n[#]\nmap nh\n
  • #7: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #8: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #9: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #10: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #11: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #12: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #13: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #14: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #15: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #16: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #17: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #18: introduce term entities\nbig idea = modularity, flexibility to go towards deployability without loosing customizability\n[#1] > SOA [#2] > PNP\n?!? whose device? where is the light?\n[#3] > semantic = common language/understanding to describe entities/environ > interoperable > semantic P&P (role1)\n > reasoning (role2)\nimperative = application specific, robust, short design phase\ndeclarative = reusable code by splitting application logic and underlying models, better maintenance \n
  • #19: WANTED: graph repr. > delete auto nodes branching downwards\n[#] > monotonicity\nsolutions: 1. higher complexity = tried and not enthusiastic\n2. no live state is good > explain\n
  • #20: WANTED: graph repr. > delete auto nodes branching downwards\n[#] > monotonicity\nsolutions: 1. higher complexity = tried and not enthusiastic\n2. no live state is good > explain\n
  • #21: WANTED: graph repr. > delete auto nodes branching downwards\n[#] > monotonicity\nsolutions: 1. higher complexity = tried and not enthusiastic\n2. no live state is good > explain\n
  • #22: WANTED: graph repr. > delete auto nodes branching downwards\n[#] > monotonicity\nsolutions: 1. higher complexity = tried and not enthusiastic\n2. no live state is good > explain\n
  • #23: WANTED: graph repr. > delete auto nodes branching downwards\n[#] > monotonicity\nsolutions: 1. higher complexity = tried and not enthusiastic\n2. no live state is good > explain\n
  • #24: WANTED: graph repr. > delete auto nodes branching downwards\n[#] > monotonicity\nsolutions: 1. higher complexity = tried and not enthusiastic\n2. no live state is good > explain\n
  • #25: WANTED: graph repr. > delete auto nodes branching downwards\n[#] > monotonicity\nsolutions: 1. higher complexity = tried and not enthusiastic\n2. no live state is good > explain\n
  • #26: dynamic data contrary of web data for which SW is designed\n[#]\nexplosion of number of triples\ninterconnection of events + linked data philosophy > keep one big ontology\n
  • #27: dynamic data contrary of web data for which SW is designed\n[#]\nexplosion of number of triples\ninterconnection of events + linked data philosophy > keep one big ontology\n
  • #28: make it short!\n
  • #29: make it short!\n
  • #30: \n
  • #31: \n
  • #32: \n
  • #33: \n
  • #34: SOA > bundles\nplug’n’play: WSMS + auto-generation of bundle then DPWS advertise & discovery (web service techno for device connection)\n> add semantics (& same on device side)\nreasoning: euler as bundle, continuous inference, ontology in files updated\n> go through files then 1 to 6\n
  • #35: SOA > bundles\nplug’n’play: WSMS + auto-generation of bundle then DPWS advertise & discovery (web service techno for device connection)\n> add semantics (& same on device side)\nreasoning: euler as bundle, continuous inference, ontology in files updated\n> go through files then 1 to 6\n
  • #36: SOA > bundles\nplug’n’play: WSMS + auto-generation of bundle then DPWS advertise & discovery (web service techno for device connection)\n> add semantics (& same on device side)\nreasoning: euler as bundle, continuous inference, ontology in files updated\n> go through files then 1 to 6\n
  • #37: SOA > bundles\nplug’n’play: WSMS + auto-generation of bundle then DPWS advertise & discovery (web service techno for device connection)\n> add semantics (& same on device side)\nreasoning: euler as bundle, continuous inference, ontology in files updated\n> go through files then 1 to 6\n
  • #38: SOA > bundles\nplug’n’play: WSMS + auto-generation of bundle then DPWS advertise & discovery (web service techno for device connection)\n> add semantics (& same on device side)\nreasoning: euler as bundle, continuous inference, ontology in files updated\n> go through files then 1 to 6\n
  • #39: SOA > bundles\nplug’n’play: WSMS + auto-generation of bundle then DPWS advertise & discovery (web service techno for device connection)\n> add semantics (& same on device side)\nreasoning: euler as bundle, continuous inference, ontology in files updated\n> go through files then 1 to 6\n
  • #40: \n
  • #41: 2 main aspects\nPB now: 1. environment pre-described (user specs, space organization,etc.)\n2. sensors must be configured in the lab, we want to buy on the way\n> conf. tool, extend P&P, already basic behavior done, add semantic\n[#]\nLimitations: contrary to device selection well parametrized, services described at low level: what deviance do they solve\n> parametrize this, rules on parameters\n> hard: non-deterministic, infinite possibilities, heterogeneity of actions...\n
  • #42: 2 main aspects\nPB now: 1. environment pre-described (user specs, space organization,etc.)\n2. sensors must be configured in the lab, we want to buy on the way\n> conf. tool, extend P&P, already basic behavior done, add semantic\n[#]\nLimitations: contrary to device selection well parametrized, services described at low level: what deviance do they solve\n> parametrize this, rules on parameters\n> hard: non-deterministic, infinite possibilities, heterogeneity of actions...\n
  • #43: \n
  • #44: \n