SlideShare a Scribd company logo
A semantic based framework for
managing, searching and retrieving 3D
                           resources



                              Marios Pitikakis
               CERETETH and University of Thessaly
                             Chiara Catalano
                                       IMATI-CNR
AIM@SHAPE main achievements
Resources (data repositories) and knowledge have been
integrated into a unified Digital Shape Workbench
(DSW) interface.
All components are linked through ontological
structures (“knowledge technologies for shapes”).
Main services supported:
    uploading of resources (models, tools, bibliographic
    references etc);
    advanced searching (SSE & GSE), browsing and downloading
    resources;
    management of resource metadata (i.e. insert/edit/delete
    metadata);
    management and maintenance of ontologies.

    VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Technological achievements

Digital Shape Workbench (DSW)
       knowledge management system & services
       searching and browsing




Resources                                Knowledge
• shapes/models                          • domain and common ontologies
• tools/software                         • metadata for models & tools
• publications                           • glossary



       VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
DSW publicly available content
Shape Repository
       Over 1000 models (1800000 visits, 85000 model downloads)
       A lot of high quality models scanned with laser scanners
Tool repository
       82 software tools or libraries
Digital library
       2821 references in the field
Glossary (372 terms)
Shape ontologies
       5 ontologies defined (2 common ontologies and 3 domain ontologies)
Publications
       350 scientific papers, books, special issues
People and Institutions
       13 partners, 101 researchers, 82 phD students involved
       42 Network Interested Researchers’ Group (NIRG) members
       31 Network Industry Group (NIG) members



      VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
DSW Knowledge Infrastructure Design




 VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
DSW Knowledge Infrastructure
Ontology Server
    The role of the Ontology Server is to integrate the
    SSE, the Inference Engine and the OMR.
Ontology and Metadata Repository (OMR)
    The OMR is an ontology management system and
    constitutes the knowledge base back-end of the
    DSW.
Semantic Search Engine (SSE)
Inference Engine (RacerPro v1.9)
Several protocols and APIs

   VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Knowledge base content
The Ontology and Metadata Repository contains
metadata for
    1000+ models,
    80+ tools/software,
    220+ instances for Users and Institutions,
    3500+ context-dependent instances in the domain and
    common ontologies.

This large knowledge base provides a measure of the
scalability of the DSW infrastructure.

It has also provided a solid test base for the evaluation
of the efficiency of the SSE.

    VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Common Shape Ontology




                                                                    CSO: over 2500 instances
VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Shape Representation class hierarchy




 VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Domain ontologies
Virtual Humans ontology (VHO)
Shape Acquisition and Processing ontology
(SAP)
Product Design ontology (PDO)
A large number of instances have been added
    VHO: over 200
    SAP: over 100
    PDO: over 150
Tutorials of the ontologies can be found in the
DSW web pages.

   VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Browsing-Searching




VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Shape Repository




                      Common Shape Ontology
VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Variety of models




VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Shape Repository


                                                          Range images                         Raw




                                                                                         Quad




                                                                 Uniform
Groups, and sub-group levels
      VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Shape Repository




                                                                               Metadata


VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Shape Repository




                     Download / Visualization Features




VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Example Scenario

Physical
                                • Acquisition
 Digital                        • Reconstruction

Geometry                        • Processing
                                • Structuring
Structure

Semantic



                                                                                       Bimba con nastrino

   VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Insertion into the Shape Repository




VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Second example scenario




VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Geometry-based Search Engine

Goal: to search the Shape Repository of the
DSW according to geometric similarity




   VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Overall Functionalities
The geometric similarity between shapes is evaluated as a distance between
descriptions of the shape that capture relevant properties of the shape

The main ingredients are
   Tools for computing shape descriptors
   Tools for computing distances between shape descriptors (comparison
   methodologies)

Tools for computing shape descriptors and for computing distances between
shape descriptors are implemented as stand-alone tools that can be
plugged into the GSE

The GSE works with different matching criteria depending on the shape
descriptors and the comparison methodologies available (e.g. global or
partial matching)


          VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
Comparison methodologies
Five comparison methodologies
    Structural descriptors
     1. matching algorithm for attributed
        directed graphs
     2. matching algorithm for directed
        graphs

    Topological descriptor
     1. matching algorithm based on the Matching distance
     2. matching algorithm based on the Hausdorff distance




    Geometric descriptor
      1. Euclidean distance between feature vectors
        VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009

More Related Content

What's hot (18)

PDF
IEEE EED2021 AI use cases in Computer Vision
SAMeh Zaghloul
 
PDF
Paper id 21201457
IJRAT
 
PDF
A L -H ARM E XPANSION M OVIE B ASED ON V IRTUAL R EALITY
csandit
 
PDF
Mining Social Graph Data
Drew Conway
 
PDF
COMUTER GRAPHICS NOTES
ho58
 
PDF
Cross-Media Information Systems - Quo Vadis?
Beat Signer
 
PDF
The deep learning technology on coco framework full report
JIEMS Akkalkuwa
 
PPTX
Introduction to Object recognition
Ashiq Ullah
 
PPT
Representing Art in Museums: Back to τεχνή
Alessandro Mongili
 
PDF
IRJET- Image Seeker:Finding Similar Images
IRJET Journal
 
PDF
IRJET - Content based Image Classification
IRJET Journal
 
PDF
Sandhya's portfolio
Sandhya
 
PDF
H018124360
IOSR Journals
 
PDF
Efficient Image Compression Technique using Clustering and Random Permutation
IJERA Editor
 
PPTX
Multimedia content based retrieval slideshare.ppt
govintech1
 
PDF
FOCUS K3D AWG CAD/CAE
FOCUS K3D
 
PPTX
3d printing technology
Prachi Agarwal
 
PDF
GENERATION OF DATABASE AND GUI IN SHAPE MATCHING TECHNIQUE | J4RV3I12001
Journal For Research
 
IEEE EED2021 AI use cases in Computer Vision
SAMeh Zaghloul
 
Paper id 21201457
IJRAT
 
A L -H ARM E XPANSION M OVIE B ASED ON V IRTUAL R EALITY
csandit
 
Mining Social Graph Data
Drew Conway
 
COMUTER GRAPHICS NOTES
ho58
 
Cross-Media Information Systems - Quo Vadis?
Beat Signer
 
The deep learning technology on coco framework full report
JIEMS Akkalkuwa
 
Introduction to Object recognition
Ashiq Ullah
 
Representing Art in Museums: Back to τεχνή
Alessandro Mongili
 
IRJET- Image Seeker:Finding Similar Images
IRJET Journal
 
IRJET - Content based Image Classification
IRJET Journal
 
Sandhya's portfolio
Sandhya
 
H018124360
IOSR Journals
 
Efficient Image Compression Technique using Clustering and Random Permutation
IJERA Editor
 
Multimedia content based retrieval slideshare.ppt
govintech1
 
FOCUS K3D AWG CAD/CAE
FOCUS K3D
 
3d printing technology
Prachi Agarwal
 
GENERATION OF DATABASE AND GUI IN SHAPE MATCHING TECHNIQUE | J4RV3I12001
Journal For Research
 

Viewers also liked (19)

PPTX
3D Searching by ruchi
Ruchi Ritambara
 
PPSX
3D PASSWORD
BERASUDARSHAN
 
DOCX
3D printing
Vinny Chweety
 
PDF
3D password
Jaya Sinha
 
PPTX
Iptv
deepak kumar
 
PPTX
3d search
Abhishek Abhi
 
PPTX
Microsoft Hololens Presentation
Faateh Ali Dhillon
 
PPTX
3D-Doctor
Akhil Kumar
 
PPTX
INTERNET PROTOCOL TELEVISION SEMINAR PPT
Anil Mahapatra
 
PPTX
What Is Data Science? Data Science Course - Data Science Tutorial For Beginne...
Edureka!
 
PPT
3d internet
Subhashree Malla
 
PDF
Mobile IPTV
Seungyun Lee
 
PPT
Seminar Mobile Iptv
agni.anand
 
PDF
data science @NYT ; inaugural Data Science Initiative Lecture
chris wiggins
 
PDF
Tips for data science competitions
Owen Zhang
 
DOCX
Best topics for seminar
shilpi nagpal
 
PDF
Booz Allen Field Guide to Data Science
Booz Allen Hamilton
 
PPTX
Microsoft hololens final ppt
rekhameenacs
 
PPTX
Slideshare ppt
Mandy Suzanne
 
3D Searching by ruchi
Ruchi Ritambara
 
3D PASSWORD
BERASUDARSHAN
 
3D printing
Vinny Chweety
 
3D password
Jaya Sinha
 
3d search
Abhishek Abhi
 
Microsoft Hololens Presentation
Faateh Ali Dhillon
 
3D-Doctor
Akhil Kumar
 
INTERNET PROTOCOL TELEVISION SEMINAR PPT
Anil Mahapatra
 
What Is Data Science? Data Science Course - Data Science Tutorial For Beginne...
Edureka!
 
3d internet
Subhashree Malla
 
Mobile IPTV
Seungyun Lee
 
Seminar Mobile Iptv
agni.anand
 
data science @NYT ; inaugural Data Science Initiative Lecture
chris wiggins
 
Tips for data science competitions
Owen Zhang
 
Best topics for seminar
shilpi nagpal
 
Booz Allen Field Guide to Data Science
Booz Allen Hamilton
 
Microsoft hololens final ppt
rekhameenacs
 
Slideshare ppt
Mandy Suzanne
 
Ad

Similar to A semantic-based framework for managing, searching and retrieving 3D resources - Part 2 (20)

PDF
FOCUS K3D project presentation
Marios Pitikakis
 
PDF
Workshop on 3D Knowledge Technologies for Cultural Heritage Applications: Int...
Marios Pitikakis
 
PPTX
Archaeology & cultural heritage application working group part 2
Manolis Vavalis
 
PPTX
Archaeology and cultural heritage application working group
Manolis Vavalis
 
PPT
3D ICONS: World Heritage Sites for Europeana
3D ICONS Project
 
PPTX
Sharing 3D Cultural Heritage: Standards and metadata
CARARE
 
PDF
3D-­ICONS: Interactive storytelling through innovative interfaces, Carlotta C...
3D ICONS Project
 
PDF
3AMIGAS - Paper1: Chiara Catalano
FOCUS K3D
 
PDF
Computer Graphics Recipes for Endowing 3D Shapes with Semantics in Virtual Wo...
Wolfgang Hürst
 
PDF
A semantic-based framework for managing, searching and retrieving 3D resource...
Marios Pitikakis
 
PDF
3 d molding and casting2
Fab Lab LIMA
 
PPTX
Sharing 3D Cultural Heritage
CARARE
 
PDF
Out of the Box and Online: Creating 3D Models of Queer and Trans Material Cul...
Costas Papadopoulos
 
PPTX
2021 CAA2021 Digital Infrastructures
University of South Australlia
 
PDF
FOCUS K3D Project Flyer
FOCUS K3D
 
PPT
Introduction to 3D ICONS
3D ICONS Project
 
DOCX
GAME TECHNOLOGIES USAGE FOR USERS ATTRACTION TO EDUCATIONAL RESOURCES
Alexander Lavrov
 
PDF
3D-ICONS Guidelines
3D ICONS Project
 
PPT
Towards new digital cultural spaces (archive 2004)
Jpsd consultant
 
PDF
VR for monuments and sites: how to make it work
Daniel Pletinckx
 
FOCUS K3D project presentation
Marios Pitikakis
 
Workshop on 3D Knowledge Technologies for Cultural Heritage Applications: Int...
Marios Pitikakis
 
Archaeology & cultural heritage application working group part 2
Manolis Vavalis
 
Archaeology and cultural heritage application working group
Manolis Vavalis
 
3D ICONS: World Heritage Sites for Europeana
3D ICONS Project
 
Sharing 3D Cultural Heritage: Standards and metadata
CARARE
 
3D-­ICONS: Interactive storytelling through innovative interfaces, Carlotta C...
3D ICONS Project
 
3AMIGAS - Paper1: Chiara Catalano
FOCUS K3D
 
Computer Graphics Recipes for Endowing 3D Shapes with Semantics in Virtual Wo...
Wolfgang Hürst
 
A semantic-based framework for managing, searching and retrieving 3D resource...
Marios Pitikakis
 
3 d molding and casting2
Fab Lab LIMA
 
Sharing 3D Cultural Heritage
CARARE
 
Out of the Box and Online: Creating 3D Models of Queer and Trans Material Cul...
Costas Papadopoulos
 
2021 CAA2021 Digital Infrastructures
University of South Australlia
 
FOCUS K3D Project Flyer
FOCUS K3D
 
Introduction to 3D ICONS
3D ICONS Project
 
GAME TECHNOLOGIES USAGE FOR USERS ATTRACTION TO EDUCATIONAL RESOURCES
Alexander Lavrov
 
3D-ICONS Guidelines
3D ICONS Project
 
Towards new digital cultural spaces (archive 2004)
Jpsd consultant
 
VR for monuments and sites: how to make it work
Daniel Pletinckx
 
Ad

A semantic-based framework for managing, searching and retrieving 3D resources - Part 2

  • 1. A semantic based framework for managing, searching and retrieving 3D resources Marios Pitikakis CERETETH and University of Thessaly Chiara Catalano IMATI-CNR
  • 2. AIM@SHAPE main achievements Resources (data repositories) and knowledge have been integrated into a unified Digital Shape Workbench (DSW) interface. All components are linked through ontological structures (“knowledge technologies for shapes”). Main services supported: uploading of resources (models, tools, bibliographic references etc); advanced searching (SSE & GSE), browsing and downloading resources; management of resource metadata (i.e. insert/edit/delete metadata); management and maintenance of ontologies. VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 3. Technological achievements Digital Shape Workbench (DSW) knowledge management system & services searching and browsing Resources Knowledge • shapes/models • domain and common ontologies • tools/software • metadata for models & tools • publications • glossary VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 4. DSW publicly available content Shape Repository Over 1000 models (1800000 visits, 85000 model downloads) A lot of high quality models scanned with laser scanners Tool repository 82 software tools or libraries Digital library 2821 references in the field Glossary (372 terms) Shape ontologies 5 ontologies defined (2 common ontologies and 3 domain ontologies) Publications 350 scientific papers, books, special issues People and Institutions 13 partners, 101 researchers, 82 phD students involved 42 Network Interested Researchers’ Group (NIRG) members 31 Network Industry Group (NIG) members VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 5. DSW Knowledge Infrastructure Design VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 6. DSW Knowledge Infrastructure Ontology Server The role of the Ontology Server is to integrate the SSE, the Inference Engine and the OMR. Ontology and Metadata Repository (OMR) The OMR is an ontology management system and constitutes the knowledge base back-end of the DSW. Semantic Search Engine (SSE) Inference Engine (RacerPro v1.9) Several protocols and APIs VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 7. Knowledge base content The Ontology and Metadata Repository contains metadata for 1000+ models, 80+ tools/software, 220+ instances for Users and Institutions, 3500+ context-dependent instances in the domain and common ontologies. This large knowledge base provides a measure of the scalability of the DSW infrastructure. It has also provided a solid test base for the evaluation of the efficiency of the SSE. VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 8. Common Shape Ontology CSO: over 2500 instances VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 9. Shape Representation class hierarchy VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 10. Domain ontologies Virtual Humans ontology (VHO) Shape Acquisition and Processing ontology (SAP) Product Design ontology (PDO) A large number of instances have been added VHO: over 200 SAP: over 100 PDO: over 150 Tutorials of the ontologies can be found in the DSW web pages. VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 11. Browsing-Searching VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 12. Shape Repository Common Shape Ontology VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 13. Variety of models VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 14. Shape Repository Range images Raw Quad Uniform Groups, and sub-group levels VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 15. Shape Repository Metadata VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 16. Shape Repository Download / Visualization Features VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 17. Example Scenario Physical • Acquisition Digital • Reconstruction Geometry • Processing • Structuring Structure Semantic Bimba con nastrino VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 18. Insertion into the Shape Repository VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 19. Second example scenario VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 20. Geometry-based Search Engine Goal: to search the Shape Repository of the DSW according to geometric similarity VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 21. Overall Functionalities The geometric similarity between shapes is evaluated as a distance between descriptions of the shape that capture relevant properties of the shape The main ingredients are Tools for computing shape descriptors Tools for computing distances between shape descriptors (comparison methodologies) Tools for computing shape descriptors and for computing distances between shape descriptors are implemented as stand-alone tools that can be plugged into the GSE The GSE works with different matching criteria depending on the shape descriptors and the comparison methodologies available (e.g. global or partial matching) VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009
  • 22. Comparison methodologies Five comparison methodologies  Structural descriptors 1. matching algorithm for attributed directed graphs 2. matching algorithm for directed graphs  Topological descriptor 1. matching algorithm based on the Matching distance 2. matching algorithm based on the Hausdorff distance  Geometric descriptor 1. Euclidean distance between feature vectors VSMM 09, Workshop on 3D Knowledge Technologies for Cultural Heritage Applications, 12 Sept. 2009