Catmandu/LibreCat
Playmobil for playing               Legos for building




As child you had two ways to build up your world....
Search



                                                              OAI             Cataloging                     Handle




                                                                                  Sword


                                                                       WOS                           METS

In contemporary repository development you have the same choices... choose a specialized turn-the-key solution
OAI           SOAP             REST      HTML



                                                         Management                Security         Access




                                                            Datastreams                         Objects




...or choose a generic building-block on which you implement your own repository
BUT, WHAT WE WANT...
Mixing of metadata schemas and different workflows

LUND




                                                           Different front-ends for articles and grey literature




But in reality we would like to repositories that combine features of different products...
Image search engine + backend for high res scans and transformations
GENT
Digital archive with cataloging in place....




Some parts which work nice on one system. we would love to see on other systems...
Embeddable front-ends, tunable for every researcher, research
                           group, department or faculty
BIELEFELD




  We didn’t find a repository environment which provided this kind of flexibility ...
WHAT WE ACTUALLY GOT...
3 institutions : 11 systems : 8 platforms
Kahn-Wilensky
OAIS
Kahn-Wilensky & OAIS seem to produce repositories that need
to be very integrated with common metadata, protocols....
                                                                  Handle




                         Deposit                              Harvest    Service
                                                                        Provider



                                   Repositories in a network
                                   Messages about resources
Kahn-Wilensky
OAIS                                                             I search a
Kahn-Wilensky & OAIS seem to produce repositories that need     paper about
to be very integrated with common metadata, protocols....
                                                                  Handle




                         Deposit                              Harvest    Service
                                                                        Provider



                                   Repositories in a network
                                   Messages about resources
In our local environment the messages are very fragmented,
requiring many local adaptions...




                                                                 DNS

       LDAP                                                  HTML

        PROJECT
                                                                       Google
                             ETL                             Excel

        WOS

         Catalog
                                   Repository as local hub             Researcher
                                  Messages about researchers           Department
In our local environment the messages are very fragmented,
requiring many local adaptions...
                                                             Dr. Peeters

                                                                 DNS

       LDAP                                                  HTML

        PROJECT
                                                                           Google
                             ETL                             Excel

        WOS

         Catalog
                                   Repository as local hub                 Researcher
                                  Messages about researchers               Department
Project Catmandu
“Linked Data”
Subject   Predicate   Object       Guard
 312        title     “abc”^en
 312      versionOf     75
 685      deptCode    “WE03”     <2011-09-01

 685      deptCode    “WE04”
Anatomy of Search
database   export
                       index def   fix def


           convert     filter/map    fix


                       index       store


            field def   display
Import

                   Atom   CSV   DBI
  importer                            JSON

$obj->each({})
$obj->first()      MARC   OAI   SRU
$obj->rest()
$obj->select({})
$obj->any({})
$obj->many({})
Store

                          DBI     Solr     Elastic
                                           Search
    JSON                                                 store

                                                     $obj->add({})
                         Mongo      ...              $obj->search()
                          DB



   record.title:“rabbit” and record.author.firstName:“peter”

record.title any “rabbit” and record.author.firstName any “peter”
ETL
           upcase('job');

           capitalize('first');
importer   capitalize('last');
           capitalize('my.deep.nested.0');

  fix       upcase('my.deep.nested.0');
           downcase('my.deep.nested.0');
           substring('my.deep.nested.0',0,2);

  fix       add_field('test');
           add_field('income',0);
           add_field('a.0.0.0',1);

 store     copy_field('first','init');
           copy_field('first','my.deep.nested2');
           substring('init',0,1);

           join_field('colors.0','/');
Project LibreCat
Catmandu / LibreCat Project
Catmandu / LibreCat Project
Catmandu / LibreCat Project
Catmandu / LibreCat Project
Catmandu / LibreCat Project
http://librecat.org

More Related Content

PPT
Catmandu Librecat
PDF
Polyglot Persistence
PDF
wtf is in Java/JDK/wtf7?
PDF
Cloudera Impala, updated for v1.0
PPTX
UKOUG 2011 - Drag, Drop and other Stuff. Using your Database as a File Server
KEY
An introduction to CouchDB
PDF
Simple search with elastic search
PDF
Rupy2012 ArangoDB Workshop Part1
Catmandu Librecat
Polyglot Persistence
wtf is in Java/JDK/wtf7?
Cloudera Impala, updated for v1.0
UKOUG 2011 - Drag, Drop and other Stuff. Using your Database as a File Server
An introduction to CouchDB
Simple search with elastic search
Rupy2012 ArangoDB Workshop Part1

What's hot (20)

PPT
Hive Object Model
KEY
OSCON 2011 Learning CouchDB
PPTX
PPT
Tthornton code4lib
PDF
Riak from Small to Large
PDF
Querying Riak Just Got Easier - Introducing Secondary Indices
PPTX
Solr vs. Elasticsearch - Case by Case
PDF
Apache cassandra in 2016
PPTX
BGOUG 2012 - Drag & drop and other stuff - Using your database as a file server
PDF
Lightning fast analytics with Spark and Cassandra
PDF
d3sparql.js demo at SWAT4LS 2014 in Berlin
PDF
아파트 정보를 이용한 ELK stack 활용 - 오근문
PDF
OrientDB introduction - NoSQL
PDF
XQuery Design Patterns
PDF
Webinar: What's new in the .NET Driver
PPT
2011 Mongo FR - MongoDB introduction
PPTX
NoSQL Introduction
PPT
Introduction to MongoDB
PDF
Hive jdbc
PDF
Building Apps with MongoDB
Hive Object Model
OSCON 2011 Learning CouchDB
Tthornton code4lib
Riak from Small to Large
Querying Riak Just Got Easier - Introducing Secondary Indices
Solr vs. Elasticsearch - Case by Case
Apache cassandra in 2016
BGOUG 2012 - Drag & drop and other stuff - Using your database as a file server
Lightning fast analytics with Spark and Cassandra
d3sparql.js demo at SWAT4LS 2014 in Berlin
아파트 정보를 이용한 ELK stack 활용 - 오근문
OrientDB introduction - NoSQL
XQuery Design Patterns
Webinar: What's new in the .NET Driver
2011 Mongo FR - MongoDB introduction
NoSQL Introduction
Introduction to MongoDB
Hive jdbc
Building Apps with MongoDB
Ad

Viewers also liked (20)

PPT
用户体验设计
PPT
20091120 Vlengel Maastricht
PDF
Users Guide 272 345
PPT
Hadassah Ppt Early Jewish Display
PPTX
Research Steps 2016
PDF
Twice As Much Incentive - Sales and Marketing Mag 2002
PPT
Jeff Dalton David Carrithers V2 Member Recognition Start With The End In...
PPTX
Question Four & Five
KEY
About Innerwealth100%Spirit
PDF
20100306 Datasalon 4 : code4lib
PPTX
KEY
Women Of Algiers 3
PPT
Wireless Transmission Of Spirometric… By Stephen A. Raymond, Ph D
DOC
Project Achangle - One Stored-Value Platform Many Brands
PPT
صور من معرض الرسوم السادس للأطفال
PPT
Human Factor in Project Management
PPT
San Mateo County Fair Overview
 
PPT
GREP - Ghent University Repository
PPTX
Presenatation for evaluation ciara harry george megan
PDF
20090319 OñOndivemi Sm
用户体验设计
20091120 Vlengel Maastricht
Users Guide 272 345
Hadassah Ppt Early Jewish Display
Research Steps 2016
Twice As Much Incentive - Sales and Marketing Mag 2002
Jeff Dalton David Carrithers V2 Member Recognition Start With The End In...
Question Four & Five
About Innerwealth100%Spirit
20100306 Datasalon 4 : code4lib
Women Of Algiers 3
Wireless Transmission Of Spirometric… By Stephen A. Raymond, Ph D
Project Achangle - One Stored-Value Platform Many Brands
صور من معرض الرسوم السادس للأطفال
Human Factor in Project Management
San Mateo County Fair Overview
 
GREP - Ghent University Repository
Presenatation for evaluation ciara harry george megan
20090319 OñOndivemi Sm
Ad

Similar to Catmandu / LibreCat Project (20)

KEY
LibreCat::Catmandu
PDF
Open stack swift_essex_meetup_2012_06_21_judd_maltin
PPTX
ElasticSearch in Production: lessons learned
KEY
NoSQL: Why, When, and How
PPTX
Hotsos 2013 - Creating Structure in Unstructured Data
PPTX
Otago vre-overview
PPTX
Expertezed 2012 Webcast - XML DB Use Cases
PDF
ElasticSearch on AWS - Real Estate portal case study (Spitogatos.gr)
PPTX
Sharepoint Document Library Deep Dive - a how to discussion
PPTX
SWIB14 Weaving repository contents into the Semantic Web
PDF
Querying rich text with XQuery
PDF
ElasticSearch - index server used as a document database
PDF
Geospatial Analysis in the Cloud
PPTX
EBS and RBS in SharePoint 2010
PPTX
PPTX
Data Analytics Meetup: Introduction to Azure Data Lake Storage
 
PPTX
ELK - Stack - Munich .net UG
PPTX
BGOUG 2012 - XML Index Strategies
PDF
Managing Ontologies
PPT
XML Amsterdam - Creating structure in unstructured data
LibreCat::Catmandu
Open stack swift_essex_meetup_2012_06_21_judd_maltin
ElasticSearch in Production: lessons learned
NoSQL: Why, When, and How
Hotsos 2013 - Creating Structure in Unstructured Data
Otago vre-overview
Expertezed 2012 Webcast - XML DB Use Cases
ElasticSearch on AWS - Real Estate portal case study (Spitogatos.gr)
Sharepoint Document Library Deep Dive - a how to discussion
SWIB14 Weaving repository contents into the Semantic Web
Querying rich text with XQuery
ElasticSearch - index server used as a document database
Geospatial Analysis in the Cloud
EBS and RBS in SharePoint 2010
Data Analytics Meetup: Introduction to Azure Data Lake Storage
 
ELK - Stack - Munich .net UG
BGOUG 2012 - XML Index Strategies
Managing Ontologies
XML Amsterdam - Creating structure in unstructured data

More from Patrick Hochstenbach (17)

PDF
Processing Linked Data with Catmandu
PDF
The Library in 2050
PDF
20130308 webstrategie
KEY
PDF
UGent Datacenter of waarom we 140TB kopen
PDF
देवनागरी Devanāgarī
PDF
Informatie Aan Zee - TTT E-Research
PDF
Informatie Aan Zee - TTT Digital Architecture
PDF
ELAG2011 Bootcamp
PDF
Gent_M 2011-04-26
PDF
Open | Linked | Open Linked data
PPT
20100831 igelu mobilise_ugent
PPT
20100618 Datasalon5 Vooruit Gent
PPTX
Data Salon 3 - Ghent
PPT
20081007 Workshop BOM-VL WP3
Processing Linked Data with Catmandu
The Library in 2050
20130308 webstrategie
UGent Datacenter of waarom we 140TB kopen
देवनागरी Devanāgarī
Informatie Aan Zee - TTT E-Research
Informatie Aan Zee - TTT Digital Architecture
ELAG2011 Bootcamp
Gent_M 2011-04-26
Open | Linked | Open Linked data
20100831 igelu mobilise_ugent
20100618 Datasalon5 Vooruit Gent
Data Salon 3 - Ghent
20081007 Workshop BOM-VL WP3

Recently uploaded (20)

PDF
The-Future-of-Automotive-Quality-is-Here-AI-Driven-Engineering.pdf
DOCX
Basics of Cloud Computing - Cloud Ecosystem
PPTX
Build Your First AI Agent with UiPath.pptx
PDF
The influence of sentiment analysis in enhancing early warning system model f...
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PPTX
TEXTILE technology diploma scope and career opportunities
DOCX
search engine optimization ppt fir known well about this
PDF
Early detection and classification of bone marrow changes in lumbar vertebrae...
PPTX
Internet of Everything -Basic concepts details
PDF
giants, standing on the shoulders of - by Daniel Stenberg
PDF
CloudStack 4.21: First Look Webinar slides
PDF
4 layer Arch & Reference Arch of IoT.pdf
PDF
Consumable AI The What, Why & How for Small Teams.pdf
PDF
NewMind AI Weekly Chronicles – August ’25 Week IV
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PPTX
Microsoft Excel 365/2024 Beginner's training
PDF
“A New Era of 3D Sensing: Transforming Industries and Creating Opportunities,...
PDF
Enhancing plagiarism detection using data pre-processing and machine learning...
PDF
Transform-Your-Supply-Chain-with-AI-Driven-Quality-Engineering.pdf
PDF
A review of recent deep learning applications in wood surface defect identifi...
The-Future-of-Automotive-Quality-is-Here-AI-Driven-Engineering.pdf
Basics of Cloud Computing - Cloud Ecosystem
Build Your First AI Agent with UiPath.pptx
The influence of sentiment analysis in enhancing early warning system model f...
Taming the Chaos: How to Turn Unstructured Data into Decisions
TEXTILE technology diploma scope and career opportunities
search engine optimization ppt fir known well about this
Early detection and classification of bone marrow changes in lumbar vertebrae...
Internet of Everything -Basic concepts details
giants, standing on the shoulders of - by Daniel Stenberg
CloudStack 4.21: First Look Webinar slides
4 layer Arch & Reference Arch of IoT.pdf
Consumable AI The What, Why & How for Small Teams.pdf
NewMind AI Weekly Chronicles – August ’25 Week IV
NewMind AI Weekly Chronicles – August ’25 Week III
Microsoft Excel 365/2024 Beginner's training
“A New Era of 3D Sensing: Transforming Industries and Creating Opportunities,...
Enhancing plagiarism detection using data pre-processing and machine learning...
Transform-Your-Supply-Chain-with-AI-Driven-Quality-Engineering.pdf
A review of recent deep learning applications in wood surface defect identifi...

Catmandu / LibreCat Project

  • 2. Playmobil for playing Legos for building As child you had two ways to build up your world....
  • 3. Search OAI Cataloging Handle Sword WOS METS In contemporary repository development you have the same choices... choose a specialized turn-the-key solution
  • 4. OAI SOAP REST HTML Management Security Access Datastreams Objects ...or choose a generic building-block on which you implement your own repository
  • 5. BUT, WHAT WE WANT...
  • 6. Mixing of metadata schemas and different workflows LUND Different front-ends for articles and grey literature But in reality we would like to repositories that combine features of different products...
  • 7. Image search engine + backend for high res scans and transformations GENT Digital archive with cataloging in place.... Some parts which work nice on one system. we would love to see on other systems...
  • 8. Embeddable front-ends, tunable for every researcher, research group, department or faculty BIELEFELD We didn’t find a repository environment which provided this kind of flexibility ...
  • 10. 3 institutions : 11 systems : 8 platforms
  • 11. Kahn-Wilensky OAIS Kahn-Wilensky & OAIS seem to produce repositories that need to be very integrated with common metadata, protocols.... Handle Deposit Harvest Service Provider Repositories in a network Messages about resources
  • 12. Kahn-Wilensky OAIS I search a Kahn-Wilensky & OAIS seem to produce repositories that need paper about to be very integrated with common metadata, protocols.... Handle Deposit Harvest Service Provider Repositories in a network Messages about resources
  • 13. In our local environment the messages are very fragmented, requiring many local adaptions... DNS LDAP HTML PROJECT Google ETL Excel WOS Catalog Repository as local hub Researcher Messages about researchers Department
  • 14. In our local environment the messages are very fragmented, requiring many local adaptions... Dr. Peeters DNS LDAP HTML PROJECT Google ETL Excel WOS Catalog Repository as local hub Researcher Messages about researchers Department
  • 16. “Linked Data” Subject Predicate Object Guard 312 title “abc”^en 312 versionOf 75 685 deptCode “WE03” <2011-09-01 685 deptCode “WE04”
  • 17. Anatomy of Search database export index def fix def convert filter/map fix index store field def display
  • 18. Import Atom CSV DBI importer JSON $obj->each({}) $obj->first() MARC OAI SRU $obj->rest() $obj->select({}) $obj->any({}) $obj->many({})
  • 19. Store DBI Solr Elastic Search JSON store $obj->add({}) Mongo ... $obj->search() DB record.title:“rabbit” and record.author.firstName:“peter” record.title any “rabbit” and record.author.firstName any “peter”
  • 20. ETL upcase('job'); capitalize('first'); importer capitalize('last'); capitalize('my.deep.nested.0'); fix upcase('my.deep.nested.0'); downcase('my.deep.nested.0'); substring('my.deep.nested.0',0,2); fix add_field('test'); add_field('income',0); add_field('a.0.0.0',1); store copy_field('first','init'); copy_field('first','my.deep.nested2'); substring('init',0,1); join_field('colors.0','/');