Data as a service
Download as PPT, PDF2 likes2,235 views
Emerging Trends in Data Visualization and Dissemination discusses providing statistical data through application programming interfaces (APIs) and as a service rather than goods. It describes how mashups combine data from multiple sources into new applications and services. The document outlines benefits of mashups, how they work by retrieving data through APIs from different websites, and factors to consider when planning a mashup like data sources and programming languages. It provides examples of the United Nations' UNData and Comtrade initiatives that make international statistical databases freely available through APIs and web services.
Data as a service
- 1. Emerging Trends in Data Visualization and Dissemination Internet mashups and Statistical Data as a Service 7 October 2010
- 2. What do we have today? Statistical organizations became competent and capable content providers and users of the Internet. Most NSOs and International Agencies have their websites with static or dynamic content and with interactive databases or downloadable datasets. With the current approach we are distributing statistical data as goods but are there other ways to provide access to statistical data?
- 3. What is a Mashup? A web application that combines data from more than one source into a single integrated tool an example is the use of data from Google Maps to add location information to statistical data, thereby creating a new and distinct web service that was not originally provided by either source
- 4. What are the benefits mashups? Creation of new dynamic user experience Gain valuable insights through information remix Further promotion of our services and data Minimized application data management Reduced development effort Get results faster by accessing information in place Ability to quickly assemble applications for new situations
- 5. How a mashup works? User Mashup website User Request Website 1 Website 2 API Call Data API Call Data Data presentation Data Manipulation
- 6. APIs and web services - API is an abbreviation for Application Program Interface, a set of routines, protocols, and tools for building software applications. A good API makes it easier to develop a program by providing all the building blocks. A programmer then puts the blocks together. - Web services today are frequently just Application Programming Interfaces (API) or web APIs that can be accessed over a network, such as the Internet, and executed on a remote system hosting the requested services.
- 7. How to plan for a mashup? Pick a subject A Mashup of What? Map + Statistical data? Google Fusion tables for transformation + Statistical data? More sources of data More complicated Decide your data sources Who is your data provider? Google maps, Bing maps, etc.. Online data UNdata, Comtrade, Dallas etc.. Usually language agnostic Varying complexity Other concerns How much time do you have? Do you have a server to run it on? Which programming language?
- 8. Providing Data as a Service Dynamic content providers, mashup creators Analysts, researchers, data enthusiasts Storage is provided Need for storage Always latest update Dated with the time of download Dynamic access Bulk onetime download Data as Service Data as Goods
- 9. Data dissemination – UNData UNdata is unique initiative of the Statistics Division to bring statistical information together from various international and national sources and present it in an easily understandable and accessible format. Make UN databases freely available Organize international databases to allow searchability and open access Promote national data dissemination Build a global data dissemination infrastructure
- 10. Data dissemination – UNData
- 11. Data dissemination – UNData
- 12. Data dissemination – UNData
- 13. Global Data Dissemination Framework UNDATA API project – an API version of the great data made available by the United Nations on the UNDATA site. The aim is to make this data accessible and reusable in a variety or ways so it can be easily mashed up and recombined into new applications or analysis.
- 16. Data dissemination – Comtrade Data from over 150 countries processed into a standard format Data by partner country/commodity from 1962 covering about 90% of the world trade 1.5 billion statistical records, 0.5 Terabyte of data Free Web access to any record and paid subscription for use of download services 6 billion records downloaded since June 2003
- 17. Data dissemination – Comtrade API