PaNOSC and ExPaNDS commitment to Open Science

PaNOSC and ExPaNDS commitment to Open Science

• 1.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 PaNOSC/ExPaNDS ESFRI Science Clusters long-term commitment to Open Science 11 June 2021 Rudolf Dimper (ESRF-PaNOSC) – Patrick Fuhrmann (DESY ExPaNDS)
• 2.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Photon and Neutron analytical research infrastructures in Europe Fundamental, applied and industrial research on atomic structure and dynamics, link function and properties to atomic structure SPACE & TRANSPORT ENERGY & ENVIRONMENT MICRO & NANOELECTRONICS GEOSCIENCES & EXTREME CONDITIONS NEW MATERIALS CULTURAL & NATURAL HERITAGE FOOD BIOLOGY & HEALTH CHEMISTRY & CATALYSIS
• 3.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Together PaNOSC+ExPaNDS represent almost all Photon and Neutron sources in Europe
• 4.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 PaNOSC factsheet Call: Horizon 2020 InfraEOSC-04 Partners: ESRF, ILL, XFEL.EU, ESS, CERIC-ERIC, ELI-DC, EGI Description: Cluster of ESFRI Photon and Neutron sources Observers/non-funded: GÉANT, EUDAT, national RIs Linked 3rd parties via EGI: DESY, STFC, CESNET Status: Started 1/12/2018 Github: https://github.com/panosc-eu Home page: https://panosc.eu Twitter: @PaNOSC_eu #PaNOSC Budget: 12 M€ Coordinator: ESRF Started: 1/12/2018 Duration: 4 years
• 5.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 ExPaNDS factsheet Call: Horizon 2020 INFRAEOSC 5B Partners: EGI, DESY, Max IV, Soleil, ALBA, HZB, HZDR, UKRI, Diamond, Elettra, PSI Description: National Photon and Neutron sources Status: Started 1/12/2018 Github: https://github.com/ExPaNDS-eu/ExPaNDS Home page: https://expands.eu Twitter: https://twitter.com/ExPaNDs_EU Budget: 6 M€ Coordinator: DESY Started: 1/09/2019 Duration: 3 1/2 years
• 6.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Diamond Some of the PaN Research Infrastructures Petra III ILL ESRF SwissFEL Soleil Max IV Bessy ESS Eu-XFEL ALBA
• 7.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 PaNOSC/ExPaNDS + EOSC: building data services on FAIR data = DATA + SERVICES
• 8.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Where is the DATA? • How do I find them? • How do I get them? • How do I look at them? • What does they mean? • Are they correct? credits – Jon Taylor (ESS) How can I: • download TBs of raw data? • search, view and process data remotely? • access a Jupyter notebook to process my data? • make my data open and get a DOI to cite? • get credentials to login and use these services?
• 9.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 = is amplifying the needs and making them urgent PaNOSC + EOSC should offer: 1. Remote acces to analytical facilities 2. Downloadable metadata & raw data 3. Software services to browse and analyse raw data 4. Platform as a service to do computations + simulations 5. Common space to share progress and workflows 6. Long-term data archive beyond the RI data policies
• 10.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 VISA = remote access during COVID-19 and beyond ● Provide remote data analysis services with access to ○ Experimental data ○ Analysis software ○ Compute infrastructure ○ Support (IT and Scientific) ● Make access as simple as possible using a web browser ● Allow scientific collaborations ● Enable remote experiments credits – Jamie Hall (ILL) + Stuart Caunt (ILL)
• 11.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 PaNOSC and ExPaNDS will provide by 2022  Data policy framework  Persistent identifiers (DOIs) for data  Data management plans  Standard metadata  Nexus/HDF5  Electronic logbooks  Open data  Data search API  Data portal  Jupyter notebook service  Remote access desktops  Data simulation services  Data transfer service  Persistent user identities (AAI)  Scientific software catalogue  e-training platform + material For enabling Open Data + Open Science
• 12.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Mid-term achievements of PaNOSC/ExPaNDS  Enhancing the PaN software catalogue  Designed and developing search data catalogue search API  Simulation software APIs released  Developed python MacStasScript for McStas, integrated in pan-learning  Deployed e-learning platform pan- learning.org supports PaNOSC AAI  2 EOSC services published  Support for HDF5 + NeXus  Developing PaNOSC portal  AAI integrated into eduTEAMS  Deployed Jupyter at all partner sites and also  FAIR research data policy framework  Working on DMP templates  Open call for Use Cases from scientists  Provided publications and feedback to EOSC Working Groups  Organised with ExPaNDS the PaN EOSC symposium 👤 199 participants, 📆 09/11/2020  Many videos promoting Open Science and data management practices Video promoting DOIs + contacted publishers together LEAPS + LENS
• 13.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Sustainability of PaNOSC/ExPaNDS Services to be sustained after the projects: • AAI • Data transfer service (RI-RI, RI-HPC-centre, RI-User) • Helpdesk • Data catalogue search engine + API • Software catalogue • Data visualization service • Jupyter notebook services + data analysis as a service (DAaaS) • Simulation services • E-learning platform
• 14.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Photons (LEAPS – League of European Accelerator based Photon Sources) Neutrons (LENS – League of European Neutron Sources) PaNOSC ExPaNDS DESY STFC CESNET PaN RIs in PaNOSC/ExPaNDS are coming together in LEAPS & LENS
• 15.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Sustainability of PaNOSC/ExPaNDS via LEAPS & LENS  LEAPS & LENS via the RIs in these leagues will share the future sustainability of common services  MoUs will define the cost and SLAs for each of the outputs from PaNOSC/ExPaNDS
• 16.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Cross-Cluster activities today and future • Ontologies – PaNOSC/ExPaNDS + EOSC-Life • Data stewardship training – PaNOSC/ExPaNDS + EOSC-Life • Jupyter HDF5 viewver – PaNOSC/ExPaNDS + ESCAPE • VISA data analysis portal – all clusters and EOSC Future • HDF5 file format best practices – all clusters • Data transfer – PaNOSC/ExPaNDS + ESCAPE • COVID-19 data – PaNOSC/ExPaNDS + EOSC-Life
• 17.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 PaNOSC/ExPaNDS in EOSC-Future • Integrate and exercise the services developed in PaNOSC/ExPaNDS into EOSC • Apply them to two cross-disciplinary science projects • Tracing Bio-Structures • Dynamics of biological processes • Collect feedback, improve services and make them generic, advertise and share results
• 18.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Future role of Science Clusters Desirable common activities • Cloud procurement of scale • Use of HPC, access models, accounting • Workflow tools • Data compression • Machine Learning and Artificial Intelligence • Best practices and knowledge exchange • Share developments of common interest • Fostering the Open Science paradigm Science Clusters • Representing large and divers user communities • Facing the data challenge – more data, more complex data • Ensure that time to publication is reduced • Provide an environment which is user friendly
• 19.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 “The scientific communities using the analytical facilities need an EOSC which enables seamless interaction with open data for open science”
• 20.
  These projects havereceived funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No. 823852 and 857641 Thank you to all PaNOSC/ExPaNDS project members for their contributions to the project and sharing a common vision! [email protected], [email protected]