Comunidad práctica de Laboratorios
30 June 2022
Realizing co-creation of public
services: INTERLINK
Diego López-de-Ipiña (Univ. Deusto)
dipina@deusto.es
@dipina
Comunidad práctica de Laboratorios 2
17/06/2022
• The INTERLINK H2020 project aims to overcome the barriers that hinder
administrations to reuse and share services with private partners (including
citizens) by combining the advantages of two often opposed approaches:
▪ “top-down” approach where Government holds primary responsibility for creating these
services compliant with EU directives, sometimes seeking the support of citizens for
specific design or delivery tasks
▪ “bottom-up” approach in which citizens self-organize and deliver grassroot services where
government plays no active role in day-to-day activities but may provide a facilitating
framework
Towards more citizen-centric and sustainable
public services
Comunidad práctica de Laboratorios 3
17/06/2022
Teaming up co-producers: quadruple helix
Comunidad práctica de Laboratorios 4
17/06/2022
INTERLINK co-production methodology
Comunidad práctica de Laboratorios 5
17/06/2022
• COLLABORATION & RE-USE
▪ The INTERLINK platform offers a digital environment that facilitates co-
production processes between Public Administrations, private
stakeholders and citizens and promotes the re-use of software for
delivery of public services.
• CO-DESIGN & CO-DELIVERY
▪ INTERLINK provides a step-by-step guidance for the co-production and
co-delivery of public services along with guidelines, tips and templates
that facilitate the collaboration of different actors.
• INTERLINKERs
▪ Pieces of knowledge or software that your team can re-use and
customize to deliver services.
INTERLINK’s key principles and concepts
Comunidad práctica de Laboratorios 6
17/06/2022
• Designed to support the co-production methodology of INTERLINK and
facilitate its adoption and application in the co-production of novel public
services
• It offers the following core functionalities:
▪ Co-producer team and project management;
▪ Guide for co-production process;
▪ Recommendation of INTERLINKERs most suitable to the problem profiles represented by
the chosen co-production task;
▪ Selection and registry of use (displaying result of using the enabler, e.g. instantiation of a
Business Plan) and
▪ Access to INTERLINKER catalogue
• Designed to maximize extensibility, adaptation and reusability by making
use of declarative models for INTERLINKERs and co-production schemas
INTERLINK Collaborative Environment
Comunidad práctica de Laboratorios 7
17/06/2022
Collaborative Environment
Comunidad práctica de Laboratorios 8
17/06/2022
• Let’s consider the co-production of Hackathon for Good
• We would create a new co-production process “Zaragoza Apps4Good”
• Create a new team within Zaragoza organization “ZGZ Apps4Good Hackathon
organizers”
• Select a suitable co-production tree for such co-creation artefact (“#2 Hackathon
creation process”)
• Be guided by the co-production tree to make progress in the process
▪ Create rules (DESIGNFocus the problem collaborativelySketch an initial idea of
the Hackathon: theme, plan, submission & evaluation process)
o Only organizers can modify it
▪ Create participation form (RUNService ImplementationOpen Submissions)
o Participants can only view it
• You may involve different users to see different aspects (hackathon organizers &
participants)
Demonstrating co-creation
Comunidad práctica de Laboratorios 9
17/06/2022
Deployment Environments
• We can find them at the following URLs:
▪ https://mef.interlink-project.eu/
▪ https://varam.interlink-project.eu/
▪ https://zgz.interlink-project.eu/
Comunidad práctica de Laboratorios 10
17/06/2022
• 2 iterations per pilot:
• 2 sub-phases per phase:
Pilots’ planning: approach
April - May 2022
(M16 - M17)
PRE-PILOT PILOT EXECUTION
PILOT ITERATION 2
CONSOLIDATION
PRE-PILOT PILOT EXECUTION
PILOT ITERATION 1
EXPLORATION
June - September 2022
(M18 - M21)
March- April 2023
(M27 - M28)
May - Sept 2023
(M29 - M33)
PRE-PILOT PILOT EXECUTION
GOAL: Instantiation of INTERLINK platform and
testing
TESTING GROUP: Selected group of testers
GOAL: Pilot open to all stakeholders (INTERLINKERs and services published and
available to authorized users)
TESTING GROUP: Open set of users: citizens, public administrations and local
businesses (up to 200 users are expected)
ITERATION I (M16 - M21)
April 2022 June 2022 September 2022
Comunidad práctica de Laboratorios 11
17/06/2022
Evaluation goals
• Global or pilot-agnostic goals:
A. INTERLINK USE and CO-PRODUCTION of SERVICES. The number of INTERLINKERs in
use, stakeholders involved with the INTERLINK solution during the two Pilots, as well as
the co-production of services enabled by INTERLINK, which correspond to the KPIs
specified in the Proposal and their targets
B. THE VALUE PROVIDED by INTERLINK. The value improvements provided by the
INTERLINK solution
C. THE USERS’ PERCEPTIONS of INTERLINK. Users’ perceptions of INTERLINK regarding
acceptance, usability, and trust
• Local or pilot-specific goals:
D. PILOT SPECIFIC KPIs. Custom made at each pilot site
Comunidad práctica de Laboratorios 12
17/06/2022
Evaluation dimensions & constructs
• INTERLINK pilots aim to assess whether the co-production model & supporting tools and
co-produced assets put forward by the project will enhance the quality, quantity, and
reuse of public services among European public administrations (PAs).
▪ What will be the degree of ADOPTION achieved by INTERLINK co-production model,
supporting tools and co-produced public services and INTERLINKERs?
Product-based
Quality
• Functional
suitability
• Performance
efficiency
• Compatibility
• Usability
• Reliability
• Security
• Maintanability
• Portability
User-based Quality
• Effectiveness
• Efficiency
• Usefulness
• Satisfaction
• Easy of use
• Flexibility
Value-based
Quality
• Inclusiveness
• Security/Privacy
• Democratic values
• Legitimacy
• Weberian criteria
of public
administration
TRUST >> ACCEPTANCE >> ADOPTION
Quality of co-production process
Comunidad práctica de Laboratorios 13
17/06/2022
Qualitative and quantitative measures for evaluation
gathered at each pilot
• Logging mechanism for understanding user-behaviour in co-production and as end users
▪ Guiding document and spreadsheet
• Questionnaires for alpha testers (alpha scripts, activity satisfaction, UEQ and in-app questionnaires)
• Questionnaires for beta testers (for co-producers and end-users)
• KPIs tables: pilot wide and specific metrics
• Cognitive Walkthrough, Heuristic Evaluation, Think-Aloud, In-depth interviews or videos, and other
techniques
Pre-Pilot sub-phase Pilot Execution Phase
Aim → Instantiation of
INTERLINK services and
testing.
Testing group → Controlled
& selected group of alpha
testers (5-10 users/pilot
site)
Aim → Pilot open to all stakeholders (services published and
available to authorized users).
Testing group → open set of users: citizens, public
administration and local businesses (up to 200 users are
expected)
April (M16 M17)- May 2022
(M17)
June 2022 (M18) – September 2022
(M20 M21)
Data logs
Cognitive walkthrough
Heuristic evaluation
Alpha questionnaires
Data logs
In-app questionnaires
Online surveys
Think-aloud methods
Interviews
April (M16)-May (M17) 2022 June (M18)-September (M21) 2022
Pilot Execution sub-phase
14
Comunidad práctica de Laboratorios
Use case: goal and iterations
MEF’s use case goal is to leverage on the INTERLINK platform and its enablers to co-design a Participatory Strategic
Planning Module (PSPM). These goals are divided into two clear phases of co-design.
Use Case Structure
The second iteration, foresees further
work on the INTERLINK platform, its
enablers, and the PSPM alongside some of
the same and potentially new stakeholders
to gather additional requirements and
feedback. The result of these interactions
will be a mock-up of the PSPM.
Second Iteration:
CO-CREATION PHASE
The first iteration has the goal of collecting
expectations, requirements and feedback
from stakeholders in order to test the
usability of the INTERLINK platform and to
co-design a blueprint of the PSPM
(Participatory Strategic Planning Module)
open to Public Bodies to allow their
participation in the definition of the MEF’s
Strategic Plan.
First Iteration:
CO-DESIGN PHASE
Between iterations
a blueprint of the
PSPM
will be produced
17/06/2022
Comunidad práctica de Laboratorios 15
17/06/2022
VARAM use-case goal
• VARAM aims to improve public services, by involving a wider range of
stakeholders in the development and provision of public (specifically
municipal) services.
• The focus of VARAM pilot is unified municipal services that are provided by
all or majority of Latvian municipalities.
16
Zaragoza UC context
Public admin
NGOs
Research
Entrepreneurs
Artists
Civic Tissue
The City of Zaragoza (ZGZ) together with Zaragoza City of Knowledge
Foundation (FZCC) work jointly to promote collaborative and innovative
programs in education, entrepreneurship, smart city, and digital culture.
Etopia. Center of art and technology, is the headquarters of both the Smart City
Service and the Zaragoza City of Knowledge Foundation.
In addition to Zaragoza City Council's Smart City Service and the Zaragoza City
of Knowledge Foundation, Etopia also involves other stakeholders who design,
organise and produce different programmes aimed at schools, creators,
artists, researchers, entrepreneurs, companies and citizens in general.
eTOPIA_ Center for Arts & Tech. Municipal Innovation Hub
DG.O 2022: Democratizing co-creation
17/06/2022
17
1. Provide a digital layer to our physical co-creation and co-delivery activities
2. Increase our internal productivity through better reporting, tracking, and booking, also creating a
data feedback loop for agile improvement
3. Improve the citizen perception in our brand as a City Making Center through a more accessible and
open catalogue of services
4. Promote the transition from users to co-producers and co-deliverers from an agile and "open
source" approach.
5. Enhance the engagement and participation level of the communities around Etopia_ including its
co-governance through tokenization and gamification.
Zaragoza UC: Goals and Expectations
18
Other initiatives: SOCIO-BEE & GREENGAGE
https://interlink-project.eu/

More Related Content

PDF
A Collaborative Environment to Boost Sustainable Engaged Research & Co-Produc...
PDF
A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...
PDF
Fostering multi-stakeholder collaboration through co-production and rewarding
PDF
Democratizing Co-Production Of Sustainable Public Services
PDF
Empowering citizens to turn them into cocreators of demand driven public serv...
PDF
INTERLINK: Engaged Research through co-production
PDF
Towards Citizen Co-created Public Service Apps
PDF
H2020. Criterios de evaluación y consejos prácticos para la elaboración de pr...
A Collaborative Environment to Boost Sustainable Engaged Research & Co-Produc...
A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...
Fostering multi-stakeholder collaboration through co-production and rewarding
Democratizing Co-Production Of Sustainable Public Services
Empowering citizens to turn them into cocreators of demand driven public serv...
INTERLINK: Engaged Research through co-production
Towards Citizen Co-created Public Service Apps
H2020. Criterios de evaluación y consejos prácticos para la elaboración de pr...

Similar to PrácticaParticipación-INTERLINK-realizingcoproduction_final.pdf (20)

PPTX
PDF
Open lab presentation
PDF
D2.2 Workflow Guidelines
PPTX
Data Days: Citadel pilots results
PDF
EUDAT-EGI collaboration - Welcome and Overview
PDF
How open data ecosystems are stimulated?
PPTX
Barbato leit ict 15-16-17
PPTX
Gesture-based information systems: from DesignOps to DevOps
PPTX
FP7-ICT Programme
PPTX
Cadrage en cycle court : Veolia optimise la gestion de la ressource en eau à ...
PDF
The SNAP Project
PPTX
Bruno Monteiro, technology and experimentation, public service delivery, SIGM...
PDF
Fostering solar technology in the Mediterranean area - Communication Plan
PDF
The H2020 InLife project - A platform for digital AT services in communities ...
 
PPTX
EOSC-hub: A Collaborative Framework for the EOSC Implementation
PDF
Chest caps concertation presentation
PDF
Interreg Sudoe TWIST - Launching interest group EIUIG
PPT
Pieter Ballon - Open Innovation by Living Labs Across Borders: the APOLLON pr...
PDF
Connected Products Studio Report
PPT
JISC Mass Digitization And Sustainable Business Models
Open lab presentation
D2.2 Workflow Guidelines
Data Days: Citadel pilots results
EUDAT-EGI collaboration - Welcome and Overview
How open data ecosystems are stimulated?
Barbato leit ict 15-16-17
Gesture-based information systems: from DesignOps to DevOps
FP7-ICT Programme
Cadrage en cycle court : Veolia optimise la gestion de la ressource en eau à ...
The SNAP Project
Bruno Monteiro, technology and experimentation, public service delivery, SIGM...
Fostering solar technology in the Mediterranean area - Communication Plan
The H2020 InLife project - A platform for digital AT services in communities ...
 
EOSC-hub: A Collaborative Framework for the EOSC Implementation
Chest caps concertation presentation
Interreg Sudoe TWIST - Launching interest group EIUIG
Pieter Ballon - Open Innovation by Living Labs Across Borders: the APOLLON pr...
Connected Products Studio Report
JISC Mass Digitization And Sustainable Business Models
Ad

More from Diego López-de-Ipiña González-de-Artaza (20)

PDF
Validating a Citizen Observatories enabling Platform by completing a Citizen ...
PDF
Citizen Observatories to encourage more democratic data evidence-based decisi...
PDF
Democratizing co-production of thematic co-explorations for Citizen Observato...
PDF
Digital Twin aiding more effective Digital Maintenance
PDF
Humanized Computing: the path towards higher collaboration and reciprocal lea...
PDF
Generative AI How It's Changing Our World and What It Means for You_final.pdf
PDF
Ontological Infrastructure for Interoperable Research Information Systems: HE...
PDF
Internet of People: towards a Human-centric computing for Social Good
PDF
Boosting data-driven innovation in Europe with the support of DIHs
PDF
Social Coin: Blockchain-mediated incentivization of citizens for sustainable ...
PDF
Human-centric Collaborative Services : IoT, Broad Data, Crowdsourcing, Engage...
PDF
Role of Data Incubators shaping European Data Spaces: EDI & REACH cases
PDF
Transiting to SMART COMMUNITIES by fostering Collaboration & CO-CREATION for ...
PDF
ROH: Proceso de Ingeniería Ontológica & Uso y Extensión de Vocabularios Estándar
PDF
Introduction to FAIR Data and Research Objects
PDF
Introducción a Linked Open Data (espacios enlazados y enlazables)
PDF
Red Ontologías Hércules – ROH
PDF
Internet de las cosas y datos de ciencia ciudadana para uso público
PDF
AUDABLOK: Engaging Citizens in Open Data Refinement through Blockchain
PDF
Towards more Elderly-friendly Ambient Assisted Cities
Validating a Citizen Observatories enabling Platform by completing a Citizen ...
Citizen Observatories to encourage more democratic data evidence-based decisi...
Democratizing co-production of thematic co-explorations for Citizen Observato...
Digital Twin aiding more effective Digital Maintenance
Humanized Computing: the path towards higher collaboration and reciprocal lea...
Generative AI How It's Changing Our World and What It Means for You_final.pdf
Ontological Infrastructure for Interoperable Research Information Systems: HE...
Internet of People: towards a Human-centric computing for Social Good
Boosting data-driven innovation in Europe with the support of DIHs
Social Coin: Blockchain-mediated incentivization of citizens for sustainable ...
Human-centric Collaborative Services : IoT, Broad Data, Crowdsourcing, Engage...
Role of Data Incubators shaping European Data Spaces: EDI & REACH cases
Transiting to SMART COMMUNITIES by fostering Collaboration & CO-CREATION for ...
ROH: Proceso de Ingeniería Ontológica & Uso y Extensión de Vocabularios Estándar
Introduction to FAIR Data and Research Objects
Introducción a Linked Open Data (espacios enlazados y enlazables)
Red Ontologías Hércules – ROH
Internet de las cosas y datos de ciencia ciudadana para uso público
AUDABLOK: Engaging Citizens in Open Data Refinement through Blockchain
Towards more Elderly-friendly Ambient Assisted Cities
Ad

Recently uploaded (20)

PDF
A symptom-driven medical diagnosis support model based on machine learning te...
PDF
INTERSPEECH 2025 「Recent Advances and Future Directions in Voice Conversion」
PPTX
Module 1 Introduction to Web Programming .pptx
PPTX
Internet of Everything -Basic concepts details
PDF
NewMind AI Weekly Chronicles – August ’25 Week IV
PPTX
MuleSoft-Compete-Deck for midddleware integrations
PDF
Convolutional neural network based encoder-decoder for efficient real-time ob...
PDF
Co-training pseudo-labeling for text classification with support vector machi...
PDF
The-2025-Engineering-Revolution-AI-Quality-and-DevOps-Convergence.pdf
PDF
Transform-Your-Streaming-Platform-with-AI-Driven-Quality-Engineering.pdf
PPTX
SGT Report The Beast Plan and Cyberphysical Systems of Control
PDF
Advancing precision in air quality forecasting through machine learning integ...
PDF
Early detection and classification of bone marrow changes in lumbar vertebrae...
PPTX
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
PDF
Accessing-Finance-in-Jordan-MENA 2024 2025.pdf
PDF
Comparative analysis of machine learning models for fake news detection in so...
PDF
Lung cancer patients survival prediction using outlier detection and optimize...
PDF
5-Ways-AI-is-Revolutionizing-Telecom-Quality-Engineering.pdf
PDF
Rapid Prototyping: A lecture on prototyping techniques for interface design
PDF
IT-ITes Industry bjjbnkmkhkhknbmhkhmjhjkhj
A symptom-driven medical diagnosis support model based on machine learning te...
INTERSPEECH 2025 「Recent Advances and Future Directions in Voice Conversion」
Module 1 Introduction to Web Programming .pptx
Internet of Everything -Basic concepts details
NewMind AI Weekly Chronicles – August ’25 Week IV
MuleSoft-Compete-Deck for midddleware integrations
Convolutional neural network based encoder-decoder for efficient real-time ob...
Co-training pseudo-labeling for text classification with support vector machi...
The-2025-Engineering-Revolution-AI-Quality-and-DevOps-Convergence.pdf
Transform-Your-Streaming-Platform-with-AI-Driven-Quality-Engineering.pdf
SGT Report The Beast Plan and Cyberphysical Systems of Control
Advancing precision in air quality forecasting through machine learning integ...
Early detection and classification of bone marrow changes in lumbar vertebrae...
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
Accessing-Finance-in-Jordan-MENA 2024 2025.pdf
Comparative analysis of machine learning models for fake news detection in so...
Lung cancer patients survival prediction using outlier detection and optimize...
5-Ways-AI-is-Revolutionizing-Telecom-Quality-Engineering.pdf
Rapid Prototyping: A lecture on prototyping techniques for interface design
IT-ITes Industry bjjbnkmkhkhknbmhkhmjhjkhj

PrácticaParticipación-INTERLINK-realizingcoproduction_final.pdf

  • 1. Comunidad práctica de Laboratorios 30 June 2022 Realizing co-creation of public services: INTERLINK Diego López-de-Ipiña (Univ. Deusto) [email protected] @dipina
  • 2. Comunidad práctica de Laboratorios 2 17/06/2022 • The INTERLINK H2020 project aims to overcome the barriers that hinder administrations to reuse and share services with private partners (including citizens) by combining the advantages of two often opposed approaches: ▪ “top-down” approach where Government holds primary responsibility for creating these services compliant with EU directives, sometimes seeking the support of citizens for specific design or delivery tasks ▪ “bottom-up” approach in which citizens self-organize and deliver grassroot services where government plays no active role in day-to-day activities but may provide a facilitating framework Towards more citizen-centric and sustainable public services
  • 3. Comunidad práctica de Laboratorios 3 17/06/2022 Teaming up co-producers: quadruple helix
  • 4. Comunidad práctica de Laboratorios 4 17/06/2022 INTERLINK co-production methodology
  • 5. Comunidad práctica de Laboratorios 5 17/06/2022 • COLLABORATION & RE-USE ▪ The INTERLINK platform offers a digital environment that facilitates co- production processes between Public Administrations, private stakeholders and citizens and promotes the re-use of software for delivery of public services. • CO-DESIGN & CO-DELIVERY ▪ INTERLINK provides a step-by-step guidance for the co-production and co-delivery of public services along with guidelines, tips and templates that facilitate the collaboration of different actors. • INTERLINKERs ▪ Pieces of knowledge or software that your team can re-use and customize to deliver services. INTERLINK’s key principles and concepts
  • 6. Comunidad práctica de Laboratorios 6 17/06/2022 • Designed to support the co-production methodology of INTERLINK and facilitate its adoption and application in the co-production of novel public services • It offers the following core functionalities: ▪ Co-producer team and project management; ▪ Guide for co-production process; ▪ Recommendation of INTERLINKERs most suitable to the problem profiles represented by the chosen co-production task; ▪ Selection and registry of use (displaying result of using the enabler, e.g. instantiation of a Business Plan) and ▪ Access to INTERLINKER catalogue • Designed to maximize extensibility, adaptation and reusability by making use of declarative models for INTERLINKERs and co-production schemas INTERLINK Collaborative Environment
  • 7. Comunidad práctica de Laboratorios 7 17/06/2022 Collaborative Environment
  • 8. Comunidad práctica de Laboratorios 8 17/06/2022 • Let’s consider the co-production of Hackathon for Good • We would create a new co-production process “Zaragoza Apps4Good” • Create a new team within Zaragoza organization “ZGZ Apps4Good Hackathon organizers” • Select a suitable co-production tree for such co-creation artefact (“#2 Hackathon creation process”) • Be guided by the co-production tree to make progress in the process ▪ Create rules (DESIGNFocus the problem collaborativelySketch an initial idea of the Hackathon: theme, plan, submission & evaluation process) o Only organizers can modify it ▪ Create participation form (RUNService ImplementationOpen Submissions) o Participants can only view it • You may involve different users to see different aspects (hackathon organizers & participants) Demonstrating co-creation
  • 9. Comunidad práctica de Laboratorios 9 17/06/2022 Deployment Environments • We can find them at the following URLs: ▪ https://mef.interlink-project.eu/ ▪ https://varam.interlink-project.eu/ ▪ https://zgz.interlink-project.eu/
  • 10. Comunidad práctica de Laboratorios 10 17/06/2022 • 2 iterations per pilot: • 2 sub-phases per phase: Pilots’ planning: approach April - May 2022 (M16 - M17) PRE-PILOT PILOT EXECUTION PILOT ITERATION 2 CONSOLIDATION PRE-PILOT PILOT EXECUTION PILOT ITERATION 1 EXPLORATION June - September 2022 (M18 - M21) March- April 2023 (M27 - M28) May - Sept 2023 (M29 - M33) PRE-PILOT PILOT EXECUTION GOAL: Instantiation of INTERLINK platform and testing TESTING GROUP: Selected group of testers GOAL: Pilot open to all stakeholders (INTERLINKERs and services published and available to authorized users) TESTING GROUP: Open set of users: citizens, public administrations and local businesses (up to 200 users are expected) ITERATION I (M16 - M21) April 2022 June 2022 September 2022
  • 11. Comunidad práctica de Laboratorios 11 17/06/2022 Evaluation goals • Global or pilot-agnostic goals: A. INTERLINK USE and CO-PRODUCTION of SERVICES. The number of INTERLINKERs in use, stakeholders involved with the INTERLINK solution during the two Pilots, as well as the co-production of services enabled by INTERLINK, which correspond to the KPIs specified in the Proposal and their targets B. THE VALUE PROVIDED by INTERLINK. The value improvements provided by the INTERLINK solution C. THE USERS’ PERCEPTIONS of INTERLINK. Users’ perceptions of INTERLINK regarding acceptance, usability, and trust • Local or pilot-specific goals: D. PILOT SPECIFIC KPIs. Custom made at each pilot site
  • 12. Comunidad práctica de Laboratorios 12 17/06/2022 Evaluation dimensions & constructs • INTERLINK pilots aim to assess whether the co-production model & supporting tools and co-produced assets put forward by the project will enhance the quality, quantity, and reuse of public services among European public administrations (PAs). ▪ What will be the degree of ADOPTION achieved by INTERLINK co-production model, supporting tools and co-produced public services and INTERLINKERs? Product-based Quality • Functional suitability • Performance efficiency • Compatibility • Usability • Reliability • Security • Maintanability • Portability User-based Quality • Effectiveness • Efficiency • Usefulness • Satisfaction • Easy of use • Flexibility Value-based Quality • Inclusiveness • Security/Privacy • Democratic values • Legitimacy • Weberian criteria of public administration TRUST >> ACCEPTANCE >> ADOPTION Quality of co-production process
  • 13. Comunidad práctica de Laboratorios 13 17/06/2022 Qualitative and quantitative measures for evaluation gathered at each pilot • Logging mechanism for understanding user-behaviour in co-production and as end users ▪ Guiding document and spreadsheet • Questionnaires for alpha testers (alpha scripts, activity satisfaction, UEQ and in-app questionnaires) • Questionnaires for beta testers (for co-producers and end-users) • KPIs tables: pilot wide and specific metrics • Cognitive Walkthrough, Heuristic Evaluation, Think-Aloud, In-depth interviews or videos, and other techniques Pre-Pilot sub-phase Pilot Execution Phase Aim → Instantiation of INTERLINK services and testing. Testing group → Controlled & selected group of alpha testers (5-10 users/pilot site) Aim → Pilot open to all stakeholders (services published and available to authorized users). Testing group → open set of users: citizens, public administration and local businesses (up to 200 users are expected) April (M16 M17)- May 2022 (M17) June 2022 (M18) – September 2022 (M20 M21) Data logs Cognitive walkthrough Heuristic evaluation Alpha questionnaires Data logs In-app questionnaires Online surveys Think-aloud methods Interviews April (M16)-May (M17) 2022 June (M18)-September (M21) 2022 Pilot Execution sub-phase
  • 14. 14 Comunidad práctica de Laboratorios Use case: goal and iterations MEF’s use case goal is to leverage on the INTERLINK platform and its enablers to co-design a Participatory Strategic Planning Module (PSPM). These goals are divided into two clear phases of co-design. Use Case Structure The second iteration, foresees further work on the INTERLINK platform, its enablers, and the PSPM alongside some of the same and potentially new stakeholders to gather additional requirements and feedback. The result of these interactions will be a mock-up of the PSPM. Second Iteration: CO-CREATION PHASE The first iteration has the goal of collecting expectations, requirements and feedback from stakeholders in order to test the usability of the INTERLINK platform and to co-design a blueprint of the PSPM (Participatory Strategic Planning Module) open to Public Bodies to allow their participation in the definition of the MEF’s Strategic Plan. First Iteration: CO-DESIGN PHASE Between iterations a blueprint of the PSPM will be produced 17/06/2022
  • 15. Comunidad práctica de Laboratorios 15 17/06/2022 VARAM use-case goal • VARAM aims to improve public services, by involving a wider range of stakeholders in the development and provision of public (specifically municipal) services. • The focus of VARAM pilot is unified municipal services that are provided by all or majority of Latvian municipalities.
  • 16. 16 Zaragoza UC context Public admin NGOs Research Entrepreneurs Artists Civic Tissue The City of Zaragoza (ZGZ) together with Zaragoza City of Knowledge Foundation (FZCC) work jointly to promote collaborative and innovative programs in education, entrepreneurship, smart city, and digital culture. Etopia. Center of art and technology, is the headquarters of both the Smart City Service and the Zaragoza City of Knowledge Foundation. In addition to Zaragoza City Council's Smart City Service and the Zaragoza City of Knowledge Foundation, Etopia also involves other stakeholders who design, organise and produce different programmes aimed at schools, creators, artists, researchers, entrepreneurs, companies and citizens in general. eTOPIA_ Center for Arts & Tech. Municipal Innovation Hub DG.O 2022: Democratizing co-creation 17/06/2022
  • 17. 17 1. Provide a digital layer to our physical co-creation and co-delivery activities 2. Increase our internal productivity through better reporting, tracking, and booking, also creating a data feedback loop for agile improvement 3. Improve the citizen perception in our brand as a City Making Center through a more accessible and open catalogue of services 4. Promote the transition from users to co-producers and co-deliverers from an agile and "open source" approach. 5. Enhance the engagement and participation level of the communities around Etopia_ including its co-governance through tokenization and gamification. Zaragoza UC: Goals and Expectations