SlideShare a Scribd company logo
Ten ways to make your semantic
app addictive
Elena Simperl, University of
Innsbruck, AT
ISWC 2010
www.insemtives.eu 1
Executive summary
• Many aspects of semantic content authoring naturally rely
on human contribution.
• Motivating users to contribute is essential for semantic
technologies to reach critical mass and ensure sustainable
growth.
• This tutorial is about
– Methods and techniques to study incentives and motivators
applicable to semantic content authoring scenarios.
– How to implement the results of such studies through
technology design, usability engineering, and game mechanics.
www.insemtives.eu 2
Our approach
• Typology of semantic content authoring tasks and
the ways they could motivate users to contribute.
• Methodology for analyzing and designing
incentivized semantic applications.
• Pilots, showcases and technology.
www.insemtives.eu 3
www.insemtives.eu 4
Incentives and motivation
• Incentives are ‘rewards’ assigned by an external ‘judge’
to a performer for undertaking a specific task.
• Common belief (among economists): incentives can be
translated into a sum of money for all practical purposes.
• Incentives can be related to both extrinsic and intrinsic
motivations.
– Extrinsic motivation if task is considered
• Boring, dangerous, useless, socially undesirable, dislikable by
the performer.
– Intrinsic motivation if
• The performer likes what he/she is doing
• The act is satisfying in itself (for various reasons).
www.insemtives.eu 5
Examples
Examples (2)
www.insemtives.eu 6
Examples (3)
www.insemtives.eu 7
Harnessing human intelligence
Facebook reports 4,000,000,000 minutes (> 7500
person years) are spent on the site every day
www.insemtives.eu 8
Recaptcha users solve 60 million CAPTCHAs
a day, which accounts for around 160,000
human hours (19 person years)
More than 18 000 titles
preserved in 10 years
Harnessing human intelligence
www.insemtives.eu 9
Which tasks can be crowdsourced?
• Modularity/Divisibility:
can the task be divided
into smaller chunks (see
casual games, Amazon’s
Mechanical Turk, open
source software)
• Skills and expertise:
does the task address a
broad audience (see
CAPTCHAs, casual
games)
• Combinability
– Additive: pulling a rope
(group performs better than
individuals, but each
individual pulls less hard)
– Conjunctive: running in a
pack (performance is that of
the weakest member, group
size reduces group
performance)
– Disjunctive: answering a quiz
(group size increases group
performance in term of the
time needed to answer)
www.insemtives.eu 10
Example: video annotation
www.insemtives.eu 11
Example: ontology alignment
www.insemtives.eu 12
Example: ontology evaluation
www.insemtives.eu 13
Challenges
• Task selection, work breakdown and distribution
of labor
• Domain selection and creation of knowledge
corpus
• Deriving formal representations from user inputs
• Technology design
• Intrinsic motivations
www.insemtives.eu 14
Factors affecting participation
• Prize is higher
• Participants are more intrinsically motivated ,
have more free time, are non-experts in the field ,
and are not participating due to career concerns,
social motivations, or to beat others.
www.insemtives.eu 15
(Lakhani et al, 2007)
Outline of the tutorial
Time Presentation
09:00 – 09:30 Human contributions in semantic content authoring
09:30 – 10:30 Methods and techniques to analyze and design incentivized semantic
applications
10:30 – 11:00 Coffee break
11:00 – 12:30 Guidelines for incentivized technology design
12:30 - 13:30 Lunch break
13:30 – 14:30 Casual games for semantic content creation
14:30 – 15:00 Hands-on (Part I)
15:00 – 15:30 Coffee break
15:30 – 17:00 Hands-on (Part II)
17:00 – 17:30 Wrap-up and closing
www.insemtives.eu 16
1/29/2015 www.insemtives.eu 17
Realizing the Semantic Web by
encouraging millions of end-users
to create semantic content.

More Related Content

Similar to Introduction (1/6) (20)

PDF
Insemtives iswc2010
Elena Simperl
 
PPTX
WP1 1st Review
INSEMTIVES project
 
PPTX
INSEMTIVES talk at Semtech2010
INSEMTIVES project
 
PDF
INSEMTIVES Tutorial ISWC2011 - Session1
INSEMTIVES project
 
PDF
Insemtives iswc2011 session1
Elena Simperl
 
PDF
Insemtives semtech2010-20100622
Elena Simperl
 
PDF
One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...
Elena Simperl
 
PPTX
IINSEMTIVES
INSEMTIVES
 
PPTX
Tutorial Cognition - Irene
SSSW
 
PDF
Insemtives cluj meetup
Elena Simperl
 
PDF
Insemtives (Newsfromthefront 2010)
STI International
 
PDF
Insemtives stanford
Elena Simperl
 
PDF
Human computation and the Semantic Web (examples)
Elena Simperl
 
PDF
Tutorial: Social Semantic Web and Crowdsourcing - E. Simperl - ESWC SS 2014
eswcsummerschool
 
PDF
SSSW 2016 Cognition Tutorial
Irene Celino
 
PDF
Insemtives swat4ls 2012
Elena Simperl
 
PDF
Insemtives cluj iccp
Elena Simperl
 
PPTX
SemTech2011 - Employee-of-the-Month' Badge Unlocked
INSEMTIVES project
 
PDF
Crowdsourcing & Human Computation Labeling Data & Building Hybrid Systems
Matthew Lease
 
PDF
The semanticweb may2001_timbernerslee
grknsfk
 
Insemtives iswc2010
Elena Simperl
 
WP1 1st Review
INSEMTIVES project
 
INSEMTIVES talk at Semtech2010
INSEMTIVES project
 
INSEMTIVES Tutorial ISWC2011 - Session1
INSEMTIVES project
 
Insemtives iswc2011 session1
Elena Simperl
 
Insemtives semtech2010-20100622
Elena Simperl
 
One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...
Elena Simperl
 
IINSEMTIVES
INSEMTIVES
 
Tutorial Cognition - Irene
SSSW
 
Insemtives cluj meetup
Elena Simperl
 
Insemtives (Newsfromthefront 2010)
STI International
 
Insemtives stanford
Elena Simperl
 
Human computation and the Semantic Web (examples)
Elena Simperl
 
Tutorial: Social Semantic Web and Crowdsourcing - E. Simperl - ESWC SS 2014
eswcsummerschool
 
SSSW 2016 Cognition Tutorial
Irene Celino
 
Insemtives swat4ls 2012
Elena Simperl
 
Insemtives cluj iccp
Elena Simperl
 
SemTech2011 - Employee-of-the-Month' Badge Unlocked
INSEMTIVES project
 
Crowdsourcing & Human Computation Labeling Data & Building Hybrid Systems
Matthew Lease
 
The semanticweb may2001_timbernerslee
grknsfk
 

More from Roberta Cuel (6)

PPT
Insemtives at the KIT
Roberta Cuel
 
PPTX
Methods and techniques (2/6)
Roberta Cuel
 
PPTX
Handson 1 (5/6)
Roberta Cuel
 
PPTX
Guidelines (4/6)
Roberta Cuel
 
PPTX
Methods and techniques-comm (3/6)
Roberta Cuel
 
PPTX
Handson 2 (6/6)
Roberta Cuel
 
Insemtives at the KIT
Roberta Cuel
 
Methods and techniques (2/6)
Roberta Cuel
 
Handson 1 (5/6)
Roberta Cuel
 
Guidelines (4/6)
Roberta Cuel
 
Methods and techniques-comm (3/6)
Roberta Cuel
 
Handson 2 (6/6)
Roberta Cuel
 
Ad

Recently uploaded (20)

PPTX
How to Manage Large Scrollbar in Odoo 18 POS
Celine George
 
PDF
1, 2, 3… E MAIS UM CICLO CHEGA AO FIM!.pdf
Colégio Santa Teresinha
 
PPTX
STAFF DEVELOPMENT AND WELFARE: MANAGEMENT
PRADEEP ABOTHU
 
PPTX
Growth and development and milestones, factors
BHUVANESHWARI BADIGER
 
PPSX
HEALTH ASSESSMENT (Community Health Nursing) - GNM 1st Year
Priyanshu Anand
 
PDF
CHILD RIGHTS AND PROTECTION QUESTION BANK
Dr Raja Mohammed T
 
PPTX
How to Configure Prepayments in Odoo 18 Sales
Celine George
 
PDF
Generative AI: it's STILL not a robot (CIJ Summer 2025)
Paul Bradshaw
 
DOCX
A summary of SPRING SILKWORMS by Mao Dun.docx
maryjosie1
 
PDF
ARAL-Orientation_Morning-Session_Day-11.pdf
JoelVilloso1
 
PDF
IMP NAAC-Reforms-Stakeholder-Consultation-Presentation-on-Draft-Metrics-Unive...
BHARTIWADEKAR
 
PDF
CONCURSO DE POESIA “POETUFAS – PASSOS SUAVES PELO VERSO.pdf
Colégio Santa Teresinha
 
PDF
community health nursing question paper 2.pdf
Prince kumar
 
PPSX
Health Planning in india - Unit 03 - CHN 2 - GNM 3RD YEAR.ppsx
Priyanshu Anand
 
PDF
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - GLOBAL SUCCESS - CẢ NĂM - NĂM 2024 (VOCABULARY, ...
Nguyen Thanh Tu Collection
 
PPTX
Capitol Doctoral Presentation -July 2025.pptx
CapitolTechU
 
PDF
IMP NAAC REFORMS 2024 - 10 Attributes.pdf
BHARTIWADEKAR
 
PPTX
A PPT on Alfred Lord Tennyson's Ulysses.
Beena E S
 
PPTX
How to Configure Lost Reasons in Odoo 18 CRM
Celine George
 
PPTX
ASRB NET 2023 PREVIOUS YEAR QUESTION PAPER GENETICS AND PLANT BREEDING BY SAT...
Krashi Coaching
 
How to Manage Large Scrollbar in Odoo 18 POS
Celine George
 
1, 2, 3… E MAIS UM CICLO CHEGA AO FIM!.pdf
Colégio Santa Teresinha
 
STAFF DEVELOPMENT AND WELFARE: MANAGEMENT
PRADEEP ABOTHU
 
Growth and development and milestones, factors
BHUVANESHWARI BADIGER
 
HEALTH ASSESSMENT (Community Health Nursing) - GNM 1st Year
Priyanshu Anand
 
CHILD RIGHTS AND PROTECTION QUESTION BANK
Dr Raja Mohammed T
 
How to Configure Prepayments in Odoo 18 Sales
Celine George
 
Generative AI: it's STILL not a robot (CIJ Summer 2025)
Paul Bradshaw
 
A summary of SPRING SILKWORMS by Mao Dun.docx
maryjosie1
 
ARAL-Orientation_Morning-Session_Day-11.pdf
JoelVilloso1
 
IMP NAAC-Reforms-Stakeholder-Consultation-Presentation-on-Draft-Metrics-Unive...
BHARTIWADEKAR
 
CONCURSO DE POESIA “POETUFAS – PASSOS SUAVES PELO VERSO.pdf
Colégio Santa Teresinha
 
community health nursing question paper 2.pdf
Prince kumar
 
Health Planning in india - Unit 03 - CHN 2 - GNM 3RD YEAR.ppsx
Priyanshu Anand
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - GLOBAL SUCCESS - CẢ NĂM - NĂM 2024 (VOCABULARY, ...
Nguyen Thanh Tu Collection
 
Capitol Doctoral Presentation -July 2025.pptx
CapitolTechU
 
IMP NAAC REFORMS 2024 - 10 Attributes.pdf
BHARTIWADEKAR
 
A PPT on Alfred Lord Tennyson's Ulysses.
Beena E S
 
How to Configure Lost Reasons in Odoo 18 CRM
Celine George
 
ASRB NET 2023 PREVIOUS YEAR QUESTION PAPER GENETICS AND PLANT BREEDING BY SAT...
Krashi Coaching
 
Ad

Introduction (1/6)

  • 1. Ten ways to make your semantic app addictive Elena Simperl, University of Innsbruck, AT ISWC 2010 www.insemtives.eu 1
  • 2. Executive summary • Many aspects of semantic content authoring naturally rely on human contribution. • Motivating users to contribute is essential for semantic technologies to reach critical mass and ensure sustainable growth. • This tutorial is about – Methods and techniques to study incentives and motivators applicable to semantic content authoring scenarios. – How to implement the results of such studies through technology design, usability engineering, and game mechanics. www.insemtives.eu 2
  • 3. Our approach • Typology of semantic content authoring tasks and the ways they could motivate users to contribute. • Methodology for analyzing and designing incentivized semantic applications. • Pilots, showcases and technology. www.insemtives.eu 3
  • 4. www.insemtives.eu 4 Incentives and motivation • Incentives are ‘rewards’ assigned by an external ‘judge’ to a performer for undertaking a specific task. • Common belief (among economists): incentives can be translated into a sum of money for all practical purposes. • Incentives can be related to both extrinsic and intrinsic motivations. – Extrinsic motivation if task is considered • Boring, dangerous, useless, socially undesirable, dislikable by the performer. – Intrinsic motivation if • The performer likes what he/she is doing • The act is satisfying in itself (for various reasons).
  • 8. Harnessing human intelligence Facebook reports 4,000,000,000 minutes (> 7500 person years) are spent on the site every day www.insemtives.eu 8 Recaptcha users solve 60 million CAPTCHAs a day, which accounts for around 160,000 human hours (19 person years) More than 18 000 titles preserved in 10 years
  • 10. Which tasks can be crowdsourced? • Modularity/Divisibility: can the task be divided into smaller chunks (see casual games, Amazon’s Mechanical Turk, open source software) • Skills and expertise: does the task address a broad audience (see CAPTCHAs, casual games) • Combinability – Additive: pulling a rope (group performs better than individuals, but each individual pulls less hard) – Conjunctive: running in a pack (performance is that of the weakest member, group size reduces group performance) – Disjunctive: answering a quiz (group size increases group performance in term of the time needed to answer) www.insemtives.eu 10
  • 14. Challenges • Task selection, work breakdown and distribution of labor • Domain selection and creation of knowledge corpus • Deriving formal representations from user inputs • Technology design • Intrinsic motivations www.insemtives.eu 14
  • 15. Factors affecting participation • Prize is higher • Participants are more intrinsically motivated , have more free time, are non-experts in the field , and are not participating due to career concerns, social motivations, or to beat others. www.insemtives.eu 15 (Lakhani et al, 2007)
  • 16. Outline of the tutorial Time Presentation 09:00 – 09:30 Human contributions in semantic content authoring 09:30 – 10:30 Methods and techniques to analyze and design incentivized semantic applications 10:30 – 11:00 Coffee break 11:00 – 12:30 Guidelines for incentivized technology design 12:30 - 13:30 Lunch break 13:30 – 14:30 Casual games for semantic content creation 14:30 – 15:00 Hands-on (Part I) 15:00 – 15:30 Coffee break 15:30 – 17:00 Hands-on (Part II) 17:00 – 17:30 Wrap-up and closing www.insemtives.eu 16
  • 17. 1/29/2015 www.insemtives.eu 17 Realizing the Semantic Web by encouraging millions of end-users to create semantic content.