Clay Shirky, Fantasy Football, and Using Data to
Glean the Future of Library Collections
Greg Raschke and John Vickery,
North Carolina State University
Charleston Conference
November 3, 2010
Assumptions
 Economics are not sustainable
 Collections budgets will not grow at rate of past 30 years
 Unit growth and growth in cost per unit are not sustainable
 Need to lower costs of overall system
 Lower unit costs
 Use data and users to be more precise
 Therefore collection practices and strategies must change
 This change will be hard – much reason for optimism
Supply-Side Collections
 Print-based, unpredictable
demand, and legitimate need for
just in case collections
 Lead to judging quality by size (as
in the ARL rankings) and libraries
were then held captive to this
standard
 Contributed to inelastic demand
for journals and a combination of
speculative and package buying
 Use is secondary to size, dollars
expended, and other input
measures
 Credit to David Lewis
(http://ulib.iupui.edu/users/dlewis)
Supply-Side Can Not Continue
Demand-Driven Collections
 Make information easily,
widely, and cheaply available
 Collections as drivers of
research, teaching, and
learning
 To make special or unique
collections held/managed by
the library available to the user
community and the world
Demand-Driven – Changing Practice
 Tension between time-honored role as custodians of scholarship
versus enabling digital environment for scholars
 Not just PDA – portfolio of approaches, but certainly more
responsive
 Utilize new tools and techniques to become advanced analysts
 Truly embrace evidence based decision making
 Look at how collections are actually used, not at expressed need
Demand-Driven – More Assumptions
 Less tolerance for and less
investment in lower use
general collections
 Resource management based
increasingly on use
 Modify collecting based on
changes in the actual use
 Risks of doing nothing –
newspapers
Demand-Driven – Assertions
 Rewards of adapting – more
used and vital than ever
 Use based and user driven
collecting models will take
growing share of budget
 Bet on numbers
 Bet on good and quick
 Put resources into enabling
digital environment for
scholars and custodian role
will come out of that strategy
Why So Much Data?
 Data analysis is a key component in solving/managing:
 Increasing pressure for accountability
 Increasing capability to gather and analyze data
 Increasing precision in the way we build collections and expend
resources
 Advocacy
 Changing practice and data analysis at NCSU
Clay Shirky, Fantasy Football, and Using Data to Glean the Future of Library Collections - Radically Different Future of Collection Development
Serials Review 2009 – Open, Data-Driven,
and Real-Time Analysis
 Standardized usage data
(where available)
 Bibliometrics - publication
data and citation patterns
(e.g LJUR)
 Impact factor and eigenfactor
 User community feedback via
interactive, database-driven
applications
 Weigh/calculate/quantify user
feedback
 Weigh price against multiple
data points
 Usage ((07 usage+08 usage/2)+
(publications*10)+ (citations*5)+
(Impact Factor)
 Community Feedback
((Weighted Ranking x % Match)
x Total # Rankings) + 0.1 x # of
"1s“
 Price/feedback value
 Price/use
 Merge results to filter out top
20% and bottom 20%
Looking closer – Finding balance
An example - a closer look at print item usage
 Traditional ILS reporting tools can make this difficult
 Advanced analytical tools can help
 What types of questions can we ask?
 Should Patron-Driven records not purchased be purged after 2 years?
 How does print item usage break down?
 Do print items even get used?
If it’s not used after 2 years…
Should PDA records
be purged?
Maybe…
We haven’t even hit
50% usage
But what if we take
a longer view…
If it’s not used after 2 years…
 Things begin to
look different
Looking even closer…
 How does
print item use
break down?
 Single circ
usage is
consistently
~14%
 Would this
change in a
PDA only
world?
Expenditures to University Data
Expenditures to University Data
Expenditures to University Data
Expenditures to University Data
Measurable Uses of the Collection 2009/2010
Full-text journal downloads* 3,672,600
Database use 1,989,972
Print book circulations/renewals 525,430
Digital collections requests 471,403
E-books 149,815
Reserves** 327,267
Total Uses 7,136,487
* Includes use of NC LIVE full-text content
** Includes textbook, print, and e-reserves usage
Measurable Uses of the Collection 2009/2010
Challenges
 Have ability to be more precise, more used, and more relevant than
ever – need to make the necessary changes
 Apps are a risk – silo(ing) networked, web environment –
connections where libraries can excel
 Not enough data - still lack much of the comprehensive data we
need – must improve quickly
 Data can punish niche areas, disciplinary variation, and titles without
data
 Open resources impact ability to control and command data

More Related Content

PPT
ALA Collections Review Presentation(070209)
PPTX
Collection Intelligence: Using data driven decision making in collection mana...
PPT
Oklahoma Collections Innovation Presentation
PPTX
E-Metrics: Assessing Electronic Resources
PPTX
Web and social media metrics: library’s impact and value
PPTX
Effectively Applying Usage Statistics in E-Resource Collection Development
PPTX
Chilton "Collaborative Collection Assessment"
PPTX
AIM: Data-driven collection management
ALA Collections Review Presentation(070209)
Collection Intelligence: Using data driven decision making in collection mana...
Oklahoma Collections Innovation Presentation
E-Metrics: Assessing Electronic Resources
Web and social media metrics: library’s impact and value
Effectively Applying Usage Statistics in E-Resource Collection Development
Chilton "Collaborative Collection Assessment"
AIM: Data-driven collection management

What's hot (20)

PDF
Data informed decision making - Yaz El Hakim
PPT
We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...
PPTX
UKSG Conference 2017 Breakout - Evaluation of PDA and EBS models for e-books ...
PDF
Electronic Collection Management: How statistics can, and can't, help.
PPTX
Library intelligence notes
PDF
Supporting Students: OER and Textbook Affordability Initiatives at a Mid-Size...
PPTX
Branch oclc publishers_panel_final
PDF
Strategic Metrics
PPTX
Introducing SciVal
PPT
AAUP 2008: E-Journal Experience (H. McGregor)
PPTX
Managing with Data: Using ACRLMetrics and PLAmetrics Webinar
PPTX
Talis Insight Asia-Pacific 2018 - Craig Milne and Kelly Johson, Griffith Univ...
PPTX
Jeremy Buhler on "Demonstrating the Value of Libraries" 2014
PPT
Koch's Feb08 LibLiaison Slideshow
PDF
RDAP 16 Poster: Measuring adoption of Electronic Lab Notebooks and their impa...
PPT
Evaluating Libraries
PPTX
Behave 2018 saves
PPTX
DMPTool2 Webinar #1 for Administrators
PPT
Collection Analysis and Evaluation: Fundamentals of Collection-Centered Asse...
Data informed decision making - Yaz El Hakim
We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...
UKSG Conference 2017 Breakout - Evaluation of PDA and EBS models for e-books ...
Electronic Collection Management: How statistics can, and can't, help.
Library intelligence notes
Supporting Students: OER and Textbook Affordability Initiatives at a Mid-Size...
Branch oclc publishers_panel_final
Strategic Metrics
Introducing SciVal
AAUP 2008: E-Journal Experience (H. McGregor)
Managing with Data: Using ACRLMetrics and PLAmetrics Webinar
Talis Insight Asia-Pacific 2018 - Craig Milne and Kelly Johson, Griffith Univ...
Jeremy Buhler on "Demonstrating the Value of Libraries" 2014
Koch's Feb08 LibLiaison Slideshow
RDAP 16 Poster: Measuring adoption of Electronic Lab Notebooks and their impa...
Evaluating Libraries
Behave 2018 saves
DMPTool2 Webinar #1 for Administrators
Collection Analysis and Evaluation: Fundamentals of Collection-Centered Asse...
Ad

Similar to Clay Shirky, Fantasy Football, and Using Data to Glean the Future of Library Collections - Radically Different Future of Collection Development (20)

PPT
Virginia ACRL Presentation
PPT
Virginia tech collections_presentation
PPT
Moneyball, Libraries, and more - Ithaka collections presentation
PPT
Getting the Most Out of Your E-Resources: Measuring Success
PPT
Collection.Evaluation
PPT
2010 nasig integrating_usage_statistics
PPTX
Encountering COUNTER: Making the most of your usage statistics
PPTX
Eval_Elec_Resources.pptx
PPSX
USING BIGDATA WITH ACADEMIC LIBRARY SERVICES: A VIEW
PPTX
Taking a step back
PPTX
Patron-Driven Acquisition: Turning Theory into Practice (Part 2)
PDF
USER STUDY FOR EXPLORATION OF USERS NEEDS
PPTX
Gather evidence to demonstrate the impact of your research
PPT
Data driven collection development
PDF
What to do about data? An overview of guidelines and policies for dataset co...
PPT
Usage Factor vs. Impact Factor: A case study with
PPT
Lauc Conference May 2009 Next Gen Melvyl
PPT
The Four R's: The Future of the Library
PPTX
What ARE we thinking? Collections decisions in an Academic Library
Virginia ACRL Presentation
Virginia tech collections_presentation
Moneyball, Libraries, and more - Ithaka collections presentation
Getting the Most Out of Your E-Resources: Measuring Success
Collection.Evaluation
2010 nasig integrating_usage_statistics
Encountering COUNTER: Making the most of your usage statistics
Eval_Elec_Resources.pptx
USING BIGDATA WITH ACADEMIC LIBRARY SERVICES: A VIEW
Taking a step back
Patron-Driven Acquisition: Turning Theory into Practice (Part 2)
USER STUDY FOR EXPLORATION OF USERS NEEDS
Gather evidence to demonstrate the impact of your research
Data driven collection development
What to do about data? An overview of guidelines and policies for dataset co...
Usage Factor vs. Impact Factor: A case study with
Lauc Conference May 2009 Next Gen Melvyl
The Four R's: The Future of the Library
What ARE we thinking? Collections decisions in an Academic Library
Ad

More from Greg Raschke (12)

PDF
Library Usage as a Map for Targeting OER Advocacy
PPT
The Experiential Library: The Transformed Libraries Impact on Teaching and Le...
PPT
Preparing for New Roles and Transformed Libraries: Models and Implementation
PPTX
Digital Scholarship Spaces: Building Communities & Enabling Collaboration
PPT
Preparing Research Librarians for Transformed Libraries: Creating a Community...
PPT
Libraries Leading the Way on the 'Textbook Problem'
PPT
TRLN Beyond Print: Consortial E-Book Acquisitions: Librarian/Publisher/Vendor...
PPT
TRLN Beyond Print: Consortial E-Book Acquisitions: Librarian/Publisher/Vendor...
PPT
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
PPT
Beyond Print Summit: TRLN History, Context, and Motivations
PPT
UNC Collaborative Book Purchasing Plan
PPT
Open Textbook Models: View from the Library
Library Usage as a Map for Targeting OER Advocacy
The Experiential Library: The Transformed Libraries Impact on Teaching and Le...
Preparing for New Roles and Transformed Libraries: Models and Implementation
Digital Scholarship Spaces: Building Communities & Enabling Collaboration
Preparing Research Librarians for Transformed Libraries: Creating a Community...
Libraries Leading the Way on the 'Textbook Problem'
TRLN Beyond Print: Consortial E-Book Acquisitions: Librarian/Publisher/Vendor...
TRLN Beyond Print: Consortial E-Book Acquisitions: Librarian/Publisher/Vendor...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
Beyond Print Summit: TRLN History, Context, and Motivations
UNC Collaborative Book Purchasing Plan
Open Textbook Models: View from the Library

Recently uploaded (20)

PDF
The TKT Course. Modules 1, 2, 3.for self study
PPTX
Macbeth play - analysis .pptx english lit
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PPTX
PLASMA AND ITS CONSTITUENTS 123.pptx
PDF
fundamentals-of-heat-and-mass-transfer-6th-edition_incropera.pdf
PDF
PUBH1000 - Module 6: Global Health Tute Slides
PDF
LIFE & LIVING TRILOGY - PART (3) REALITY & MYSTERY.pdf
PPTX
BSCE 2 NIGHT (CHAPTER 2) just cases.pptx
DOCX
Cambridge-Practice-Tests-for-IELTS-12.docx
PPTX
Integrated Management of Neonatal and Childhood Illnesses (IMNCI) – Unit IV |...
PDF
Horaris_Grups_25-26_Definitiu_15_07_25.pdf
PDF
Everyday Spelling and Grammar by Kathi Wyldeck
PDF
0520_Scheme_of_Work_(for_examination_from_2021).pdf
PDF
Farming Based Livelihood Systems English Notes
PPT
REGULATION OF RESPIRATION lecture note 200L [Autosaved]-1-1.ppt
PDF
Hospital Case Study .architecture design
PDF
faiz-khans about Radiotherapy Physics-02.pdf
PDF
Lecture on Viruses: Structure, Classification, Replication, Effects on Cells,...
PDF
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
PDF
Disorder of Endocrine system (1).pdfyyhyyyy
The TKT Course. Modules 1, 2, 3.for self study
Macbeth play - analysis .pptx english lit
Environmental Education MCQ BD2EE - Share Source.pdf
PLASMA AND ITS CONSTITUENTS 123.pptx
fundamentals-of-heat-and-mass-transfer-6th-edition_incropera.pdf
PUBH1000 - Module 6: Global Health Tute Slides
LIFE & LIVING TRILOGY - PART (3) REALITY & MYSTERY.pdf
BSCE 2 NIGHT (CHAPTER 2) just cases.pptx
Cambridge-Practice-Tests-for-IELTS-12.docx
Integrated Management of Neonatal and Childhood Illnesses (IMNCI) – Unit IV |...
Horaris_Grups_25-26_Definitiu_15_07_25.pdf
Everyday Spelling and Grammar by Kathi Wyldeck
0520_Scheme_of_Work_(for_examination_from_2021).pdf
Farming Based Livelihood Systems English Notes
REGULATION OF RESPIRATION lecture note 200L [Autosaved]-1-1.ppt
Hospital Case Study .architecture design
faiz-khans about Radiotherapy Physics-02.pdf
Lecture on Viruses: Structure, Classification, Replication, Effects on Cells,...
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
Disorder of Endocrine system (1).pdfyyhyyyy

Clay Shirky, Fantasy Football, and Using Data to Glean the Future of Library Collections - Radically Different Future of Collection Development

  • 1. Clay Shirky, Fantasy Football, and Using Data to Glean the Future of Library Collections Greg Raschke and John Vickery, North Carolina State University Charleston Conference November 3, 2010
  • 2. Assumptions  Economics are not sustainable  Collections budgets will not grow at rate of past 30 years  Unit growth and growth in cost per unit are not sustainable  Need to lower costs of overall system  Lower unit costs  Use data and users to be more precise  Therefore collection practices and strategies must change  This change will be hard – much reason for optimism
  • 3. Supply-Side Collections  Print-based, unpredictable demand, and legitimate need for just in case collections  Lead to judging quality by size (as in the ARL rankings) and libraries were then held captive to this standard  Contributed to inelastic demand for journals and a combination of speculative and package buying  Use is secondary to size, dollars expended, and other input measures  Credit to David Lewis (http://ulib.iupui.edu/users/dlewis)
  • 5. Demand-Driven Collections  Make information easily, widely, and cheaply available  Collections as drivers of research, teaching, and learning  To make special or unique collections held/managed by the library available to the user community and the world
  • 6. Demand-Driven – Changing Practice  Tension between time-honored role as custodians of scholarship versus enabling digital environment for scholars  Not just PDA – portfolio of approaches, but certainly more responsive  Utilize new tools and techniques to become advanced analysts  Truly embrace evidence based decision making  Look at how collections are actually used, not at expressed need
  • 7. Demand-Driven – More Assumptions  Less tolerance for and less investment in lower use general collections  Resource management based increasingly on use  Modify collecting based on changes in the actual use  Risks of doing nothing – newspapers
  • 8. Demand-Driven – Assertions  Rewards of adapting – more used and vital than ever  Use based and user driven collecting models will take growing share of budget  Bet on numbers  Bet on good and quick  Put resources into enabling digital environment for scholars and custodian role will come out of that strategy
  • 9. Why So Much Data?  Data analysis is a key component in solving/managing:  Increasing pressure for accountability  Increasing capability to gather and analyze data  Increasing precision in the way we build collections and expend resources  Advocacy  Changing practice and data analysis at NCSU
  • 11. Serials Review 2009 – Open, Data-Driven, and Real-Time Analysis  Standardized usage data (where available)  Bibliometrics - publication data and citation patterns (e.g LJUR)  Impact factor and eigenfactor  User community feedback via interactive, database-driven applications  Weigh/calculate/quantify user feedback  Weigh price against multiple data points  Usage ((07 usage+08 usage/2)+ (publications*10)+ (citations*5)+ (Impact Factor)  Community Feedback ((Weighted Ranking x % Match) x Total # Rankings) + 0.1 x # of "1s“  Price/feedback value  Price/use  Merge results to filter out top 20% and bottom 20%
  • 12. Looking closer – Finding balance An example - a closer look at print item usage  Traditional ILS reporting tools can make this difficult  Advanced analytical tools can help  What types of questions can we ask?  Should Patron-Driven records not purchased be purged after 2 years?  How does print item usage break down?  Do print items even get used?
  • 13. If it’s not used after 2 years… Should PDA records be purged? Maybe… We haven’t even hit 50% usage But what if we take a longer view…
  • 14. If it’s not used after 2 years…  Things begin to look different
  • 15. Looking even closer…  How does print item use break down?  Single circ usage is consistently ~14%  Would this change in a PDA only world?
  • 20. Measurable Uses of the Collection 2009/2010 Full-text journal downloads* 3,672,600 Database use 1,989,972 Print book circulations/renewals 525,430 Digital collections requests 471,403 E-books 149,815 Reserves** 327,267 Total Uses 7,136,487 * Includes use of NC LIVE full-text content ** Includes textbook, print, and e-reserves usage Measurable Uses of the Collection 2009/2010
  • 21. Challenges  Have ability to be more precise, more used, and more relevant than ever – need to make the necessary changes  Apps are a risk – silo(ing) networked, web environment – connections where libraries can excel  Not enough data - still lack much of the comprehensive data we need – must improve quickly  Data can punish niche areas, disciplinary variation, and titles without data  Open resources impact ability to control and command data

Editor's Notes

  • #3: * Reference David Lewis
  • #5: Many reasons for this: Technology and increasing amount of content on open networks Changes in publishing Supply-chain capabilities and print-on-demand Increased accountability One reason trumps all others - economics
  • #8: “That is what real revolutions are like. The old stuff gets broken faster than the new stuff is put in its place. The importance of any given experiment isn’t apparent at the moment it appears; big changes stall, small changes spread. Even the revolutionaries can’t predict what will happen. Agreements on all sides that core institutions must be protected are rendered meaningless by the very people doing the agreeing. (Luther and the Church both insisted, for years, that whatever else happened, no one was talking about a schism.) Ancient social bargains, once disrupted, can neither be mended nor quickly replaced, since any such bargain takes decades to solidify.” – Clay Shirky “One of the difficult aspects of change, particularly when it is accompanied by complex technology and multiplying data sources, is the ability to give up an old story and develop a new one. The ‘story’ is a common sense version that unfolds.” – Jennifer James “I don’t know. Nobody knows. We’re collectively living through 1500, when it’s easier to see what’s broken than what will replace it. The internet turns 40 this fall. Access by the general public is less than half that age. Web use, as a normal part of life for a majority of the developed world, is less than half that age. We just got here. Even the revolutionaries can’t predict what will happen.” – Clay Shirky
  • #9: Spending this year’s money based on last year’s statistics, gut instinct, and what other people are saying. Trends are likely to hold. Price and demand instability. Waiver wire – aggregated packages. Spend money on people because that is what you have always done. Auction process changing everything – differential pricing. Key is management after use and results. Package challenges.
  • #12: 13,000+ points of data from 700 users – how do you at least run an initial filter through that data? Relationships between usage data and community feedback data. Way more open and data-driven process than ever before where capturing data and feedback and analyzing it in real-time.
  • #22: “Web browser’s dominance is coming to a close. And the Internet’s founding ideology – that information wants to be free, and that attempts to constrain it are not only hopeless but immoral – suddenly seems naïve and stale in the new age of apps, smart phones, and pricing plans.”