Research waste
when designing
new research
Dr Mona Nasser DDS, MSc, PhD, FHEA
Associate Professor in Evidence based Dentistry
Peninsula Dental School
Faculty of Medicine and Dentistry
University of Plymouth
What do funders do to
increase value and
reduce waste in
research?
2014 2017
EVIR (Ensuring
Value In
Research)
collaboration
2117
BLACK MIRROR STAR TREK
BLACK MIRROR
• Everyone can submit research
questions to panel
• There are established centres with
AI and humans analysing these
questions
• There are transparent processes to
prioritise
• All research are conducted meeting
certain quality standards and full
reported and available
• All research is embedded in a
systematic synthesis of previous
research and their results
automatically added to it
• More and More Billionaires and
Millionaires start supporting
research and controlling what
scientific topics gets forward
• They make public agencies
become irrelevant and less
influential
• The research agenda, quality of
research and what is disseminate
is decided by those who have the
most money
STAR TREK
• Effect to bias ratio
• Choice of question
Nasser M, Pandis N, Fleming PS, Fedorowicz Z, Ellis E, Ali K. Interventions for the management of mandibular fractures. Cochrane Database
Syst Rev. 2013 Jul 8;(7):CD006087.
Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, Schulz KF, Tibshirani R. Increasing value and reducing waste in
research design, conduct, and analysis. Lancet. 2014 Jan 11;383(9912):166-75.
• Observational studies >> RCTs (3.3-4.5
times)
• Studies with surrogate endpoints >>
clinical endpoints (1.6-3 times)
Bolland MJ, Avenell A, Grey A. Assessment of research waste part 1: an exemplar from examining study
design, surrogate and clinical endpoints in studies of calcium intake and vitamin D supplementation. BMC
Med Res Methodol. 2018 Oct 10;18(1):103.
Cochrane review with meta-analysis (Apr
2012-Mar 2013)
• 556/1286 (43%) trials (205 meta-
analyses) ->> at least one domain of high
risk of bias.
• Adjustment possible in 142 of them and
easy adjustment with no or minor cost in
71 of them (50%)
Yordanov Y, Dechartres A, Atal I, Tran VT, Boutron I, Crequit P, Ravaud P. Avoidable waste of research related to outcome
planning and reporting in clinical trials. BMC Med. 2018 Jun 11;16(1):87 .
Mona Nasser: Research waste when designing new research (role of funders)
Mona Nasser: Research waste when designing new research (role of funders)
Funding agency Country
National Institute for Health Research (NIHR) UK/England
Medical Research Council (MRC) UK
French Ministry of Health (FMoH) France
l’Agence Nationale de la Recherche (ANR) France
Deutsche ForschungsgemeinschaftDeutsche (DFG) Germany
The Netherlands Organisation for Health Research and
Development (ZonMw)
Netherlands
Danske Regioner (DR ) Denmark
Regional Health Authorities (RHA ) Norway
National Health and Medical Research Council (NHMRC) Australia
Canadian Institutes of Health Research (CIHR) Canada
National Institutes of Health (NIH) USA
Patient Centred Outcomes Research Group (PCORI) USA
Nasser M, Clarke M, Chalmers I, Brurberg KG, Nykvist H, Lund H, Glasziou P. What are funders doing to minimise waste
in research? Lancet. 2017 Mar 11;389(10073):1006-1007. doi: 10.1016/S0140-6736(17)30657-8.
Nasser M, Clarke M, Chalmers I, Brurberg KG, Nykvist H, Lund H, Glasziou P. How can research funders add value to
research as part of a special session on responsible research conduct for funding agencies. Work Research integrity
conference, Amsterdam, Netherlands. 28-31 May 2017
Funder Definition of systematic reviews
NIHR “New primary research will only be funded if it is based on a
review of existing evidence that is credible to your peers and is
completed according to a predetermined methodology….
maximises completeness in a way proportionate to the risk of an
inappropriate funding decision, ….critically appraises for quality
and relevance, synthesises […..without introduce new bias]
PCORI PCORI defines systematic reviews ..The PCORI Methodology Committee
endorses the standards issued by the National Academy of Medicine
(NAM), formerly the Institute of Medicine. This committee recognizes the
importance of conducting systematic reviews consistent with updates to
methodological best practices. But it also acknowledges that flexibility in
the application of some standards may not compromise the validity of the
review.
CIHR The policy on clinical trials say - “ The researcher has a
responsibility to present the proposed research in the context of a
systematic review of the literature on that topic. Clinical trials
should not be conducted unnecessarily on questions that have
already been definitively answered.” We did not find any
additional information.
Funded project Which part of
the proposal
used a
systematic
review
How is was used
A multicentre prospective
randomised open-label blinded
end-point controlled trial of cardiac
troponin I-guided combination
angiotensin receptor blockade and
beta blocker therapy to prevent
cardiac toxicity in anthracycline
treated breast cancer patients
They cite NICE
guideline and a meta-
analysis
To choose the intervention
and comparison
Randomised double-blind
controlled efficacy and mechanism
study of sub-sensory sacral
neuromodulation in adults with
faecal incontinence
They cite three
systematic reviews
and a third self-
conducted one
Demonstrating previous
studies were observational
or RCTS with quality issues
IASO: A phase II randomised
placebo controlled double blind trial
of Interleukin 1 blockade in Acute
Severe Colitis
They cite one
systematic review
They use the review to
design their study (choice of
outcome measures)
Mona Nasser: Research waste when designing new research (role of funders)
Innovative
idea
Innovator
Contextual
challenges
And Impact on
Society
Gummerum, M., & Denham, S. L.
(2014). Cognitive Innovation: From Cell
to Society, 10.
https://doi.org/10.5964/ejop.v10i4.879
Nasser M 2017 'How Do Selected National Funding
Agencies Communicate the Concept of Cognitive Innovation
on Their Public Website?' AVANT. Trends in Interdisciplinary
Studies Publisher Site , DOI
Mona Nasser: Research waste when designing new research (role of funders)
BLACK MIRROR
• Everyone can submit research
questions to panel
• There are established centres with
AI and humans analysing these
questions
• There are transparent processes to
prioritise
• All research are conducted meeting
certain quality standards and full
reported and available
• All research is embedded in a
systematic synthesis of previous
research and their results
automatically added to it
• More and More Billionaires and
Millionaires start supporting
research and controlling what
scientific topics gets forward
• They make public agencies
become irrelevant and less
influential
• The research agenda, quality of
research and what is disseminate
is decided by those who have the
most money
STAR TREK
Thank you
mona.nasser@Plymouth.ac.uk @monalisa1n

More Related Content

PPTX
Hans Lund: Background and Introduction to the COST Action EVBRES
PPTX
Introduction to EVBRES
PPTX
Introduction to EVBRES
PPTX
EBR external presentation
PPTX
Klara Brunnhuber: Research Waste when Justifying New Research
PPTX
Introduction to evidence based research
PDF
How to choose publishable research topic
Hans Lund: Background and Introduction to the COST Action EVBRES
Introduction to EVBRES
Introduction to EVBRES
EBR external presentation
Klara Brunnhuber: Research Waste when Justifying New Research
Introduction to evidence based research
How to choose publishable research topic

What's hot (20)

PDF
Introduction to Systematic Review & Meta-Analysis
PPT
The Knowledge Egg Stanford
PPTX
General steps of biomedical research
PDF
HEALTHCARE RESEARCH METHODS: Secondary and tertiary Studies
PDF
Ebdm n concept of critical appraisal
PDF
HEALTHCARE RESEARCH METHODS: the Research Question, the team and the study ap...
PPT
Research Presentation
PDF
HEALTHCARE RESEARCH METHODS: Designing the Study and Collecting Data
PPTX
Critical appraisal
PDF
The Process of Health Research and literature reviews
PDF
HEALTHCARE RESEARCH METHODS: Primary Studies: Developing a Questionnaire - Su...
PDF
Research unit 1
PPTX
Characteristics of a satisfactory case study
PDF
Clinical research methodology introduction
PPTX
Case study approach as a pedagogy in management
PDF
Clinical research methodology preparations
PDF
INTRODUCTION TO HEALTHCARE RESEARCH METHODS: Correlational Studies, Case Seri...
PPT
Systematic review
PDF
Guidelines scientific papers
Introduction to Systematic Review & Meta-Analysis
The Knowledge Egg Stanford
General steps of biomedical research
HEALTHCARE RESEARCH METHODS: Secondary and tertiary Studies
Ebdm n concept of critical appraisal
HEALTHCARE RESEARCH METHODS: the Research Question, the team and the study ap...
Research Presentation
HEALTHCARE RESEARCH METHODS: Designing the Study and Collecting Data
Critical appraisal
The Process of Health Research and literature reviews
HEALTHCARE RESEARCH METHODS: Primary Studies: Developing a Questionnaire - Su...
Research unit 1
Characteristics of a satisfactory case study
Clinical research methodology introduction
Case study approach as a pedagogy in management
Clinical research methodology preparations
INTRODUCTION TO HEALTHCARE RESEARCH METHODS: Correlational Studies, Case Seri...
Systematic review
Guidelines scientific papers
Ad

Similar to Mona Nasser: Research waste when designing new research (role of funders) (20)

PPTX
Evidence based periodontology
PPTX
Evidence based periodontology
PPTX
NIHR Research Design Service
PPT
Introduction to the Cochrane Collaboration in Middle East (WONCA)
PDF
Introa-Morton-slides.pdf
PDF
Systematic reviews of
PPTX
Kalpana ebd
PPTX
Making Sense of Mixed Methods Design in Health Research
PDF
'Demystifying Knowledge Transfer- an introduction to Implementation Science M...
PPTX
A Health Economics Perspective on NICE and Stratified Medicine Towse Jan 2014
PPTX
Comparative Effectiveness Research
PPTX
EVIDENCE BASED DECISION MAKING IN DENTISTRY
PPTX
evidence based periodontology
PDF
Observational Studies in a Learning Health System
PPT
EVIDENCE BASED.ppt
PPT
(clinical trial overview)
DOCX
evidence based periodontics
PDF
Five steps to conducting a systematic review
PPT
Volmink Dfidsept2009jvfinal
PPT
Knowledge transfer, and evidence informed health policy-minster's meeting
Evidence based periodontology
Evidence based periodontology
NIHR Research Design Service
Introduction to the Cochrane Collaboration in Middle East (WONCA)
Introa-Morton-slides.pdf
Systematic reviews of
Kalpana ebd
Making Sense of Mixed Methods Design in Health Research
'Demystifying Knowledge Transfer- an introduction to Implementation Science M...
A Health Economics Perspective on NICE and Stratified Medicine Towse Jan 2014
Comparative Effectiveness Research
EVIDENCE BASED DECISION MAKING IN DENTISTRY
evidence based periodontology
Observational Studies in a Learning Health System
EVIDENCE BASED.ppt
(clinical trial overview)
evidence based periodontics
Five steps to conducting a systematic review
Volmink Dfidsept2009jvfinal
Knowledge transfer, and evidence informed health policy-minster's meeting
Ad

Recently uploaded (20)

PPSX
Man & Medicine power point presentation for the first year MBBS students
PPTX
Connective tissue disorder C1 lecture (1).pptx
PPTX
Communicating with the FDA During an Inspection -August 26, 2025 - GMP.pptx
PDF
HQ_Solutions_Resource_for_the_Healthcare_Quality_Professional_Fourth (1).pdf
PPTX
Diseases of the voice box (pharynx).pptx
PPTX
Geriatrics_(0).pptxxvvbbbbbbbnnnnnnnnnnk
PPT
BONE-TYPES,CLASSIFICATION,HISTOLOGY,FRACTURE,
PPTX
INFLAMMATORY BOWEL DISEASE(U,CERATIVE COLITIS AND CHROHN'S DISEASE)
PPTX
A Detailed Physiology of Endocrine System.pptx
PPTX
Emergencies in Anaesthesia by Dr SAMI.pptx
PPTX
community health nursing- nutrition and nursing -2.pptx
PDF
Question paper PYQ.pdf for derma pgs students
PPT
Medical Emergencies in Maxillofacial_Surgery.ppt
PPT
First Aid Training for construction and other
PPTX
PHYSIOlogy Cardiovascula system for medical students.pptx
PDF
neonatology-for-nurses.pdfggghjjkkkkkkjhhg
PDF
Diabetes mellitus - AMBOSS.pdf
PDF
Cranial nerve palsies (I-XII) - AMBOSS.pdf
PDF
communicable diseases for healthcare - Part 1.pdf
PPT
ANTI-HYPERTENSIVE PHARMACOLOGY Department.ppt
Man & Medicine power point presentation for the first year MBBS students
Connective tissue disorder C1 lecture (1).pptx
Communicating with the FDA During an Inspection -August 26, 2025 - GMP.pptx
HQ_Solutions_Resource_for_the_Healthcare_Quality_Professional_Fourth (1).pdf
Diseases of the voice box (pharynx).pptx
Geriatrics_(0).pptxxvvbbbbbbbnnnnnnnnnnk
BONE-TYPES,CLASSIFICATION,HISTOLOGY,FRACTURE,
INFLAMMATORY BOWEL DISEASE(U,CERATIVE COLITIS AND CHROHN'S DISEASE)
A Detailed Physiology of Endocrine System.pptx
Emergencies in Anaesthesia by Dr SAMI.pptx
community health nursing- nutrition and nursing -2.pptx
Question paper PYQ.pdf for derma pgs students
Medical Emergencies in Maxillofacial_Surgery.ppt
First Aid Training for construction and other
PHYSIOlogy Cardiovascula system for medical students.pptx
neonatology-for-nurses.pdfggghjjkkkkkkjhhg
Diabetes mellitus - AMBOSS.pdf
Cranial nerve palsies (I-XII) - AMBOSS.pdf
communicable diseases for healthcare - Part 1.pdf
ANTI-HYPERTENSIVE PHARMACOLOGY Department.ppt

Mona Nasser: Research waste when designing new research (role of funders)

  • 1. Research waste when designing new research Dr Mona Nasser DDS, MSc, PhD, FHEA Associate Professor in Evidence based Dentistry Peninsula Dental School Faculty of Medicine and Dentistry University of Plymouth What do funders do to increase value and reduce waste in research?
  • 2. 2014 2017 EVIR (Ensuring Value In Research) collaboration 2117
  • 4. BLACK MIRROR • Everyone can submit research questions to panel • There are established centres with AI and humans analysing these questions • There are transparent processes to prioritise • All research are conducted meeting certain quality standards and full reported and available • All research is embedded in a systematic synthesis of previous research and their results automatically added to it • More and More Billionaires and Millionaires start supporting research and controlling what scientific topics gets forward • They make public agencies become irrelevant and less influential • The research agenda, quality of research and what is disseminate is decided by those who have the most money STAR TREK
  • 5. • Effect to bias ratio • Choice of question Nasser M, Pandis N, Fleming PS, Fedorowicz Z, Ellis E, Ali K. Interventions for the management of mandibular fractures. Cochrane Database Syst Rev. 2013 Jul 8;(7):CD006087. Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, Schulz KF, Tibshirani R. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014 Jan 11;383(9912):166-75.
  • 6. • Observational studies >> RCTs (3.3-4.5 times) • Studies with surrogate endpoints >> clinical endpoints (1.6-3 times) Bolland MJ, Avenell A, Grey A. Assessment of research waste part 1: an exemplar from examining study design, surrogate and clinical endpoints in studies of calcium intake and vitamin D supplementation. BMC Med Res Methodol. 2018 Oct 10;18(1):103.
  • 7. Cochrane review with meta-analysis (Apr 2012-Mar 2013) • 556/1286 (43%) trials (205 meta- analyses) ->> at least one domain of high risk of bias. • Adjustment possible in 142 of them and easy adjustment with no or minor cost in 71 of them (50%) Yordanov Y, Dechartres A, Atal I, Tran VT, Boutron I, Crequit P, Ravaud P. Avoidable waste of research related to outcome planning and reporting in clinical trials. BMC Med. 2018 Jun 11;16(1):87 .
  • 10. Funding agency Country National Institute for Health Research (NIHR) UK/England Medical Research Council (MRC) UK French Ministry of Health (FMoH) France l’Agence Nationale de la Recherche (ANR) France Deutsche ForschungsgemeinschaftDeutsche (DFG) Germany The Netherlands Organisation for Health Research and Development (ZonMw) Netherlands Danske Regioner (DR ) Denmark Regional Health Authorities (RHA ) Norway National Health and Medical Research Council (NHMRC) Australia Canadian Institutes of Health Research (CIHR) Canada National Institutes of Health (NIH) USA Patient Centred Outcomes Research Group (PCORI) USA
  • 11. Nasser M, Clarke M, Chalmers I, Brurberg KG, Nykvist H, Lund H, Glasziou P. What are funders doing to minimise waste in research? Lancet. 2017 Mar 11;389(10073):1006-1007. doi: 10.1016/S0140-6736(17)30657-8. Nasser M, Clarke M, Chalmers I, Brurberg KG, Nykvist H, Lund H, Glasziou P. How can research funders add value to research as part of a special session on responsible research conduct for funding agencies. Work Research integrity conference, Amsterdam, Netherlands. 28-31 May 2017
  • 12. Funder Definition of systematic reviews NIHR “New primary research will only be funded if it is based on a review of existing evidence that is credible to your peers and is completed according to a predetermined methodology…. maximises completeness in a way proportionate to the risk of an inappropriate funding decision, ….critically appraises for quality and relevance, synthesises […..without introduce new bias] PCORI PCORI defines systematic reviews ..The PCORI Methodology Committee endorses the standards issued by the National Academy of Medicine (NAM), formerly the Institute of Medicine. This committee recognizes the importance of conducting systematic reviews consistent with updates to methodological best practices. But it also acknowledges that flexibility in the application of some standards may not compromise the validity of the review. CIHR The policy on clinical trials say - “ The researcher has a responsibility to present the proposed research in the context of a systematic review of the literature on that topic. Clinical trials should not be conducted unnecessarily on questions that have already been definitively answered.” We did not find any additional information.
  • 13. Funded project Which part of the proposal used a systematic review How is was used A multicentre prospective randomised open-label blinded end-point controlled trial of cardiac troponin I-guided combination angiotensin receptor blockade and beta blocker therapy to prevent cardiac toxicity in anthracycline treated breast cancer patients They cite NICE guideline and a meta- analysis To choose the intervention and comparison Randomised double-blind controlled efficacy and mechanism study of sub-sensory sacral neuromodulation in adults with faecal incontinence They cite three systematic reviews and a third self- conducted one Demonstrating previous studies were observational or RCTS with quality issues IASO: A phase II randomised placebo controlled double blind trial of Interleukin 1 blockade in Acute Severe Colitis They cite one systematic review They use the review to design their study (choice of outcome measures)
  • 15. Innovative idea Innovator Contextual challenges And Impact on Society Gummerum, M., & Denham, S. L. (2014). Cognitive Innovation: From Cell to Society, 10. https://doi.org/10.5964/ejop.v10i4.879 Nasser M 2017 'How Do Selected National Funding Agencies Communicate the Concept of Cognitive Innovation on Their Public Website?' AVANT. Trends in Interdisciplinary Studies Publisher Site , DOI
  • 17. BLACK MIRROR • Everyone can submit research questions to panel • There are established centres with AI and humans analysing these questions • There are transparent processes to prioritise • All research are conducted meeting certain quality standards and full reported and available • All research is embedded in a systematic synthesis of previous research and their results automatically added to it • More and More Billionaires and Millionaires start supporting research and controlling what scientific topics gets forward • They make public agencies become irrelevant and less influential • The research agenda, quality of research and what is disseminate is decided by those who have the most money STAR TREK