Multi-agent Systems for Automating
Large Naturalistic Treatment Trials in
Routine Practice
Zina Ibrahim
Motivating Research
❏ By: Lorena Fernández de la Cruz, Argyris Stringaris, Robert Goodman and
others at the Department of Child and Adolescent Psychiatry, Institute of
Psychiatry, King’s College London.
❏ Aim: Conduct large naturalistic treatment trials on ADHD
❏ Test the effectiveness of ADHD treatments in routine clinical settings
❏ Establish the effectiveness of ADHD treatments for the subgroup of
children with mood dysregulation.
❏ Assessment Variable: Strength and Difficulties Questionnaire clinical
outcome measure (SDQ) scores in the de-identified electronic health
records.
The Strengths and Difficulties Questionnaire (SDQ)
❏ A brief child mental health questionnaire for children and
adolescents ages 2 through 17 years old, developed by Dr.
Robert Goodman.
❏ Measures 25 attributes, some positive and others negatives.
❏ The 25 attributes fall into the following 4 scales:
❏ Emotional Symptoms (5 items)
❏ Conduct problems (5 items)
❏ Hyperactivity/inattention (5 items)
❏ Peer relationship problems (5 items)
❏ Prosocial behaviour (5 items)
❏ The patient is given a score for each attribute. The total of all
the scores provides the SDQ score of the patient.
Outcome of Initial Research
❏ Excellent baseline SDQ
data available
❏ Baseline SDQ scores
predictive of diagnosis
outcome
Number of EPJS Records for ADHD Cases 8,434
Gender (% Female) 44%
Age: M (SD) 11.2 (3.8)
Records with SDQ 6, 912
Problem: No Treatment Outcome Measures
❏ Apart from the initial diagnosis SDQ, few patients have
repeated SDQ measures, collected at subsequent intervals,
to assess treatment outcomes.
Subsample of ADHD individuals
with at least 2 SDQ
N:157 Age: M(13) Gender: 82% F
Medication: 148 valid, 9 missing
Medication N %
Methylphenidate 137 87.3
Dextroamphetamine 1 0.6
Atomoxetine 29 18.5
Clonidine 9 5.7
Number of Meds N %
1 121 77.1
2 26 16.6
3 1 0.6
Solution: Automatic Collection of Outcome Measures
❏ Aims:
❏ Improve the quality of treatment outcome measure (SDQ)
collection in EPJS (and subsequently CRIS).
❏ Engage with patients through online web resources.
❏ Objectives:
❏ Automate clinical trial feedback without clinicians’ intervention.
❏ Provide patients with detailed analyses based on their SDQ
scores. The analyses provide books, helpful hints and link to
help them better understand their situations.
❏ Description: build an automated computer system which:
❏ Regularly queries EPJS for newly-created first (baseline) SDQ entries
❏ Creates virtual agents (autonomous software components) for every
SDQ entry found. Every agent will:
❏ Generate a personalised guidance report using youthinmind.info based on
the SDQ entries
❏ Make the following available on an online web resource:
❏ The personalised guidance report
❏ Forms for filling new SDQ entries
Solution: Automatic Collection of Outcome Measures
❏ Create a monthly follow-up schedule for the case. Every month the
virtual agent will:
❏ Monitor adherence to the follow-up schedule by regularly sending
reminders to participants to complete the web form until one is filled
❏ Once filled, the agent sends the new SDQ entries for the case from
the web resource to EPJS
❏ Generate a new personalised guidance report based on the new
entries (from youthinmind.info)
Solution: Automatic Collection of Outcome Measures
Zina Ibrahim - Big Data in Mental Health - 23rd July 2014
❏ A Software Agent: is a computer program which:
❏ Acts autonomously on behalf of its user
❏ Acts proactively to achieve a predefined goal
❏ Reacts to input from the changing environment
❏ Is social, i.e. it communicates with other agents
❏ A Multi-agent system: computer system made of a number
of software agents jointly interacting to achieve the design
requirements of the overall system.
Multi-Agent Systems
Multi-Agent Systems for Generating
Treatment Trials
Overall System Architecture
A Month after last SDQ
is entered
Weekly reminders until
user signs up and fills
the next SDQ form.
Repeat
for six SDQs
youthinmind.info
Implementation and Progress
❏ Implementation Details:
❏ JADE (Java-based Agent Development Environment) Java-based environment
which interacts with the user through Servlets and JSP pages.
❏ Prototype developed based on the EPJS Testing database
❏ Development Progress:
❏ Core functionalities 95% complete
❏ Currently working on:
❏ Parsing patient/informer e-mail addresses from free-text data
❏ Interacting with the users using text messaging for reminders and alerts.
❏ Designing a (good looking) web interface.
❏ Post-development Phase
❏ Acquisition of permissions for deployment over EPJS.
Acknowledgments
http://core.brc.iop.kcl.ac.uk
Dr Richard J Dobson (BRC)
Dr Lorena Fernandez de la Cruz
(IoP)
Dr Argyris Stringaris(IoP)
Prof. Robert Goodman (IoP)
Prof. Emily Siminoff (IoP)
Prof. Andrew Pickles (IoP)
Dr Matthew Broadbent (BRC)
Dr Caroline Johnston (BRC)
Dr Amos Folarin (BRC)
John Turp (SLAM)

More Related Content

PPTX
Chris Hollis - Big Data in Mental Health - 23rd July 2014 - 2
PPTX
Chris Hollis - Big Data in Mental Health - 23rd July 2014 - 1
PPTX
Taking cognitive/ emotional assessments and therapies to scale
PPTX
Harness digital platforms to accelerate R&D and drive proper adoption
PPTX
Future Solutions from Qualitative Big Data
PPTX
Update by Marcel Legrand, Chief Revenue Officer of Total Brain
PDF
The Challenges of Creating Mobile Games for Regulated Health Situations
PPTX
How to address privacy, ethical and regulatory issues: Examples in cognitive ...
Chris Hollis - Big Data in Mental Health - 23rd July 2014 - 2
Chris Hollis - Big Data in Mental Health - 23rd July 2014 - 1
Taking cognitive/ emotional assessments and therapies to scale
Harness digital platforms to accelerate R&D and drive proper adoption
Future Solutions from Qualitative Big Data
Update by Marcel Legrand, Chief Revenue Officer of Total Brain
The Challenges of Creating Mobile Games for Regulated Health Situations
How to address privacy, ethical and regulatory issues: Examples in cognitive ...

What's hot (20)

PDF
Pervasive Neurotechnology: The Digital Revolution Meets the Human Brain
PPTX
How to intervene early: Examples in depression, epilepsy and smoking cessation
PPTX
Brain Health Meets Digital Health
PDF
Engaging with Clinicians by Creating Highly Adoptable Improvement: Relevance ...
PPTX
An Integrated Electronic Lifestyle and Mental Health Patient Self-Assessment ...
PPTX
Rethinking and Retooling Brain Health and Mental Health
PDF
David tyas - telehealth evaluation view from the frontline-021012
PPTX
Top Brainnovations to monitor and improve Brain Health
PPTX
Treatment Scores
PDF
Moving From Paper To Electronic Medication Reconciliation
PDF
Real-time monitoring and the data trap
PPTX
Aung 20 minresearch
PPT
Evaluating Change and Tracking Improvement
PPTX
Build­ing Up the Apollo Brain Data Exchange Por­tal
PDF
Expo Day: Baycrest, Lumosity, BrainBaseline & SharpBrains
PDF
Digital Mental Health: the Hurt, the Hype, the Hope + Brainnovations Session 1
PDF
Digital Medicine Acceleration: The Promise of Learning Health Systems
PPTX
Brain Health in the Per­va­sive Neu­rotech­nol­ogy Era
PPTX
Inno­v­a­tive part­ner­ships to improve life­long brain health and customer/ ...
PPTX
What’s next: The future of non-invasive neurotechnology
Pervasive Neurotechnology: The Digital Revolution Meets the Human Brain
How to intervene early: Examples in depression, epilepsy and smoking cessation
Brain Health Meets Digital Health
Engaging with Clinicians by Creating Highly Adoptable Improvement: Relevance ...
An Integrated Electronic Lifestyle and Mental Health Patient Self-Assessment ...
Rethinking and Retooling Brain Health and Mental Health
David tyas - telehealth evaluation view from the frontline-021012
Top Brainnovations to monitor and improve Brain Health
Treatment Scores
Moving From Paper To Electronic Medication Reconciliation
Real-time monitoring and the data trap
Aung 20 minresearch
Evaluating Change and Tracking Improvement
Build­ing Up the Apollo Brain Data Exchange Por­tal
Expo Day: Baycrest, Lumosity, BrainBaseline & SharpBrains
Digital Mental Health: the Hurt, the Hype, the Hope + Brainnovations Session 1
Digital Medicine Acceleration: The Promise of Learning Health Systems
Brain Health in the Per­va­sive Neu­rotech­nol­ogy Era
Inno­v­a­tive part­ner­ships to improve life­long brain health and customer/ ...
What’s next: The future of non-invasive neurotechnology
Ad

Viewers also liked (6)

PPTX
Michael Lynskey - Big Data in Mental Health - 23rd July 2014
PPT
Sean Maskey - Big Data in Mental Health - 23rd July 2014
PDF
Maxim Osipov - Big Data in Mental Health - 23rd July 2014
PPTX
Richard Jackson - Big Data in Mental Health - 23rd July 2014
PDF
Will Spooner - Big Data in Mental Health - 23rd July 2014
PPTX
Amos Folarin - Big Data in Mental Health - 23rd July 2014
Michael Lynskey - Big Data in Mental Health - 23rd July 2014
Sean Maskey - Big Data in Mental Health - 23rd July 2014
Maxim Osipov - Big Data in Mental Health - 23rd July 2014
Richard Jackson - Big Data in Mental Health - 23rd July 2014
Will Spooner - Big Data in Mental Health - 23rd July 2014
Amos Folarin - Big Data in Mental Health - 23rd July 2014
Ad

Similar to Zina Ibrahim - Big Data in Mental Health - 23rd July 2014 (20)

PPTX
Findings so far from outcomes data and looking to the future - Dr Miranda Wol...
PDF
This week will see the launch of Health Outcomes Insights (Formerly DHP Resea...
PDF
FINAL DOCUMENTATION
PDF
Building momentum: who’d have thought ROMS could create such a buzz? - Workshop
PPT
Ron's muri presentation
PDF
Computer games for user engagement in Attention Deficit Hyperactivity Disorde...
PDF
From SnappyApp to Screens in the Wild: Gamifying an Attention Hyperactivity D...
PDF
UX portfolio
PDF
Designing Complex Research: Using Experience Design To Plan And Organize Coll...
PPTX
Making decisions for complex, dynamic problems with imperfect knowledge: Th...
PPTX
UXPA2019 Comparing formative and summative approaches in the usability testin...
PPTX
Development of a Computer-Based Tailored Information Application to Improve H...
PDF
Job Redesign For Expanded HIM Functions Case Study...
PPTX
HCLT Case Study: Gamification in Chronic Disease (ADHD) Treatment
PPTX
Testing technology in the ‘real world’ of acute healthcare
PPTX
Team 1 PPT document of social relavent project
PPTX
Overview of the Occupational Therapy foundations
DOCX
Impact Of Computer Software Appplication On Medication Therapy Adherence
PDF
Implementation science and learning health systems: Pieces of a puzzle
PPTX
ACCA PM and OM.pptx
Findings so far from outcomes data and looking to the future - Dr Miranda Wol...
This week will see the launch of Health Outcomes Insights (Formerly DHP Resea...
FINAL DOCUMENTATION
Building momentum: who’d have thought ROMS could create such a buzz? - Workshop
Ron's muri presentation
Computer games for user engagement in Attention Deficit Hyperactivity Disorde...
From SnappyApp to Screens in the Wild: Gamifying an Attention Hyperactivity D...
UX portfolio
Designing Complex Research: Using Experience Design To Plan And Organize Coll...
Making decisions for complex, dynamic problems with imperfect knowledge: Th...
UXPA2019 Comparing formative and summative approaches in the usability testin...
Development of a Computer-Based Tailored Information Application to Improve H...
Job Redesign For Expanded HIM Functions Case Study...
HCLT Case Study: Gamification in Chronic Disease (ADHD) Treatment
Testing technology in the ‘real world’ of acute healthcare
Team 1 PPT document of social relavent project
Overview of the Occupational Therapy foundations
Impact Of Computer Software Appplication On Medication Therapy Adherence
Implementation science and learning health systems: Pieces of a puzzle
ACCA PM and OM.pptx

More from kclcompbio (6)

PPTX
Cheryl Gillet - The HTA and Biobanking
PPTX
Cerisse Gunasinghe - KCL Bioresource
PPTX
Ryan Little - Clinical Data Linkage Service
PPTX
Cris consent public
PPTX
Veronica Howe - Research Data Management
PPTX
Anne Cameron - An Introduction to the Data Protection Act for Researchers
Cheryl Gillet - The HTA and Biobanking
Cerisse Gunasinghe - KCL Bioresource
Ryan Little - Clinical Data Linkage Service
Cris consent public
Veronica Howe - Research Data Management
Anne Cameron - An Introduction to the Data Protection Act for Researchers

Recently uploaded (20)

PPTX
Approch to weakness &paralysis pateint.pptx
PPTX
Genetics and health: study of genes and their roles in inheritance
PPTX
Communicating with the FDA During an Inspection -August 26, 2025 - GMP.pptx
PDF
Nematodes - by Sanjan PV 20-52.pdf based on all aspects
PDF
heliotherapy- types and advantages procedure
PDF
Gonadotropin-releasing hormone agonist versus HCG for oocyte triggering in an...
PPTX
Indications for Surgical Delivery...pptx
PPT
ANTI-HYPERTENSIVE PHARMACOLOGY Department.ppt
PPTX
GAIT IN HUMAN AMD PATHOLOGICAL GAIT ...............
PPTX
Bacteriology and purification of water supply
PPTX
SUMMARY OF EAR, NOSE AND THROAT DISORDERS INCLUDING DEFINITION, CAUSES, CLINI...
PDF
NCCN CANCER TESTICULAR 2024 ...............................
PDF
Diabetes mellitus - AMBOSS.pdf
DOCX
ORGAN SYSTEM DISORDERS Zoology Class Ass
PDF
neonatology-for-nurses.pdfggghjjkkkkkkjhhg
PPSX
Man & Medicine power point presentation for the first year MBBS students
PPTX
المحاضرة الثالثة Urosurgery (Inflammation).pptx
PPTX
LIVER DIORDERS OF PREGNANCY in detail PPT.pptx
PPTX
ENT-DISORDERS ( ent for nursing ). (1).p
PDF
Integrating Traditional Medicine with Modern Engineering Solutions (www.kiu....
Approch to weakness &paralysis pateint.pptx
Genetics and health: study of genes and their roles in inheritance
Communicating with the FDA During an Inspection -August 26, 2025 - GMP.pptx
Nematodes - by Sanjan PV 20-52.pdf based on all aspects
heliotherapy- types and advantages procedure
Gonadotropin-releasing hormone agonist versus HCG for oocyte triggering in an...
Indications for Surgical Delivery...pptx
ANTI-HYPERTENSIVE PHARMACOLOGY Department.ppt
GAIT IN HUMAN AMD PATHOLOGICAL GAIT ...............
Bacteriology and purification of water supply
SUMMARY OF EAR, NOSE AND THROAT DISORDERS INCLUDING DEFINITION, CAUSES, CLINI...
NCCN CANCER TESTICULAR 2024 ...............................
Diabetes mellitus - AMBOSS.pdf
ORGAN SYSTEM DISORDERS Zoology Class Ass
neonatology-for-nurses.pdfggghjjkkkkkkjhhg
Man & Medicine power point presentation for the first year MBBS students
المحاضرة الثالثة Urosurgery (Inflammation).pptx
LIVER DIORDERS OF PREGNANCY in detail PPT.pptx
ENT-DISORDERS ( ent for nursing ). (1).p
Integrating Traditional Medicine with Modern Engineering Solutions (www.kiu....

Zina Ibrahim - Big Data in Mental Health - 23rd July 2014

  • 1. Multi-agent Systems for Automating Large Naturalistic Treatment Trials in Routine Practice Zina Ibrahim
  • 2. Motivating Research ❏ By: Lorena Fernández de la Cruz, Argyris Stringaris, Robert Goodman and others at the Department of Child and Adolescent Psychiatry, Institute of Psychiatry, King’s College London. ❏ Aim: Conduct large naturalistic treatment trials on ADHD ❏ Test the effectiveness of ADHD treatments in routine clinical settings ❏ Establish the effectiveness of ADHD treatments for the subgroup of children with mood dysregulation. ❏ Assessment Variable: Strength and Difficulties Questionnaire clinical outcome measure (SDQ) scores in the de-identified electronic health records.
  • 3. The Strengths and Difficulties Questionnaire (SDQ) ❏ A brief child mental health questionnaire for children and adolescents ages 2 through 17 years old, developed by Dr. Robert Goodman. ❏ Measures 25 attributes, some positive and others negatives. ❏ The 25 attributes fall into the following 4 scales: ❏ Emotional Symptoms (5 items) ❏ Conduct problems (5 items) ❏ Hyperactivity/inattention (5 items) ❏ Peer relationship problems (5 items) ❏ Prosocial behaviour (5 items) ❏ The patient is given a score for each attribute. The total of all the scores provides the SDQ score of the patient.
  • 4. Outcome of Initial Research ❏ Excellent baseline SDQ data available ❏ Baseline SDQ scores predictive of diagnosis outcome Number of EPJS Records for ADHD Cases 8,434 Gender (% Female) 44% Age: M (SD) 11.2 (3.8) Records with SDQ 6, 912
  • 5. Problem: No Treatment Outcome Measures ❏ Apart from the initial diagnosis SDQ, few patients have repeated SDQ measures, collected at subsequent intervals, to assess treatment outcomes. Subsample of ADHD individuals with at least 2 SDQ N:157 Age: M(13) Gender: 82% F Medication: 148 valid, 9 missing Medication N % Methylphenidate 137 87.3 Dextroamphetamine 1 0.6 Atomoxetine 29 18.5 Clonidine 9 5.7 Number of Meds N % 1 121 77.1 2 26 16.6 3 1 0.6
  • 6. Solution: Automatic Collection of Outcome Measures ❏ Aims: ❏ Improve the quality of treatment outcome measure (SDQ) collection in EPJS (and subsequently CRIS). ❏ Engage with patients through online web resources. ❏ Objectives: ❏ Automate clinical trial feedback without clinicians’ intervention. ❏ Provide patients with detailed analyses based on their SDQ scores. The analyses provide books, helpful hints and link to help them better understand their situations.
  • 7. ❏ Description: build an automated computer system which: ❏ Regularly queries EPJS for newly-created first (baseline) SDQ entries ❏ Creates virtual agents (autonomous software components) for every SDQ entry found. Every agent will: ❏ Generate a personalised guidance report using youthinmind.info based on the SDQ entries ❏ Make the following available on an online web resource: ❏ The personalised guidance report ❏ Forms for filling new SDQ entries Solution: Automatic Collection of Outcome Measures
  • 8. ❏ Create a monthly follow-up schedule for the case. Every month the virtual agent will: ❏ Monitor adherence to the follow-up schedule by regularly sending reminders to participants to complete the web form until one is filled ❏ Once filled, the agent sends the new SDQ entries for the case from the web resource to EPJS ❏ Generate a new personalised guidance report based on the new entries (from youthinmind.info) Solution: Automatic Collection of Outcome Measures
  • 10. ❏ A Software Agent: is a computer program which: ❏ Acts autonomously on behalf of its user ❏ Acts proactively to achieve a predefined goal ❏ Reacts to input from the changing environment ❏ Is social, i.e. it communicates with other agents ❏ A Multi-agent system: computer system made of a number of software agents jointly interacting to achieve the design requirements of the overall system. Multi-Agent Systems
  • 11. Multi-Agent Systems for Generating Treatment Trials
  • 13. A Month after last SDQ is entered Weekly reminders until user signs up and fills the next SDQ form. Repeat for six SDQs
  • 15. Implementation and Progress ❏ Implementation Details: ❏ JADE (Java-based Agent Development Environment) Java-based environment which interacts with the user through Servlets and JSP pages. ❏ Prototype developed based on the EPJS Testing database ❏ Development Progress: ❏ Core functionalities 95% complete ❏ Currently working on: ❏ Parsing patient/informer e-mail addresses from free-text data ❏ Interacting with the users using text messaging for reminders and alerts. ❏ Designing a (good looking) web interface. ❏ Post-development Phase ❏ Acquisition of permissions for deployment over EPJS.
  • 16. Acknowledgments http://core.brc.iop.kcl.ac.uk Dr Richard J Dobson (BRC) Dr Lorena Fernandez de la Cruz (IoP) Dr Argyris Stringaris(IoP) Prof. Robert Goodman (IoP) Prof. Emily Siminoff (IoP) Prof. Andrew Pickles (IoP) Dr Matthew Broadbent (BRC) Dr Caroline Johnston (BRC) Dr Amos Folarin (BRC) John Turp (SLAM)