Data validation services
- 1. Data Validation Services Delivering quality and complete data sets
- 2. Introduction • A complete and accurate data set is essential if the conclusions drawn following the data collection exercise are to remain valid and legitimate; • Building on 2and7 Limited’s range of data collection systems, we also offer complementary services to ensure the data collected is as complete and valid as possible; • Using a combination of Microsoft SQL Server, Microsoft SharePoint Server and our own tricks of the trade, we can automate the creation of data queries by checking for a variety of common mistakes; • A variety of data quality metrics can be displayed and reported depending upon your individual requirements;
- 3. Missing Information • The first test is to ensure that the individuals/company collecting the data have filled in the information required and the time points required; • You provide us with a schedule which shows which data should be captured and when; • We convert this into a series of rules which can be scheduled to run in real time, overnight or in regular batches; • The results of these rules can then be produced as standalone reports or integrated into the data collection database to be tracked; • The queries are sufficiently sophisticated to also include instances where data were correct, but were subsequently amended or removed;
- 4. Beyond Tolerance • The data set is complete, but is it accurate? • Queries can also be written which compare specific data elements against agreed benchmarks and can subsequently highlight any data which are beyond the normal range; • As well as a quality tool, this feature can also be useful for analysis by potentially identifying areas of interest or concern – especially where the data are related to patient care, etc; • Tolerance levels can be set individually or for a group of queries;
- 5. Contextual Queries • These are the final set of queries to be identified which check to ensure that linked fields are completed; • These queries are the most complex and flexible, with their use ranging from checking that all test results must have an associated test date through to allowing for variation in data fields based upon the user or subject;
- 6. Query Reporting • There a variety of ways in which data queries can be reported ranging from static PDFs, through to dynamic Microsoft Excel workbooks and Microsoft SharePoint lists; • The information to be reported can vary according to the individual study, but more typically captures the following: • Information to enable the customer to find the individual visit/episode; • A description of the rule that has been violated; • Where appropriate, the relevant form section or page; • Depending upon the data collection system chosen, the queries can then be displayed via a web interface to allow them to be addressed and updated;
- 7. Query Resolution Process • Once the data queries have been raised, you need a way of flagging when they have been addressed; • There are two main ways in which queries can be closed within the system: • Automatically – a missing value is completed and the system closes the query automatically; • Manually – using a web interface, the query can be updated with comments explaining the absence of those data; • Both methods record the date/time when the query was closed, the identity of the person closing the query and (where appropriate) who authorised the closure of that query;
- 8. Closing Comments • The system outlined here is optimised to use Microsoft SharePoint 2010, Microsoft SQL Server and Microsoft Office, making use of any existing licences you may already have; • The system is available as a public cloud, private cloud, co- located or fully managed system depending upon individual requirements; • The system described is currently used in a variety of studies within the University of Leeds and Leeds Teaching Hospitals NHS Trust;
- 9. Contact Details For more information, please contact us via either of the following methods: Web site: http://2and7.co.uk By post: 2and7 Limited, Suite 13, Prospect House, Colliery Close, Staveley, Chesterfield, Derbyshire S43 3QE Ged Connolly-Thompson Managing Director, 2and7 Limited Mobile: 07946 359060