IWMW 2004: Measuring the Impact of a CMS Implementation (A7)
Download as PPT, PDF0 likes262 views
The document discusses the implementation and impact of a Content Management System (CMS) at the University of Western Australia (UWA), highlighting changes from a decentralized web structure to a more centralized system. Post-CMS implementation, UWA experienced improved consistency, accessibility, and ROI in web development, although some decentralization remained. Overall, the CMS brought significant benefits, but challenges with management and site fragmentation persisted.
IWMW 2004: Measuring the Impact of a CMS Implementation (A7)
- 1. IWMW Birmingham July 2004 Measuring the Impact of a CMS Implementation Is the Web Guru dead? Grant Malcolm, The University of Western Australia
- 2. IWMW Birmingham July 2004 About UWA ● 16,000 students ● 3,500 staff ● research intensive ● “high tech, high touch” ● member of Australian Group of Eight ● a “sandstone university”
- 3. IWMW Birmingham July 2004 Web @ UWA - pre CMS ● responsibility highly devolved ● infrastructure highly decentralised ● no web guidelines ● no SOE ● significant duplication of content/effort ● poor ROI in web development ● Feb 2002 snapshot* courtesy of http://www.archive.org/
- 4. IWMW Birmingham July 2004 Implementation – the sum of its parts ● academic restructure ● faculty sub-branding ● web guidelines ● site management plans ● CMS
- 5. IWMW Birmingham July 2004 Web @ UWA - post CMS ● still no SOE ● still devolved responsibility for content ● infrastructure largely centralised ● content reused and repurposed ● limited guidelines supported by CMS ● better ROI in web development ● Two years later - Feb 2004 snapshot*
- 6. IWMW Birmingham July 2004 CMS Impact - High ● consistent "look" ● consistent navigation styles ● improved accessibility ● guideline & standards compliance ● easier to develop/maintain ● “a University website” ● shift focus of web development
- 7. IWMW Birmingham July 2004 Web @ UWA – pre CMS Decentralised ● layout ● branding ● design ● navigation ● structure ● accessibility ● standards ● content ● infrastructure Centralised
- 8. IWMW Birmingham July 2004 Web @ UWA – post CMS Shared ● design ● layout ● navigatio n ● accessibil ity Centralised ● branding ● standards ● infrastructure Decentralised ● structure ● content
- 9. IWMW Birmingham July 2004 CMS Impact - Moderate ● currency of content ● improved structure ● better information management ● better ROI ● fewer outlaws
- 10. IWMW Birmingham July 2004 Expectations for website (and CMS) ● consistent ● usable ● accurate ● alignment ● available ● compliant ● current ● affordable... suggestions?
- 11. IWMW Birmingham July 2004 Consistent ● portion of site in CMS (37k pages or ~10%)* ● lies, damned lies and Google page counts ● intranet and applications? ● organisational units in CMS (132 or 93%) ● content weighting? ● design, navigation and behaviour ● flexible templates – the balancing act*
- 12. IWMW Birmingham July 2004 Number of Pages in CMS Currently ~37,000 pages Se p 01 O ct 01 No v 01 De c 01 Ja n 02 Fe b 02 M ar 02 Ap r 02 M ay 02 Ju n 02 Jul 02 Au g 02 Se p 02 O ct 02 No v 02 De c 02 Ja n 03 Fe b 03 M ar 03 Ap r 03 M ay 03 Ju n 03 Jul 03 Au g 03 Se p 03 O ct 03 No v 03 De c 03 Ja n 04 Fe b 04 M ar 04 Ap r 04 M ay 04 Ju n 04 Jul 04 0 5000 10000 15000 20000 25000 30000 35000 40000
- 13. IWMW Birmingham July 2004 Usable ● navigation ● structure ● usability studies ● client surveys and feedback
- 14. IWMW Birmingham July 2004 Accurate ● sourcing from the source ● repurposing and re-using content – Static and/or unstructured e.g. pull or nest content, minimal document management* – Dynamic and/or structured e.g. contact, event or handbook details*
- 15. IWMW Birmingham July 2004 Alignment ● Supports policy and strategic initiatives ● Integrates with enterprise architecture – VLEs, LMSs and CMSs – Personnel and Financial Systems – Student information systems – Portals – Library Systems – SSO
- 16. IWMW Birmingham July 2004 Available ● Client expectations ● SLA's
- 17. IWMW Birmingham July 2004 CMS Reliability & Stability 2003 - 2004 2003 2004 Excellent Good Av erage Fair 0 2 4 6 8 10 12 Excellent Good Average Fair Poor 0 5 10 15 20 25 30 35 40 45
- 18. IWMW Birmingham July 2004 Compliant ● validate against (which?) standards – <table> not <div> – HTML not XHTML ● accessibility – currently minimum WCAG A rating ● site management plans – required for all official sites – currently checklist – monitor CMS (93%) vs non-CMS (76%)*
- 19. IWMW Birmingham July 2004 Site Compliance with Web Guidelines Inside CMS Outside CMS 0.00% 10.00% 20.00% 30.00% 40.00% 50.00% 60.00% 70.00% 80.00% 90.00% 100.00%
- 20. IWMW Birmingham July 2004 Current ● frictionless publishing “many hands” – staff maintaining content in CMS (623 or ~20%)* – editor accesses (20-250 logins/working hour)* – development rates (0-150 pages/working hour)* – updating rates (20-150 pages/working hour)* – demand for support/training (11 requests/day)* – 30k pages/480 working days = 62 pages per day – CMS user surveys and feedback* ● expiry and review notification
- 21. IWMW Birmingham July 2004 Number of Staff Publishing in CMS Currently 623 staff Pre CM S Jan FebMar Apr Ma y Jun 200 2 Jul AugSep Oct NovDecJan 200 3 FebMar Apr Ma y Jun Jul AugSep Oct NovDecJan 200 4 FebMar Apr Ma y Jun Jul 0 100 200 300 400 500 600 700
- 22. IWMW Birmingham July 2004 Staff Using CMS by Role 2003 - 2004 Academic Administrative Managerial Executive Technical 2003 2004
- 23. IWMW Birmingham July 2004 CMS Specific Training 2003 - 2004 No training Less than one hour 1-3 hours More than 3 hours 2003 2004
- 24. IWMW Birmingham July 2004 CMS Ease of Use 2003 - 2004 Excellent Good A verage Fair 0 2 4 6 8 10 12 14 16 18 20 1 19 5 4 Excellent Good Average Fair Poor 0 5 10 15 20 25 30 35 40 45 50 10 45 15 12 12 2003 2004
- 25. IWMW Birmingham July 2004 Affordable ● resourcing levels: staffing, hardware & software infrastructure – Staff up to 3.5 FTE = A$150k – Six Intel boxes = A$50k – OpenSource software = A$0 – Organisational unit costs not included ● two year implementation/rollout cost – A$200k/30k pages = A$6.67 per page
- 26. IWMW Birmingham July 2004 Overall Benefit of Using CMS 2003 Huge benef it Signif icant benef it Marginal benef it Neutral Marginal set back Signif icant set back 0 5 10 15 20 25 30
- 27. IWMW Birmingham July 2004 Overall Benefit of Using CMS 2004 Huge benef it Signif icant benef it Marginal benef it Neutral Marginal set back Signif icant set back Huge setback 0 5 10 15 20 25 30 35
- 28. IWMW Birmingham July 2004 Amount & Effectiveness of Effort - 2004 Decreased hugely Decreased signif icantly Decreased marginally About the same Increased marginally Increased signif icantly Increased hugely 0 2 4 6 8 10 12 14 16 18 Amount of effort Much more Marginally more About the same Marginally less Much less 0 5 10 15 20 25 Effectiveness of Effort
- 29. IWMW Birmingham July 2004 Web @ UWA - what hasn't changed? ● poor management predominates ● fragmented, siloed architecture ● disparity between sites depending on resourcing levels ● web gurus?
- 30. IWMW Birmingham July 2004 Web Gurus? Shared ● design ● layout ● navigatio n ● accessibil ity Centralised ● branding ● standards ● infrastructure Decentralised ● structure ● content... from information and navigation to transactional, strategic web use ? ? ? ? ? ?
- 31. IWMW Birmingham July 2004 Questions/feedback? ● Thank you