E xtreme programming for etl and data analytics final
Download as PPTX, PDF2 likes389 views
This document discusses the evolution of extreme programming practices at IDeaS for their ETL projects. It describes how their practices started with Hilstar and evolved through Opera and Pegasus to incorporate techniques like test-driven development, pair programming, continuous integration, and greater tester involvement. This led to benefits like reduced bugs, faster development cycles, and easier adaptation to change. The document also outlines future areas to improve like refactoring, sandbox environments, polyglot programming skills, and joint application development with vendors.
![eXtreme
Programming for ETL
Agile Pune 2014
_________________________
Prafulla Girgaonkar [@pgirgaonkar]
Naresh Jain [@nashjain]
Illustration: Umesh Kale](https://image.slidesharecdn.com/extremeprogrammingforetlanddataanalyticsfinal-141124083231-conversion-gate01/85/E-xtreme-programming-for-etl-and-data-analytics-final-1-320.jpg)
![Prafulla Girgaonkar [@pgirgaonkar]
Naresh Jain [@nashjain]
Illustration: Umesh Kale
Session Ends.. Efforts Continue…](https://image.slidesharecdn.com/extremeprogrammingforetlanddataanalyticsfinal-141124083231-conversion-gate01/85/E-xtreme-programming-for-etl-and-data-analytics-final-74-320.jpg)
E xtreme programming for etl and data analytics final
- 1. eXtreme Programming for ETL Agile Pune 2014 _________________________ Prafulla Girgaonkar [@pgirgaonkar] Naresh Jain [@nashjain] Illustration: Umesh Kale
- 2. 25YEARS 6000+CLIENTS Nr 1M ROOMS 94COUNTRIES 95%+ ago we started later we’re still finding around the world are helping clients the revenue opportunity priced every single day manage their in every situation using IDeaS revenue on 6 continents have hotels that now run on IDeaS Revenue Management Systems More than 95 percent of all our clients are still working with us today. About IDeaS
- 3. ETL IP DECISIO N ETL & IDEAS PMS/CRS Competitor WebRate Social Media Periodically or Real Time Full or Delta Messages or File * * * *
- 4. Earlier ETL Practices Concept Exploration Discovery Structuring Requirements
- 5. Typical Development Cycle on an ETL Project Concept Data Exploration “Structurization” ETL Development Certification GA
- 6. Earlier ETL Practices Vendor IDEAS Development
- 7. Challenges and Flaws Source : www.dogri.org/
- 12. Challenges and Flaws Time Discovery Development
- 13. Challenges and Flaws Source : http://roselawgroupreporter.com/
- 15. Challenges and Flaws - Vendor Late Data Change Delays Requirement Misunderstanding Priorities API Performance Requirement Conformity
- 16. Naresh Jain • nareshjain.com • @nashjain
- 17. Prafulla S Girgaonkar Product Development for Hospitality | Revenue Optimization | Finance [email protected] @pgirgaonkar
- 18. Journey Hilstar Opera Pegasus
- 19. Old Approach
- 20. Existing Approach - Iterative & Incremental Approach
- 21. Initial XP Practices - Hilstar
- 22. DBA QA DEV PM UX Initial XP Practices – Whole Team Source: http://www.selfishprogramming.com/ BO KM
- 23. Initial XP Practices – Small Releases Iteration #1 Iteration #2 Iteration #3
- 24. Initial XP Practices - Continuous Integration
- 25. Initial XP Practices – User Story
- 26. Evolution of the Practices… OPERA Source: http://www.freedomchurchunited.org/
- 27. Evolution of the Practices - Pairing
- 28. Evolution of the Practices – Planning/Grooming Source: http://www.h4-entertainment.com/
- 29. Evolution of the Practices – Test Driven Development
- 30. Evolution of the Practices – Refactoring
- 31. Evolution of the Practices – Coding Standards
- 32. Evolution of the Practices – Collective Ownership
- 33. Evolution of the Practices – Simple Design
- 34. Evolution of the Practices – Optimization at the End • The customer is always available • Code the unit test first • Leave optimization for later
- 35. Evolution of the Practices – Test Driven Bug Fixing Write a TEST before FIXING the BUG
- 36. Further…Evolution of the Practices… Pegasus
- 37. Further…Evolution of the Practices – SAS 4GL Data Management 4GL MACROS PROCS FUNCTIONS Learn SAS 4gl @ http://support.sas.com/software/p roducts/ondemand-academics/
- 38. Further…Evolution of the Practices – Earlier Code
- 39. Further…Evolution of the Practices – Testability No Unit test No Build Integration Language Unawareness Discover the Tool SASUNIT
- 40. Further…Evolution of the Practices – Code Later
- 41. Further…Evolution of the Practices – Build Process Correction Part of build Process Fail Fast
- 42. Further…Evolution of the Practices – Jenkins for SASUNIT Integrated With Jenkins Fail Fast Fail Reports
- 43. Engineering Practices are always at the core. Tools May not be there. There is WILL, there is WAY CRUX
- 45. Benefits – Source: http://docustar.com/blog/quality-check-is-99-9-good-enough/
- 47. Benefits
- 48. Benefits
- 49. Benefits Relative Time Hilstar Opera Pegasus
- 50. UNIT Test … UNIT Test … UNIT Test … Benefits Source: www.topnews.in
- 51. Benefits Source: http://en.wikipedia.org/wiki/Cello
- 52. Change Management Source: http://www.animalnational.com/monarch-butterfly-migration/
- 53. Change Management – Usual Reactions Source: http://ericgerlach.com/introphilosophy8/ DEVs | QAs | POs | BOs
- 54. Change Management – Looking for Rituals Source: http://www.theguardian.com/books/2014/apr/27/reading-print-books-ereaders-technology DEVs | QAs | POs | BOs
- 55. Change Management – Smaller Release/Stories were Shaker Courtesy: Jeff Patton DEVs | QAs | POs | BOs
- 56. Change Management – Incremental Development DEVs | QAs | POs | BOs
- 57. Change Management – Story Map DEVs | QAs | POs | BOs
- 58. Change Management – Spikes were new Source: http://www.kitchology.com/ DEVs | QAs
- 59. Change Management – CI & Failing Builds DEVs | QAs
- 60. Change Management – Pairing Source: https://www.airpair.com/mean-stack/posts/2014-10-job-post-mean-stack-developer DEVs | QAs
- 61. Change Management – Team Ownership Source: https://dilbert.com DEVs | QAs
- 62. Change Management – Testers part of Design Discussion Source: http://www.mercatornet.com/articles/view/health_economics_101_contraceptives_pay_for_themselves_usually_babies_dont DEVs | QAs
- 63. Change Management – Defect are discussed; not entered Source: http://letstalkaboutdiscussion.ca/ QAs
- 64. Change Management – Test Automation Source: http://www.mobileqazone.com/profiles/blogs/software-testing-by-human-or-machine-what-should-shouldn-t-be QAs
- 65. Road Ahead Source: http://www.gettyimages.in/
- 66. Engineering Practice - Refactoring / Managing Code Smells Source: www.123rf.com
- 67. Road Ahead - Engineering Practice – Simple Design • Engineering Practice - Simple Design & Solving critical challenges by taking them out of context Source: http://flickr.com/
- 68. Road Ahead - Engineering Practice –Sandbox • Engineering Practice - Simple Design & Solving critical challenges by taking them out of context Source: http://ifum.com/
- 69. Road Ahead - Engineering Practice - Evolutionary Design Extended Source: http://nordicedge.com/
- 70. Road Ahead - Engineering Practice – Programming skills and polyglot
- 71. Road Ahead - Real Time Integration
- 72. Road Ahead - Joint Application development with Vendor WE I JAD Source: http://www.p-r-i.org/nadcap/nadcap-meetings/
- 73. Take Away • Engineering Practices are universal – determination and perseverance • XP Practices lead to T-Shaped individual or Generalizing Specialist • Product Discovery & Story Mapping vital for Alignment.
- 74. Prafulla Girgaonkar [@pgirgaonkar] Naresh Jain [@nashjain] Illustration: Umesh Kale Session Ends.. Efforts Continue…