Use of standards and related issues in predictive analytics
3 likes2,017 views
The document discusses the use of standards in predictive analytics, particularly around PMML and PFA, highlighting their relevance to contemporary system architectures like distributed processing and streaming applications. It emphasizes the need for interchange in machine learning libraries and the challenges posed by organizational changes in businesses. Additionally, it raises concerns over technical debt and emerging standards for workflow definitions, including data lineage and metadata management.
Use of standards and related issues in predictive analytics
- 1. Use of standards and related issues in predictive analytics KDD 2016, SF 2016-08-16 Paco Nathan, @pacoid⨠Dir, Learning Group @ OâReilly Media
- 2. PMML referenced by 86 publications in Safari, 2001-2016⨠https://www.safaribooksonline.com/search/?query=PMML
- 3. Pattern: PMML for Cascading and Hadoop⨠P Nathan, G Kathalagiri (2013-08-11)⨠https://goo.gl/jk7829
- 4. Customer Orders Classify Scored Orders GroupBy token Count PMML Model M R Failure Traps Assert Confusion Matrix Pattern â score a model, using pre-defined Cascading app cascading.org/projects/pattern
- 5. evaluationoptimizationrepresentationcirca 2010 ETL into cluster/cloud data data visualize, reporting Data Prep Features Learners, Parameters Unsupervised Learning Explore train set test set models Evaluate Optimize Scoring production data use cases data pipelines actionable results decisions, feedback bar developers foo algorithms Algorithms and developer-centric template thinking only go so far in real-world workflows⌠Results shown in blue, hard problems highlighted in red Generalized Workflow for ML Use Cases in Big Data
- 6. Portable Format for Analytics (PFA) PFA updates the standards w.r.t. more contemporary issues of system architectures used for predictive analytics: distributed processing, in-memory computing, serialization, etc. http://dmg.org/pfa/docs/motivation/ ⢠much more support for distributed systems ⢠Avro data types ⢠forward-looking toward more streaming applications ⢠fits well with higher layers of abstraction, success of DSLs, etc.
- 7. Tuning Spark Streaming for Throughput Gerard Maas, Virdata (2014-12-22) âOne Size Fits Allâ Doesnât Anymore⨠This common architectural pattern requires interchangeâŚ
- 8. bits.blogs.nytimes.com/2013/06/19/g-e-makes-the-machine- and-then-uses-sensors-to-listen-to-it/ IoT alters âvelocityâ and âvolumeâ dramatically⨠This growing category of use cases requires interchangeâŚ
- 9. Lessons from the success of Apache Spark⌠interchange is necessary for the ecosystem major use cases tend to build their own ML libraries â despite a case where a majority of committers tend to support a common vision and encourage use of a canonical library (MLLib with DataFrames) when a successful business grows over time, challenges arise by definition: managing separated teams, mergers and acquisitions, increased audits, regulations, etc. therefore, lack of interchange for analytics represents a serious technical debt and potential liability
- 10. Tungsten Execution PythonSQL R Streaming DataFrame Advanced Analytics Physical Execution: CPU Efficient Data Structures Keep data closure to CPU cache Tungsten Lessons from the success of Apache Spark⌠direct use of âcompilersâ becomes atypical as abstraction layers become smarter for deferred optimization
- 11. What to suggest for existing standards? microservices: how to compose models + parameters from multiple/distinct services support for API definitions in Swaggar http://swagger.io/ consider the benefits of Parquet, e.g., how pushdown predicates enable better optimization of workflows
- 12. What to suggest for existing standards? additional standards emerging for other aspects of workflow definition: Jupyter http://jupyter.org/⨠⨠create and share documents that contain live code, equations, visualizations and explanatory text â ⨠a network protocol suite, at heart, for distributed REPL environments, often along with containerization see usage in Oriole http://oreilly.com/oriole/index.html⨠Dat http://dat-data.com/ shares versioned data through a decentralized network
- 13. What to suggest for existing standards? other lingering issues: ⢠data lineage / provenance ⢠metadata drift ⢠public dialog and law:⨠https://public.resource.org/about/
- 14. presenter: Just Enough Math OâReilly (2014) justenoughmath.com monthly newsletter for updates, ⨠events, conf summaries, etc.: liber118.com/pxn/