IBM IT Operations Analytics for z systems
1 like•795 views
The document discusses IBM's advancements in z IT Operations Analytics solutions, emphasizing the importance of predictive analytics for proactive outage prevention and operational efficiency. It highlights new products such as IBM Operations Analytics for z Systems v3.1 and IBM Z Operational Insights SaaS, which aid in anomaly detection and provide expert recommendations for cost savings. The document also addresses industry trends, including the shift towards cloud-based tools and the growing demand for IT operations analytics.
![IBM zOI - Product Editions
Free CICS Essentials Pack
View sample reports, and test drive zOI with
your own data
Benefit from access to a rounded set of
optimization reports for the CICS subsystem
$0.00 USD $3,000.00 USD
per month per user
[Try free edition] [Purchase now]
Try CICS Abend Analysis with your own data.
View sample reports of other insights.
Access a range of CICS reports including:
CICS Region CPU Constraints
CICS Abend Analysis
CICS Threadsafe
CICS Java Offload
Upload 20 datasets per month Upload 250 datasets per month
1 user 1 user
Forum-based support IBM support
Try Free Edition Purchase Now
With further
subsystem
coverage
planned for
future
CICS
DB2
MQz
IMS
zStorage
…](https://image.slidesharecdn.com/ibmitoperationsanalyticsforzsystems-161020133046/85/IBM-IT-Operations-Analytics-for-z-systems-29-320.jpg)
IBM IT Operations Analytics for z systems
- 1. © 2016 IBM Corporation Getting More Intelligence from Your Mainframe: A Look at z IT Operations Analytics Solutions
- 2. Disclaimer Statement IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here. 1
- 3. Agenda • Overview of analytics • Our portfolio • Product capabilities • Q&A
- 4. Industry trends • Costs and outages are top of mind for clients • A recent survey of z Systems clients showed cost reduction and outage prevention as the top 2 factors where they want to focus operational efforts • Interest in IT Operations Analytics is on the rise • Market dynamics show growth in IT Operations Analytics (ITOA) and decline in IT Operations Monitoring (ITOM), shifting from pure ITOM to an ITOM+ITOA hybrid • SaaS is a growing consumption model • Cloud-based delivery is growing 4x faster than on-premise delivery • 60% of z Systems clients foresee their company adopting some form of cloud-based tooling between now and 2018 3 0 1 0 1 0 1 0 10 1 010 1 0 1
- 5. © 2016 IBM Corporation 4 Our Portfolio
- 6. HybridOn Premise Cloud Optimization • IBM Capacity Mgmt Analytics. • NEW - IBM z Operational Insights (SaaS) “Insight to action in half the time” IT Operations Analytics Solutions on z Systems Investigate and Automate • NEW - IBM Operations Analytics for z Systems • NEW - IBM Common Data Provider for z/OS Predict • NEW - IBM zAware (Anomaly Detection) • IBM Operations Analytics – Predictive Insights • Capacity Management • Software cost analysis • Enterprise resource and workload optimization • SME insights in cloud (SaaS) • Log Analytics • Domain insights and expert advice • Alert notification and automation • Unified data collection for logs and SMF • Pro-Active Outage Avoidance • Predict Problems before occurrence • Log anomaly detection
- 7. Reduce Operational Cost, Bring Analytics to your Data, Smarter IT Service Management with Rapid Time to Value • New Problem Insights View • Consolidated view across the system for root cause analysis • z/OS Security Insight Pack • See patterns of security incidents by user or resource • Analyze critical operations data • Includes zAware Software Appliance • Advanced machine learning to detect abnormal system behavior ibm.biz/ioazlivedemo Insurance industry client example • Experienced an application outage that resulted in the team working around the clock for 29 hours • After the issue was resolved, the logs were captured and sent to IBM lab for analysis using IBM Operations Analytics for z Systems • Within minutes, the IBM team was able to focus in on the root cause of problem and find the relevant PTF to resolve the issue IBM Operations Analytics for z Systems v3.1
- 8. Cognitive infrastructure to detect anomalous systems behavior in near real-time • New Software Appliance Delivery • Deploy and launch within minutes • Enhanced Proactive Anomaly Detection • Act before there is a service outage via email notification • New Historical View • See the history of an anomalous message in order to accelerate problem resolution • Integrated with IBM Operations Analytics • Launch directly to logs in the context of an anomaly ibm.biz/ioazlivedemo Insurance industry client example • Experienced an application outage that resulted in the team working around the clock for 29 hours • After the issue was resolved, the logs were captured and sent to IBM lab for analysis using IBM Operations Analytics for z Systems • Within minutes, the IBM team was able to focus in on the root cause of problem and find the relevant PTF to resolve the issue IBM zAware v3.1 I zAware host Linux on system z z/OS IBM zAware zAware monitored clients z/OS IBM zAware Web GUI to monitor results z/VM Monitors z/OS and Linux on z images running natively or as a guest
- 9. IBM Common Data Provider for z Systems 1.1: Real Time Access to Analytics A single source for all operational data streamed to the analytics platform of choice • CDP provides consumable, near real time operational data • Built to improve the ability to manage the growing complexity of data requests • Tivoli Decision Support for z/OS customers can write their SMF data directly to IDAA • Simple to install, configure and use • Multiple data sources • Flexible output options • Write to any destination • Streaming SMF and log data • Built in filtering to control data volumes Reduce Risk to you Business: Detect threats with your Security products using live streaming data Optimize Costs and Efficiencies: Feed all IT Operations data to analytical engines from a single product Prevent Impact to Your Operation: Proactive Analysis of data in near Real Time as an early warning
- 10. Breaking new ground in the Cloud with IBM z Operational Insights (SaaS) Expert cost & performance insights for z Systems in minutes. Just add operational data. • IT Service Management software, delivered as SaaS, addresses key pain points: • z Systems performance & running costs • Pressure on staff availability & SME skills • Time-to-value of traditional on-premise tooling • Analytics on z operational data, with embedded IBM expertise • ‘CICS Essentials’, with intent to expend across subsystems • Try IBM zOI for yourself at ibm.biz/try-zoi • Potential benefits quantified upfront • Tailored recommended actions • First-in-kind comparisons to other users • Built on expertise from z performance SMEs • Clean, modern web browser-based interface • Easy value assessment – free SaaS trial
- 11. © 2016 IBM Corporation Product Capabilities IBM Operations Analytics for z Systems
- 12. IBM Operations Analytics for z Systems V3.1 11 Problem Insights and Anomaly Identification … Understanding the unknown NEW in V3.1: Inclusion of IBM zAware v3.1 anomaly detection with Problem Insights Rapid analysis of vast amounts of data, and even more data types New z/OS Security Audit Events Insight Pack Use in conjunction with NEW Common Data Provider v1.1 Key Values: Built-in IBM expertise to predict issues instead of waiting for failure, for fewer outages Analyze & intelligently search ops data with anomaly detection, for faster root cause analysis and Mean Time to Recovery http://ibm.biz/ioazlivedemo
- 13. Problem Insights 12 Automatically surfaces important messages found in the log data. Provides easy to read problem summary and suggested actions for problem resolution. Displays Anomaly Interval scores from IBM zAware. Total number of Problem Insights found per Sysplex Count of this message over the timeframe Link to search for this message in this time period Click to show the suggested actions for this message Interval Score column shows anomaly score for the last time the problem occurred on this system
- 14. Suggested Actions The Suggested Actions are presented as a pop-up window. 13 Link to the Knowledge Center for this message ID Suggested Actions to investigate/resolve the issue
- 15. IBM Support Portal based Expert Advice 14 Search for expert advice with the click of a button All IBM support site documents that reference messages from search results Launch to Tech Note Launch from client or server side
- 16. © 2016 IBM Corporation Product Capabilities IBM zAware
- 17. IBM zAware v3.1 Software Appliance (included in IOAz v3.1) 16 IBM zAware v3.1... Benefits from Anomaly Identification NEW in V3.1: Anomaly detection with z/OS and Linux for z message logs Improved consumability with zAware delivered as a software appliance feature with IBM Operations Analytics for z systems Proactive outage avoidance with email Alerts for identified anomalies View the history of an anomalous message for faster problem resolution Launch in Context into logs in the context of the Anomaly for quick message id search Key Values: Built-in IBM expertise to provide proactive outage avoidance instead of waiting for failure to happen; thus fewer outages Improve problem determination intelligently using anomaly detection on IT operational data for better Mean Time to Recovery
- 18. Integration between IOAz and zAware 17 zAware interval anomaly scores link back into zAware Select message and Launch to IOA/Search
- 19. © 2016 IBM Corporation Product Capabilities IBM Common Data Provider for z Systems
- 20. IBM Common Data Provider The Common Data Provider (CDP) was driven by customer requests to address the growing Operational Analytics requirement. The CDP provides: • A single source for z/OS Operational Data in a flexible, consumable format both on and off platform • Near real-time data feed of SMF data and log data • Single interface that is easy to configure and use • The product is OTC so data collection is NOT ingestion based • Read once - write many • Multiple destinations in different formats for different consumers • Batch data collection also available for deep dive analysis or to control CPU consumption • Documented protocols and formats for sending and consuming data are provided, enabling data ingestion to widely used Industry Analytics Platforms or Enterprise-specific solutions for access and analysis Vision and Purpose • An interactive framework for combining multiple views of the same data to provide a deeper understanding of the Enterprise
- 21. Maximize Existing Investments IBM DB2 Analytics Accelerator IBM Tivoli Decision Support for z/OS (TDSz) customers can leverage their existing reporting systems by loading TDSz data direct in to the IDAA SMF Data DB2 IDAA/SQL queries Today: TDSz and IDAA Copy from DB2 to IDAA. Time consuming and expensive TDSz CDP Solution: Direct load to IDAA with TDSz schema • Direct load of TDSz SMF data to IDAA with TDSz schema • No data lands in DB2 tables (reduced DB2 footprint) • Saves CPU on copy and aggregation • Allows you to keep more data over a longer period • Ability to store and query timestamp and interval data for deep dive • No need to change reporting systems Save time and money IDAA copy SMF Data DB2 IDAA/SQL queries CDPz IDAA IDAA LOAD batch CMA Standard TDSz Reports TDSz Schema
- 22. Common Data Provider Architecture 21 z/OS Common Data Provider IBM Operations Analytics On Premise z/OSMF Configuration Consumers On Platform SMF Data Gatherers Log Forwarder System Data Engine Syslog DB2 WAS MQ VSAM Data Streamer Fixed Data Log Data TDSz CMA Multiple Consumers Off Platform Data Handling Web UI Non IBM Analytics Platforms Enterprise-Specific Operations Data Solutions Data Flow Configuration IDAA batch Three main component types Data Gathers – flexible, customizable, efficient Data Streamer – controls data formats and destinations User Interface – simple intuitive configuration
- 23. Data Gatherers 22 System Data Engine • Based on 30+ years of engineering • Designed to collect and process SMF data • No DB2 prereq – installed and usable within hours • Data can remain unprocessed or unpacked into a readable, consumable format • Formats the data into multiple formats for ease of ingestion (eg CSV or DB2 LOAD format) • Supports all standard IBM SMF types • Supports multiple sources of SMF data – archive, logstream or direct from the new SMF Buffer api in near real time • Has built-in filtering to control data types and volumes Log Forwarder • Gathers a variety of log data and some VSAM file formats for Analytics Engines • Additional log support planned through ongoing continuous delivery • Custom log types can be added and any dataset can be streamed giving great flexibility
- 24. Streaming Live Data 23 The Data Streamer controls the destination and format of the Operations Data • Receives data from the gatherers • Splits and Annotates the log data into individual messages for ingestion into analytic engines • Transforms data messages into the right format for the destination platform (eg UTF-8 and other code pages) • Transport mechanism is TCP/IP – available as TSL for additional security • Data sent in json wrapper for ingestion by Logstash for storage and analysis • Extendable to other platforms like ELK and SPLUNK • Streams data both on and off platform • ziiP enabled for cost savings (pure Java)
- 25. Web Configuration Tool 24 The data sources, transformation and destinations are managed and controlled through a simple user interface Plug-in for z/OSMF Menu driven to configure: • Data streams and their sources • Any transformation requirements • Output format • Destination (on or off platform) Security • Push Based model • Host-based policy controls subscribers and data sources • Policy can be secured by RACF for total control of data and subscribers
- 26. © 2016 IBM Corporation Product Capabilities IBM z Operational Insights
- 27. Imagine a world with... …a simple, intuitive tool, which requires no installation, analyzes your z operational data, identifies potential efficiency improvements, shows the estimated cost savings upfront, allows you to compare your environment to others in the z community, and provides suggested next steps to improve. 26
- 28. Trying zOI is a simple process Product tour video at: https://ibm.biz/zoi-quickstart You can try zOI for free at ibm.biz/try-zoi •Explore the user interface •View sample reports without uploading any data •Try uploading your own data, and view results in one free report A simple guide: 1. Sign up to z Operational Insights Sign up in seconds at ibm.biz/try-zoi using your existing IBM id (or quickly create one) 2. Collect your operational data Collect and extract up to 750MB of SMF data (e.g. CICS SMF110 for the ‘CICS Essentials’ pack) 3. Securely upload your operational data Your data is uploaded securely using SSL, and encrypted at rest in our database The data you upload is similar to that you’d send us to help deal with a PMR We remove any custom fields and keep only the data needed for analysis 4. View results & act for improved efficiency Visualize your potential savings and how you compare to other users, and see actionable next steps to help you improve 27
- 29. IBM zOI - Product Editions Free CICS Essentials Pack View sample reports, and test drive zOI with your own data Benefit from access to a rounded set of optimization reports for the CICS subsystem $0.00 USD $3,000.00 USD per month per user [Try free edition] [Purchase now] Try CICS Abend Analysis with your own data. View sample reports of other insights. Access a range of CICS reports including: CICS Region CPU Constraints CICS Abend Analysis CICS Threadsafe CICS Java Offload Upload 20 datasets per month Upload 250 datasets per month 1 user 1 user Forum-based support IBM support Try Free Edition Purchase Now With further subsystem coverage planned for future CICS DB2 MQz IMS zStorage …
- 30. • Over 200 users from over 175 companies worldwide • Participation from all over the globe • "Operational Insights is a great tool that can be used to promote the benefit of modern capabilities to help drive operational efficiency improvements“ • - Technical Architect, leading healthcare company Client Feedback 29
- 31. Unbeatable time to value 30 •“very easy to use and effective tool” •– Latin American Bank CPU savings c 5% c $$ within minutes identified
- 32. zOI Home page
- 33. zOI CICS Java Offload 32
- 37. CICS CPU Region Constraints 36
- 38. © 2016 IBM Corporation Thank You
- 39. z IT Operations Analytics Announcements Predictive analytics for proactive outage prevention • NEW: IBM Operations Analytics for z Systems v3.1 • The new release which now includes IBM zAware v3.1 as a software appliance • NEW: Inclusion of IBM zAware v3.1 can now provide IOAz program insights with anomaly detection for faster problem determination and better proactive outage avoidance paired with comprehensive root cause analysis that provides recommended actions. • http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=897&letternum=ENUS216-373 Operational efficiency, delivered in the cloud • NEW: IBM z Operational Insights (z SaaS offering) • Cloud-based analytics with embedded expertise from performance experts • Just upload data to populate reports crafted by IBM performance experts • Get estimated savings, expert recommendations for actions, and comparisons to other users • http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=897&letternum=ENUS216-220 IT Analytics your way: Smarter data handling • NEW: IBM Common Data Provider for z/OS v1.1 • A single source for z/OS Operational Data in a flexible, consumable format both on- and off-platform • Can supply data to IBM analytics solutions, as well as other analytics platform targets • Can supply faster DB2AA and IDAA loading of valuable z Systems data 38