Oracle GoldenGate, Streams, and Data Integrator
Download as PPTX, PDF17 likes4,071 views
Oracle GoldenGate, Streams, & Oracle Data Integrator GoldenGate is Oracle’s strategic replication solution while Streams continues as a supported Oracle Database feature. GoldenGate has advantages over Streams such as better ROI, being an enterprise-wide solution, and having higher reliability, flexibility and performance. Oracle Data Integrator is an ETL tool that can be used with GoldenGate for periodic data loads from operational systems to data warehouses with lower latency compared to batch-oriented tools.
Oracle GoldenGate, Streams, and Data Integrator
- 1. Oracle GoldenGate, Streams, & Oracle Data IntegratorFumikoYamashitaSafe Harbor Statement: The views expressed on this presentation are my own and do not necessarily reflect the views of Oracle.The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making a purchasing decision. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
- 2. 2Oracle StreamsOracle GoldenGateRequires API based stored DB packages
- 3. Works with Oracle Database
- 5. Problem scaling in high-throughput environments
- 9. High performance in high transactional environment
- 10. Reliable architectureComparing GoldenGate & StreamsGoldenGate is Oracle’s strategic replication solutionStreams continues to be a supported Oracle Database featureGoldenGate’s Advantage:Better ROI overall: GoldenGate is lower cost to implement and maintain
- 11. Enterprise-wide solution: GoldenGate easily expands to new use cases
- 12. Reliability, flexibility, high performance: GoldenGate surpasses other technologiesInternal Only
- 13. Comparing GoldenGate, Data Guard & StreamsGoldenGate: Upgrading or Migrating from Oracle Database 8i/9i to 10g/11g33.1 GoldenGate’s Technology for Transactional Data Management….Aside from the differentiating ability of GoldenGate to handle heterogeneous database environments, readers familiar with Oracle data movement technologies may ruminate on the perceived resemblance between Oracle Streams and GoldenGate. This collation, however, is purely conceptual. The underlying architectures are significantly different. For example, Streams in Oracle 9i has problems scaling in high-throughput environments. In addition, it is limited in its support for data types (e.g. LONG) and for certain kernel functionality (e.g. log_parallelism). These issues are not present in GoldenGate’s platform.….6.6 Oracle Data Guard, Oracle StreamsThe above two solutions do not support a rolling upgrade from 8i or 9i to 10g or 11g. For 10g to 11g upgrades you can use a physical standby configuration but you have to use transient logical standby during the upgrade process. In addition, during the upgrade process the standby system will not be available for failover. Please note that there are some limitations with using logical standby particularly with data types.GoldenGate_WhitePaper_Oracle8i9ito10g11g.pdf
- 14. Oracle GoldenGate/ODI Use Cases & Demo CoverageEnterprise-wide Solution for Real Time Data NeedsDisaster Recovery, Data ProtectionStandby(Open & Active)13Zero Downtime Migration and UpgradesContinuous Availability(OGG)Log Based, Real-Time Change Data CaptureOperational ReportingReportingDatabaseOGGODI/ETLEDWODS2ODI/ETLReal-time OR/BI (ODI/OGG)Heterogeneous Source SystemsEDWReal-time BIQuery OffloadingData DistributionLower IT Cost(OGG)SOA Integration /Web Services (ODI/OGG)OGG: Oracle GoldenGate ODS: Operational Data Store TCO: Total cost of ownership BI: Business IntelligenceODI: Oracle Data Integrator EDW: Enterprise Data Warehouse ROI: Return of investment ETL: Extract-Transform-Load Tool
- 15. 5Oracle Real Time Data IntegrationOracle’s Unique Offering for Real Time Business Intelligence21ODI - ETL ToolPeriodic mini-batches
- 16. Transform in the Database
- 17. Never go back to sourcesOracle GoldenGateReal time CDC extracts from transactional systems
- 19. Continuous streaming load into ODS Schema of target
- 21. Maintains transactional integrity
- 22. Ensures data integrity and reliabilityEMPEMPDEPTDIMFACTDIMDIMDIMEMPDEPTDEPTSource 1ODIData Warehouse on Sybase On-Disk LogsOracleGoldenGateSource 2OracleGoldenGate On-Disk LogsODS SchemaDW SchemaOperational Financial Billing System on Oracle DBBenefitImproves business insight
- 23. Combines intelligence on current business status with historical context
- 24. Eliminates load on source systems
- 25. Reduces latencies and batch windowsOracle Data Movement & Transformation Products per SolutionAny DB Oracle Hetero-geneousOracleto OracleAny DB6
- 26. Oracle Data IntegratorBased on Technology Foundation from Data Movement and Transformation from Multiple Sources to Heterogeneous Targets
- 27. Use Cases for Oracle Data Integrator
- 28. Customer Data QualitySt. James BBQ & Pool SvcJohn St. James III42 Ridge St, #5St. Louis5551234Saint James Barbequeand Pool ServiceJonathan St. James III42 Ridge Street. NW, #5St. Louis,MO 63119314-555-1234CLEANSEProduct Data QualityWG IK 113 OHM .15W1%RESWG ik 113OHM1/8W1/8WATT IK @113O 1%ikwidg 113Ohm @.15-1Widget ik – 113OMax 113o 1/8w-1%RES6 Matching Products, each record is identical: Product: Widget IK Power: .15 Watt Resistance: 113 Ohm Tolerance: 1%CLEANSEBENEFITS FOR THE BUSINESS USERSSupply Chain - Accurate inventory data & improved collaboration with third-parties
- 29. Customers Service - Improved CS with complete and accurate CRM information
- 30. Marketing / Sales - Better understanding of customer behavior, Accurate insight into sales efficiency, New cross-selling opportunities enablement
- 31. Decision Makers - Take decisions on trustworthy data and accurate KPI, Discover new business opportunitiesOracle Data Quality and ProfilingJoint Development with TrilliumDATA QUALITY PROVIDESProfiling - Discover and assess data quality
- 32. Cleansing – Common Data Typos
- 33. Matching – Eliminate Duplicates
- 34. Parsing – Unstructured Tokens
- 35. Standardization – Common Formats Oracle Data Integrator CustomersMediaServicesCommunicationsFinance / BankingOtherEnergy/IndustrialInsurance / HealthRetail
Editor's Notes
- #3: Statement of Direction: http://www.oracle.com/technology/products/goldengate/htdocs/statement-of-direction-gg.pdfFAQ: http://www.oracle.com/goldengate/goldengate-faq.pdf
- #4: http://goldengate.com/resources/GoldenGate_WhitePaper_Oracle8i9ito10g11g.html (no longer available from the link)
- #7: SPARC M5000 32-cores, divided up to different Zones (need to be capped). Sybase on x86 w/ 4 dual-core CPUs (8 cores).