Exadata_X10M-Hardware-Overview.pdf

Oracle Exadata Database Machine
Exadata X10M Hardware Overview
Exadata Product Management
June 2023

Exadata Database Machine
• The ultimate platform for all database workloads
• OLTP, Warehousing, Database as a Service
• Most advanced hardware
• Fully scale-out servers and intelligent storage with
unified RDMA Network Fabric connectivity and PCI
flash with Memory Acceleration
• Most advanced software
• Database optimized compute, storage, and
networking algorithms dramatically improve
performance and cost
• Standardized, optimized, hardened end-to-end
2 Copyright © 2023, Oracle and/or its affiliates

Automated Management
Fully automated and optimized end-to-end
Database Aware System Software
Unique algorithms vastly improve OLTP,
Analytics, and Consolidation
Ideal Database Hardware
Scale-out, database optimized compute,
networking, and storage
Exadata Vision
Extreme Performance and Availability, Lowest Cost, Available Everywhere
Available
On Premises
Cloud@Customer
Oracle Cloud

Exadata X10M
Hardware Configuration
Copyright © 2023, Oracle and/or its affiliates
4

Exadata X10M Hardware Change Overview
Database Server (2-Socket)
• New AMD EPYC™ CPU – 96-core up to 3.7 GHz (up from 32-core 2.6 GHz)
• New and Increased Memory Capacity – 512 GB, 1.5 TB, 2.25 TB, and 3 TB-DDR5-4800MT/s (up from DDR4-
3200 MT/s) factory options – with more memory channels
Network
• 100Gb/s RoCE Network Cards; New PCIe Gen5
Storage Server
• New AMD EPYC™ CPU – 32-core up to 2.7 GHz (up from 16-core 2.2 GHz)
• New Exadata RDMA Memory Accelerator (XRMEM) – 1.25 TB DDR5 4800 MT/s
• Faster memory – 256 GB DDR5 4800 MT/s (up from DDR4-3200 MT/s)
• New performance-optimized F680 6.8 TB NVMe PCIe Gen4 flash
• New capacity-optimized 30.72 TB NVMe PCIe Gen4 SSD
- 122.8 TB per EF Storage Server, up from 51 TB (previously using F640v3 flash cards)
• New and increased storage capacity – 22 TB Hard Drives (up from 18 TB)
- 264 TB per HC/XT Storage Server, up from 216 TB

Compute Capacity
2,880 DB Cores
33 TB Memory
Storage Capacity
1088 Storage Cores
21.25 TB XRMEM
462.4 TB NVMe Flash
2 PB Raw Flash Capacity
4.2 PB Raw Disk Capacity
Exadata X10M: Extreme Scalability and Epic Performance
• Scale-Out 2 Socket Database Servers
• Latest 96-core AMD EPYC™ CPUs
• Up to 3 TB Memory
• Ultra-fast 100Gb/s RDMA over Converged Ethernet (RoCE)
Internal Fabric
• Scale-Out intelligent 2-Socket Storage Servers
• 1.25 TB XRMEM per storage server
• 122.88 TB raw capacity-optimized flash
Each rack
has up to...
Database Server
High Capacity (HC) Storage Server
Extreme Flash (EF) Storage Server
Extended (XT) Storage Server

Exadata X10M Database Machine (changes from X9M-2 in red)
• Scale-Out 2-Socket Database Servers
• 3x more cores – 96-core AMD EPYC™ CPUs
• Memory options – 512 GB / 1536 GB / 2304 GB / 3072 GB
• Additional client network flexibility
• 2RU Servers
• 100Gb RDMA over Converged Ethernet (RoCE) Internal fabric
• PCIe5.0, active-active, 2x 100 Gb RoCE network interface
ports in Database and Storage Servers
• Scale-Out Intelligent 2-Socket Storage Servers
• 1.5 TB DDR5 DRAM
• 1.25 TB - Exadata RDMA Memory
• 256 GB – for Exadata System Software
• 22% higher capacity – 22 TB Disk Drives (HC/XT)
• 2.4x higher capacity – 30.72 TB NVMe Flash Drives (EF)
• 27.8 TB Flash Cache (HC & EF)
Database Server
192 cores per server
512GB – 3TB DRAM
High-Capacity (HC) Storage
264 TB disk capacity
27.2 TB PCIe NVMe Flash
1.25 TB Exadata RDMA Memory
64 cores for SQL offload
Extreme Flash (EF) Storage
122.88 TB flash storage capacity
27.2 TB PCIe NVMe Flash
1.25 TB Exadata RDMA Memory
64 cores for SQL offload
Extended (XT) Storage
264 TB disk capacity

Oracle Exadata – Standardized and Simple to Deploy
• All Database Machines are the same
• Delivered ready-to-run
• Tested
• Highly supportable
• Runs all Oracle Database workloads
• OLTP, Analytics, Consolidation
• Full 40 years of Oracle DB capabilities
• No Exadata certification required
• Leverages Oracle ecosystem
• Skills, knowledge base, people and partners
✓ No unique configuration issues
✓ Identical to configuration used by
Oracle Engineering
Deploy in days, not months

Exadata X10M Elastic Scaling from Quarter-Rack to Multi-Rack
Quarter
Rack
Elastic
Rack
Multi
Rack
• Start with 2 Database Servers and 3 Storage Servers
• Add Database and/or Storage Servers as needed - scale out up to 14 racks
• Use Oracle Exadata Configuration Assistant (OECA) to model desired configuration

Exadata X10M Database Servers
• Exadata X10M Database Machines uses x86 2-socket Database Servers
• Database Server
• Both CPU sockets populated with 96 cores
• Well suited for all workloads - OLTP, Analytics, Consolidation, Memory Intensive, horizontally and vertically
scalable database workloads and all multi-rack data workloads

96-core 4th Generation AMD EPYC™ CPUs with up to 3 TB of Memory
Exadata X10M Database Server
11
Processor • 2x 96-core AMD EPYC™ 9J14 Processors
DDR5 Memory • 512 GB (16x 32 GB) / 1.5 TB (24x 64 GB) / 2.25 TB (24x 96 GB) / 3 TB (24x 128 GB) 4800MT/s
DDR5 DIMMs (factory installable options, field upgradeable)
Local Disk • 2x 3.84 TB NVMe PCIe4.0 Drives – expandable to 4x 3.84 TB (hot swappable)
Network (installed) • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active – RoCE Network
• Two dual-port SFP28 10/25G ethernet NIC – Client Network
Client Network
(optional, field install)
Up to 3 of the following (any combination):
• Dual port QSFP28 100G ethernet NIC (field install)
• Dual-port SFP28 10/25G ethernet NIC (field install)
• Quad-port RJ45 10G ethernet NIC (field install)
Remote Management • 1x ethernet port (ILOM)
• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

Exadata X10M Database Machine – Storage Server Options
Capacity (HC) Extreme Flash(EF) Extended(XT)
• 2x 32-core AMD EPYC™️ Genoa processors • 2x 32-core AMD EPYC™️ Genoa processors • 1x 32-core AMD EPYC™️ Genoa processors
• 256 GB DDR5 Memory • 256 GB DDR5 Memory • 128 GB DDR5 Memory
• 1.25 TB Exadata RDMA Memory • 1.25 TB Exadata RDMA Memory • N/A
• 2x 480 GB M.2 SSD NMVe • 2x 480 GB M.2 SSD NMVe • 2x 480 GB M.2 SSD NMVe
• 12x 22 TB 7200rpm hard disk drives
• 4x 30.72 TB capacity-optimized NVMe
Flash Cards
• 12x 22 TB 7200rpm hard disk drives
• 4x 6.8 TB F680 NVMe PCIe4.0 Flash Cards • 4x 6.8 TB F680 NVMe PCIe4.0 Flash Cards
• N/A
• 1x dual-port QSFP28 100Gb/s RDMA
Network Fabric Adapter
12

32-core 4th Generation AMD EPYC™ CPUs, XRMEM, NVMe Flash Cards
Exadata X10M High Capacity (HC) Storage Server
13
Processor • 2x 32-core AMD EPYC™ 9334 Processors
Total DDR5 Memory • 1.5 TB (24x 64 GB) 4800 MT/s DDR5 DIMMs
System Memory • 256 GB
Memory Acceleration • 1.25 TB
Drives • 4x 6.8 TB performance-optimized Flash Accelerator F680 PCIe Gen4 NVMe (hot pluggable)
• 12x 22 TB 3.5-inch 7200rpm SAS3 HDD (hot swappable)
• 2x 480 GB NVMe M.2 (hot-pluggable)
Disk Controller • Disk Controller HBA
Network • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active

32-core 4th Generation AMD EPYC™ CPUs, XRMEM, NVMe Flash Cards, No Spinning Drives
Exadata X10M Extreme Flash (EF) Storage Server
14
Processor • 2x 32-core AMD EPYC™ 9334 Processors
Total DDR5 Memory • 1.5 TB (24x 64 GB) 4800 MT/s DDR5 DIMMs
System Memory • 256 GB
Memory Acceleration • 1.25 TB
Drives • 4x 6.8 TB performance-optimized Flash Accelerator F680 PCIe Gen4 NVMe (hot pluggable)
• 4x 30.72 TB capacity-optimized 2.5-inch NVMe PCIe Gen4 SSD (hot swappable)

32-core 4th Generation AMD EPYC™ CPU
Exadata X10M Extended (XT) Storage Server
15
Processor • 1x 32-core AMD EPYC™ 9334 Processor
DDR5 Memory • 128 GB (4x 32 GB) 4800 MT/s DDR5 DIMMs
Drives • 12x 22 TB 3.5-inch 7200rpm SAS3 HDD (hot swappable)
Disk Controller • Disk Controller HBA
* When XRMEM is deployed, Memory is consolidated

Exadata X10M – In-Factory Configurations
16
• Database Server Client Connectivity
• All database servers ship with two dual-port 25GbE Network Cards
• Database Server Memory Capacity
• Exadata X10M Database Servers (Quarter Rack):
• 3 TB (24x 128 GB DDR5 DIMMs)
• 2.25 TB (24x 96 GB DDR5 DIMMs)
• 1.5 TB (24x 64 GB DDR5 DIMMs)
• 512 GB (16x 32 GB DDR5 DIMMs)

• Exadata X10M Memory Expansion Kit
- Marketing Part Number: 7605989 - Exadata X10M Memory Expansion Kit - Twenty four 64 GB DIMMs
- Marketing Part Number: 7606995 - Exadata X10M Memory Expansion Kit - Twenty four 96 GB DIMMs
- Marketing Part Number: 7605030 - Exadata X10M Memory Expansion Kit - Twenty four 128 GB DDR5 DIMMs
• Expands memory configuration of the X10M Database Server
- From 512 GB to 1.5 TB using 64 GB DIMMs (1x kit) – replace existing
- From 512 GB or 1.5 TB to 2.25 TB using 96 GB DIMMs (1x kit) – replace existing
- From 512 GB, 1.5 TB, or 2.25 TB to 3 TB using 128 GB DIMMs (1x kit) – replace existing
• Notes
- No option to expand memory on Exadata X10M Storage Servers
- Previous generation memory not compatible with X10M (and vice versa)
Exadata X10M Database Server Memory Upgrades (Field Upgrade)
17

Network Expansion – Field Upgrade
• Exadata X10M Database Servers come with
• 2x Dual 25G Network Adapters
• Up to 3x additional slots available for networking, choose from
• Dual 100G Network Card (QSFP28), or
• Dual 25G Network Card (SFP28), or
• Quad 10G Network Card (RJ45), or
• Combination of above
Exadata X10M Database Server Client Network Options
18
Dual 100G / Dual 25G / Quad 10G
Dual 25G
Dual 25G
Dual 25G
Field Upgrade Slot
Dual 25G
RoCE Network
RoCE Network

Rack Power Considerations
• Exadata X10M database server with 3TB memory has higher power requirements and
requires different cabling arrangement in the rack
• In OECA, under “Rack Generation”, there three two options:
- “X10M”: rack cabling is optimized for 512GB and 1.5TB configurations
- “X10M (2.25TB DB)”: rack cabling is optimized for 2.25TB configurations
- “X10M (3TB DB)”: rack cabling is optimized for 3TB configurations
• In OECA, under “Database Server Generation”, there are three options:
- “Exadata X10M DB”: database server with 512GB or 1.5TB memory
- “Exadata X10M DB (2.25TB)”: database server with 2.25TB memory
- “Exadata X10M DB (3TB)”: database server with 3TB memory
• Recommendation when using OECA:
- If you need database servers with 3TB memory, select the “X10M (3TB DB)” under Rack Generation,
then select “Exadata X10M DB (3TB)” for your server
- If you need database servers with 2.25TB memory, select the “X10M (2.25TB DB)” under Rack
Generation, then select “Exadata X10M DB (2.25TB)” for your server
- If you need database servers with 512GB or 1.5TB memory, select the “X10M” under Rack Generation,
then select “Exadata X10M DB” for your server
- Refer to FAQ in next slide for other scenarios
• How does the CPQ/Configurator handle this?
- It is handled in the background, automatically; there is no option for rack type
- The Exadata system will ship with the proper rack cabling for the selected database server

Rack Power Considerations - FAQ
Q: Why should I use OECA to model my Exadata configuration?
- In addition to facilitating the scoping and analyzing of elastic
configurations, OECA also validates your Exadata configuration on power
requirements, PDU size, weight distribution, etc.
Q: Should I model the Exadata configuration I want to purchase in
OECA?
- Yes, you must. It will provide you with detailed information on weight,
usable capacity, PDU size to order, power and cooling requirements, etc.
With this information, the quoting and booking in CPQ/Configurator will go
smoothly.
Q: Why are there three rack options in OECA for Exadata X10M?
Prior generations only had one rack option.
- To accommodate the database server with 2.25TB or 3TB of memory.
These servers have higher power requirements than the 512GB and 1.5TB
memory options, and it needs different rack power cabling configuration.
Q: Why does OECA allow adding a 2.25TB or 3TB database server to
the “X10M” Rack when it should force it to use the “X10M (3TB
DB)” or “X10M (2.25TB DB)” rack?
- This option should only be used after the purchase of the Exadata system.
If you purchased a 512GB or 1.5TB, but later you have a need to increase
the memory capacity of some of these servers, you can use OECA to model
your desired configuration to ensure that the changes are OK with your
current rack.
Q: How about CPQ/Configurator? What are the rules around this?
- It determines the type of rack depending on the database server you select.
There is no option to select the rack type.
- If you select a Quarter Rack with a certain memory capacity database server,
you can add additional database servers of the same or lower memory
capacity, not higher. It is recommended to use database servers with the
same memory size.
Q: Can I mix 2.25 or 3TB memory database servers with 512GB or
1.5TB memory servers?
- Yes, it is possible. Months or years after the Exadata purchase, customer
requirements may change, and some servers need to be upgraded to 2.25TB
or 3TB memory. Use OECA to model your desired configuration and ensure
that it is OK with your current rack.
- Note that CPQ/Configurator allows ordering a quarter rack with 3TB
database servers and mixing lower memory configuration database servers.
Q: Are the X10M PDU Cabling Tables the same as Exadata X9M-2?
- No, the X10M PDU tables are updated to reflect the greater power demands
of the X10M storage servers

Exadata X10M Database Machine Elevation Change
• Database Server changes from 1RU (& 5RU) to 2RU
• Quarter Rack continues with 2x Database + 3x Storage Servers
• Elastic Rack (total number of servers varies depending on power requirements)
• Minimum 2x Database Servers and 3x Storage Servers
• Maximum 15x Database Servers (512GB or 1.5TB Memory)
• Maximum 11x Database Servers (3TB Memory)
• Maximum 16x HC Storage Servers and 17x EF Storage Servers
• Storage Expansion Rack up to a total of 19x servers
• Minimum 4x HC or EF Storage Servers per rack
• Up to 14 additional HC Storage Servers
• Up to 15 additional EF Storage Servers
• Up to 15 additional XT Storage Servers
42
41
40
39
38
37
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
09
08
07
06
05
04
03
02
01
Use OECA (Oracle Exadata Configuration Assistant) to create your desired Exadata configuration. Maximum configurations will vary
depending on server memory capacity, power requirements, PDU capacity, etc. OECA will ensure that your configurations are valid.
https://www.oracle.com/database/technologies/oeca-download.html

Elastic Configuration
• Start with a Quarter Rack
• 2x Exadata X10M Database Servers
• 3x Exadata X10M High Capacity (HC) Storage Servers, or 3x Extreme Flash (EF) Storage Servers
• Add more Exadata X10M Database Servers (2RU each in size) :
• Up to 13x Database Servers with 512GB or 1.5TB Memory
• Up to 10x Database Servers with 2.25TB Memory
• Up to 9x Database Servers with 3TB Memory
• Add more Exadata X10M Storage Servers (2RU each in size):
• Up to 13x HC Storage Servers
• Up to 14x EF Storage Servers
• Up to 14x XT Storage Servers
• Can mix Extreme Flash, High Capacity, and Extended Storage Servers in the same rack
• Minimums for redundancy apply (2x Normal Redundancy, 3x High Redundancy)
• Embedded Hardware
• 2x Cisco Nexus 9336C-FX Switch (leaf)
36-port Managed QSFP28 (100GbE) switch
• 1x Cisco 9348 Switch (management)
• Redundant Power Distribution Units
• Optional Hardware
• 1x Cisco Nexus 9336C-FX2 Switch (spine)
Use OECA to model valid configurations, performance and environmental metrics
Exadata Database Machine X10M
22
Exadata X10M Elastic Examples
12x Database Servers +
5x HC Storage Servers
6x Database Servers +
12x HC Storage Servers

Storage Expansion Configuration
• Start with a Quarter Rack
• 4x Exadata X10M High Capacity (HC) Storage Servers, or
• 4x Exadata X10M Extreme Flash (EF) Storage Servers
• Add more Exadata X10M Storage Servers (2RU each in size):
• Up to 14x HC Storage Servers
• Up to 15x EF Storage Servers
• Up to 15x XT Storage Servers
• Can mix Extreme Flash, High Capacity, and Extended
Storage Servers in the same rack
• Minimums for redundancy apply (2x NR, 3x HR)
• Embedded Hardware
• 3x Cisco Nexus 9336C-FX2 Switch (2x leaf, 1x spine)
36-port Managed QSFP28 (100GbE) switch
Note that storage expansion racks always include a third switch to be
used for connecting to other Exadata Racks
• 1x Cisco 9348 Switch (management)
• Redundant Power Distribution Units
Use OECA available to model performance and environmental
metrics
Exadata Database Machine X10M
23
Exadata X10M
Storage Expansion Rack Examples

Thank you
Text
Text

Our mission is to help people see
data in new ways, discover insights,
unlock endless possibilities.

Exadata_X10M-Hardware-Overview.pdf

More Related Content

What's hot

Similar to Exadata_X10M-Hardware-Overview.pdf

Recently uploaded

Exadata_X10M-Hardware-Overview.pdf