Micron: Memory Expansion with CXL Modules: Benefits, Use Cases and Enriching the CXL Ecosystem
- 1. Micron Confidential Micron Confidential Memory Expansion with CXL Modules: Benefits, Use Cases and Enriching the CXL Ecosystem
- 2. Micron Confidential Micron Confidential Memory Expansion with CXL Modules: Benefits, Use Cases and Enriching the CXL Ecosystem Poorna Kale, Distinguished Member of Technical Staff, Micron Technology
- 3. Micron Confidential Micron Confidential CXL Use Cases Increasing latency and capacity Increasing bandwidth Capacity storage Fast storage Capacity and bandwidth expansion Archival storage DDR In package memory Storage Direct attached using CXL HBM Use cases for CXL-based memory expansion Data center workloads Capacity expansion Bandwidth expansion AI/ML In-memory database Data analytics General purpose compute High performance compute
- 4. Micron Confidential Micron Confidential Capacity Expansion • Direct Attached Memory Tiering • Application Transparent • OS Managed, User Space Library, 2LM Mode • Application Managed • Application Aware (ex: libnuma) • Modified (ex: libmemkind) • CXL Switch / Fabric attached Memory Tiering • Another Memory tier added to the system with higher latencies • Micron taking a leadership role in enabling the AI and data science toolchains to share data in fabric- attached memory Ways to deploy CXL Bandwidth Expansion • CXL Heterogenous interleave solutions 1. Hardware based interleave 2. Software and HW heterogenous interleave 3. Software based NUMA interleave 4. Micron actively collaborating on introducing ratio-based memory interleaving capabilities for the Linux kernel
- 5. Micron Confidential Micron Confidential CZ120 Memory Expansion Performance 24% more memory bandwidth DDR5 (768GB) DDR5 + CXL (1,792GB) Total memory bandwidth (GB/s) 24% 24% more memory bandwidth3 DDR5 (768GB) DDR5 + CXL (1,792GB) MSSQL TPC-H (3000 scale factor) queries per day 96% 96% more queries/day 128GB/256GB Up to 2TB incremental server capacity1 supporting CXL 2.0 Upto36GB/s 2 Up to 24% increased server memory read/write bandwidth E3.S2TPCIeGen5x8 Industry-standard form factor for broad deployment 1. By adding 8x256GB CZ120s, system limitations may apply. 2. Measured by running MLC workload with 2:1 read/write ratio on a single CZ120 module. 3. MLC bandwidth using 12-channel 4800MT/s RDIMM + 4x256GB CZ120 vs. RDIMM only.
- 6. Micron Confidential Micron Confidential Micron CZ120 Enablers OEMs OS/SW ISVs/SW Solns ASIC Vendors Test Vendors Switch/ CM Vendors Enriching the CXL Ecosystem with CZ120
- 7. Micron Confidential Micron Confidential • Activities: Validation, Compatibility, Qualification • Objective: Achieve Timely Qualification by CPU Launch Enriching the CXL Ecosystem with CZ120 Micron Enablers
- 8. Micron Confidential Micron Confidential • Activities: Validation, Compatibility, Power, Thermal, EVT, Optimization CXL Configuration, and Qualification • Objective: Achieve Timely Qualification by CPU Launch Enriching the CXL Ecosystem with CZ120 Micron OEMs
- 9. Micron Confidential Micron Confidential • Activities: Validation, Signal Integrity, Compliance, Across multiple DIMMs/DRAMs, Optimization of Power and Performance • Objectives: Ensure wider ASIC choices for CXL deployment, Seamless and easier CXL adoption without having to know DRAM, Choice of FFs Enriching the CXL Ecosystem with CZ120 Micron CXL ASIC Vendors
- 10. Micron Confidential Micron Confidential • Activities: SW compatibility Testing, Contributing to SW interleaving ecosystem, Linux patches, Joint Validation with OS and Hypervisors • Objectives: Ensure wider ASIC choices for CXL deployment, Seamless and easier CXL adoption without having to know DRAM, Choice of FFs Enriching the CXL Ecosystem with CZ120 Micron OS/SW
- 11. Micron Confidential Micron Confidential • Activities: Early validation, Proof points / POCs , Joint customer engagements, Integration of CXL APIs into their platforms, Certification for production with OEMs. • Objectives: Ensure wider ASIC choices for CXL deployment, Seamless and easier CXL adoption without having to know DRAM, Choice of FFs Enriching the CXL Ecosystem with CZ120 Micron ISVs/SW Vendors
- 12. Micron Confidential Micron Confidential • Activities: Deep collaboration with Early Validation, Compliance Testing and Joint Validation • Objectives: : Mature CXL Test EcoSystem Enriching the CXL Ecosystem with CZ120 Micron Test Vendors
- 13. Micron Confidential Micron Confidential • Activities: Proof Points / POCs, Validation for different applications • Objectives: Identify pooling , fabric attached use cases Enriching the CXL Ecosystem with CZ120 Micron Switch & Composable Memory Vendors
- 14. Micron Confidential Micron Confidential Micron Confidential Micron Confidential Memory solutions to meet data center infrastructure demands HBM3 Gen2 24GB Micron Confidential 2023 2024 2025 2026 Bandwidth HBM3 Gen2 36GB HBM Next 36GB-64GB Prior Gen HBM 16GB GDDR6x 16Gb GDDR7 16-24Gb High capacity Power RDIMM Up to 96GB RDIMM,MRDIMM,CXL™ 128GB+ RDIMM, MRDIMM, CXL™ 192GB+ LPDRAM 0.3X energy/bit to RDIMM Not all Products are POR and shown for conceptual discussion purposes Left edge of bar denotes approximate availability, right edge does NOT represent End of Life RDIMM, MRDIMM, CXL™ 256GB+ Monolithic 32Gb, 128GB
Editor's Notes
- #15: Highlight Capacity on this slide or zoom in and dim down bandwidth and power a bit