《HC2022.Juniper.ChangHong_Wu.v03.pdf》由会员分享,可在线阅读,更多相关《HC2022.Juniper.ChangHong_Wu.v03.pdf(27页珍藏版)》请在三个皮匠报告上搜索。
1、 2022 Juniper Networks1Juniper PublicRepresenting the Express 5 Development TeamHot Chips 2022Junipers Express 5:A 28.8Tbps Network Routing ASIC and VariationsChang-Hong Wu 2022 Juniper Networks2Juniper PublicThis presentation describes the intended capabilities of Junipers silicon.No commitment is
2、made or implied on delivering these features or products,which are subject to change at any time without notice.No purchasing decision should be made contingent upon Juniper Networks delivering any feature or functionality depicted in this presentation.Disclaimer 2022 Juniper Networks3Juniper Public
3、What is Express 5?2022 Juniper Networks4Juniper PublicRoutersSwitchesLayer 3 DevicesLayer 2 DevicesDeep Packet BuffersShallow Packet BuffersHigh Logical ScaleLow Logical Scale 2022 Juniper Networks5Juniper PublicJuniper Routing ASICsMultiple Packet Processing EnginesRun-to-CompletionFlexibility/Logi
4、cal Scale/ML EnabledProgrammable PipelineBandwidth and Energy EfficiencyTrio ASICs for MXExpress ASICs for PTXLatest generation:Trio 6Latest generation:Express 5 2022 Juniper Networks6Juniper PublicExpress 5 Goals 2022 Juniper Networks7Juniper PublicScale OutScale UpUsing Many Small-Form-Factor Syst
5、emsUsing Fewer Large Modular Systems 2022 Juniper Networks8Juniper PublicScale Out:Why 28.8Tbps Single ASIC for Express 5?And not 19.2Tbps36 Pluggable Optical Cages Fit in Standard 19 Racks36 x 800Gbps=28.8TbpsCommon Radix:32 or 36 2022 Juniper Networks9Juniper PublicScale Up:Modular ChassisBuilt us
6、ing internal fabricconnected componentsExample:16 Line Cards x 28.8Tbps per Line Card=460.8TbpsOr 4608 x 100GbE portsPFE ASICPFE ASICPortsLine CardFabric CardFabric ASICFabric ASICFabric ASICLine CardsFabric Cards(not visible in the back)2022 Juniper Networks10Juniper PublicPacketsPacketslightly loa
7、dedidlebusyFabric ASICFabric ASICFabric ASICFabric ASICPFE ASICPFE ASICPFE ASICPFE ASICPitfalls of Nave Packet-Based Fabric Design Ethernet devices for PFE and fabric Lack of speedup for scheduling Unbalanced distribution of flows Dramatically different sized packets Low utilization of links Low ene
8、rgy efficiency 2022 Juniper Networks11Juniper PublicPFE ASICPFE ASICPFE ASICPFE ASICFabric ASICFabric ASICFabric ASICFabric ASICPacketsPacketsExpress 5:Cell-Based Fabric Design Even spray of small cells High link utilization Resiliency:retransmit-on-error VoQ based fabric protocol Low-latency cell s
9、witching High energy efficiency Interoperable with previous generation line cards 2022 Juniper Networks12Juniper PublicExpress 5 Building Blocks 2022 Juniper Networks13Juniper PublicX-Chiplet:eXpress forwarding chiplet TSMC 7nm 59 billion transistors 3 billion bits of on-die SRAM Multiple HBM2e Inte
10、rfaces Multiple 112G Long Reach(LR)PAM4 SerDes Multiple 112G eXtreme Short Reach(XSR)PAM4 SerDes PCIe,Host Ethernet and other misc interfacesSharedForwarding TablesNetwork InterfacesOn-die PacketBufferPacket Forwarding PipelineIn-Package XSR InterfacesPacket ForwardingPipeline 2022 Juniper Networks1
11、4Juniper PublicF-Chiplet:Fabric interface/switching chiplet TSMC 7nm 35 billion transistors 0.29 billion bits of on-die SRAM Multiple 112G Long Reach(LR)PAM4 SerDes Multiple 112G eXtreme Short Reach(XSR)PAM4 SerDes PCIe and other misc interfacesIn-Package XSR InterfacesFabric InterfacesCore Switchin
12、g 2022 Juniper Networks15Juniper PublicWhy CEI-112G-XSR-PAM4 In-Package Interconnect?Low power and area efficient High bandwidth on organic substrate channels Standardized by OIF(proposed by Juniper&partners)Allows for future Co-Packaged Optics 2022 Juniper Networks16Juniper PublicExpress 5 ASIC Var
13、iations 2022 Juniper Networks17Juniper PublicASIC 1:28.8Tbps Network Routing Device 2 X-chiplets,connected through 112G-XSR interfaces,with 32Tbps of aggregate bandwidth 118 billion transistors,6 billion SRAM bits Multiple HBM2e stacks 2 silicon interposers,each 1.5x reticle size 85mm x 85mm organic
14、 substrate 6756 BGA balls,1mm pitch,square patterns Bare dies with stiffener ring 2022 Juniper Networks18Juniper PublicFeatures8M countersNative IPFIX exportInband Network Telemtry288 x 112G LR SerDes for36 x 800GbE or72 x 400GbE or144 x 200GbE or288 x 100GbE ormixture of portsUp to 10 billion packe
15、ts per secondSpeedScaleSecurityVisibility10+M entries Internet+sized routing tableUnified packet forwarding databaseMulti-dimensional scalingExtendable to HBMHigh performance/high capacity packet filtersIntegrated MACSec on all ports at line rateQoSFlexibilityHybrid on-die and HBM packet buffer Cong
16、ested queues to HBM HQoS supportProgrammable pipeline stagesNew protocol support including SRv6,BIER 2022 Juniper Networks19Juniper PublicPacket Forwarding PipelinesEthernetMACMACsecParserSource Lookup+Tunnel TerminationFilterDestLookupNext Hop ProcessorIngressRewriteFabricInterfaceFabricInterfacePa
17、rserDescriptorProcessorHeader BuildEgress Filterand RewriteMACsecEthernetMACIngressEgressTask Specific Microcode Programmable StagesP4 Runtime SupportShared Packet BufferUnified Packet Forwarding Database 2022 Juniper Networks20Juniper Public 1 X-chiplet and 1 F-chiplet,connected through 112G-XSR in
18、terfaces,with 32Tbps of aggregate BW Multiple HBM2e stacks 2 silicon interposers on an organic substrate 14.4Tbps of Ethernet ports Same packet-forwarding functionality 16Tbps cell-based VoQ fabric interconnect Forward Error Correction and retransmit-on-error for the fabric linksASIC 2:Line Card Pac
19、ket Forwarding Device with Fabric Interconnect 2022 Juniper Networks21Juniper PublicASICs 3 and 4:Cell-Based Fabric Switch Devices 16Tbps cell-based fabric switch ASICSingle F-chiplet 32Tbps cell-based fabric switch ASICDual F-chiplets connected by XSR 2022 Juniper Networks22Juniper PublicASIC 5:14.
20、4Tbps Network Routing Device 1 X-chiplet,multiple HBM2e stacks,1 silicon interposer 14.4Tbps of Ethernet ports 2022 Juniper Networks23Juniper PublicASICs 6 and 7:Networking Devices without HBM28.8Tbps of Ethernet ports2 X-chiplets,connected by XSR14.4Tbps of Ethernet ports1 X-chiplet 2022 Juniper Ne
21、tworks24Juniper PublicASIC 8:Future Integration of Co-Packaged Optics 2022 Juniper Networks25Juniper PublicSummary 2022 Juniper Networks26Juniper Public28.8Tbps Routing ASIC14.4Tbps(+16Tbps Fabric)Line Card PFE ASIC14.4Tbps Routing ASIC32Tbps Cell-Based Fabric Switch ASIC28.8Tbps Networking ASICw/o HBM14.4Tbps NetworkingASICw/o HBMScale OutScale UpExpress 5 High Bandwidth,High Scale,Programmable ASIC FamilyX-ChipletF-Chiplet16Tbps Cell-Based Fabric Switch ASICFuture CPO Integration 2022 Juniper Networks27Juniper PublicThank you