《1A-202_advanced SmartNICFeatures Thanks to Programmable DPU-Kalray.PPTX》由会员分享,可在线阅读,更多相关《1A-202_advanced SmartNICFeatures Thanks to Programmable DPU-Kalray.PPTX(19页珍藏版)》请在三个皮匠报告上搜索。
1、SmartNIC Summit 2022-Kalray SA.-All Rights RGuru BachchuSW Applications EngineerADVANCED SMARTNIC FEATURESTHANKS TO PROGRAMMABLE DPUSSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.2ABSTRACTDuring the last several decades,the data center world has been moving to a“Software Defined Everything”par
2、adigm.This has been taken care of mostly by hypervisors running on the x86 up to recently.Using Data Processing Unit(DPU)technology can enhance a SmartNICs role in this SDx paradigm.By combining critical hardware offload capabilities with the adaptability of specialized processing cores,network and
3、storage features and services can be managed and configured to any data center need.In addition,a DPU based SmartNIC can offload most of the tasks x86 base processors inefficiently handle today,thereby giving billable CPU cycles back to the data center job manager.Security,configurability,availabili
4、ty,durability and performance can all become quality of service(QoS)options.To fully unlock the benefits of SmartNIC features while keeping the software defined paradigm,we believe a new kind of processor is needed:the Data Processing Unit,or DPU.SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.2
5、SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.3THE PRESENTERGuru BachchuSW Applications Engineer3Guru is an applications engineer at Kalray with 20+years of experience in SW engineering&applications development,writing software for Network Processors,ARM SoCs and Manycore Parallel Processers.C
6、urrently working on NVMe-oF/TCP storage solutions.Guru joined Kalray 3 years ago with the vision of using massively parallel processing to solve many of the current challenges of network and storage bandwidth and performance issues.SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.SmartNIC Summit
7、2022-Kalray SA.-All Rights Reserved.4ABOUT KALRAYIntelligent Data Processing,from Cloud to EdgeLEADER IN MANYCORE LEADER IN MANYCORE TECHNOLOGYTECHNOLOGYKalray offers a new type of processorprocessor(DPU)1 and solutions targeting the booming market of edge edge computing computing and fast fast data
8、 processingdata processingPublicly Traded Company(ALKAL)Founded in 2008 Support from European Govts Working with 500 fortune companies 3030Patent families+100m100mR&D investment3 3rdrdGeneration of MPPA processorA GLOBAL PRESENCEA GLOBAL PRESENCE1 Data Processing UnitINDUSTRIAL INVESTORSINDUSTRIAL I
9、NVESTORSSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.4SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.5Storage AppliancesPCIe Cards&Modules for Compute and Storage MPPA ProcessorsEDGE COMPUTING EDGE COMPUTING&5G&5GCompute&AI Intensive Workloads(Automotive,Industry 4.0,Smart City,Drones,Ro
10、bots)CLOUD AND CLOUD AND DATA CENTERSDATA CENTERSSolutions for Storage&NetworkingAutomotiveSmart CityIndustry 4.0Data center5GKALRAY OFFERIntelligent Data Processing,from Cloud to EdgeSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.5SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.6NVME-OF BA
11、CKGROUNDCONVERGES STORAGE AND NETWORKFIRST NVM EXPRESS FIRST NVM EXPRESS SPECIFICATION SPECIFICATION RELEASEDRELEASED Open logical device interface specification for accessing non-volatile storage attached via the PCIe bus Designed to capitalize on the low latency and internal parallelism of solid-s
12、tate storage devicesFIRST FIRST NVMNVMe e OVER OVER FABRICS FABRICS SPECIFICATION SPECIFICATION RELEASEDRELEASED Extends the NVMe command set using a transport protocol over a network NVMe/FC,NVMe/RoCE,NVMe/iWARP,NVMe/IB Enables the benefits of NVMe technology to be realized at a much larger scaleNV
13、MENVME/TCP/TCP SPECIFICATION SPECIFICATION RELEASEDRELEASED Allows NVMe usage using existing network infrastructure201120162018SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.7DPU DATA PROCESSING UNITWHAT IS A DPU?DPUCPUGPUNetworking:NFV,vSwitch,NAT,protocol offload Storage:NVMe-oF,compression,d
14、eduplication,encryption,computing Security:Firewall,encryption,Ipsec,A NEW CLASS OF PROGRAMMABLE PROCESSOR Specialized in running datacenter infrastructure servicesCPU,GPU DPUThe 3rd socket in data centers alongside CPUs and GPUsACCELERATIONAccelerates software-defined datacenter infrastructure serv
15、ices and more!SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.8 8SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.HOW DPUS ARE FORMULATEDMost Advanced DPU on the Market,Result of 10 Years of DevelopmentK A L R AY S M P PA3C O O L I D G E A few power-hungry RISC CPU cores CPU flexibility limit
16、ed to control plane Data plane is“hardwired”No new services/no possible evolution!U S U A L A P P R O A C HASICCPUcoreCPUcoreCPUcoreCPUcore Data Plane Control PlaneCPUcoreCPUcoreCPUcoreCPUcore 80 highly efficient VLIWindependent CPU cores,Gathered into 5 clusters,running at 1GHz,Connected to high-sp
17、eed fabrics&high-speed interfaces.Fully Programmable Control Plane/Mgt Plane Linux 16 cores Data Plane-64 cores Standard tool chain and software framework(e.g.SPDK,GCC)Power Efficiency20W TypHigh-speed I/O2x100Gbps,PCIeGen4,DDR4Top Performance,Any workload200KDMIPs,25TOPS,HW AccelerationsFunctional
18、Isolation&SafetySecure Islands,Encrypt/Decrypt,Secure BootSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.9KEY FEATURES FOR A DPU TO BE A SMARTNIC?Key FeaturesFULLYFULLYPROGRAMMABLEPROGRAMMABLE Management plane,control plane and data plane Qual
19、ity of Service decision making for networking and storage features Advanced programmable offloads from x86HIGH HIGH PERFORMANCE PCIPERFORMANCE PCIe e INTERFACEINTERFACE SR-IOV for virtualization support Gen4 bandwidth to fully utilize netword and offload capabilities Root Complex and P2P modes HIGH
20、HIGH PERFORMANCE PERFORMANCE NETWORK NETWORK INTERFACESINTERFACES Packet parsing/matching/dispatching RDMA support TCP acceleration(RSS,LRO,checksums,)TIGHTLY TIGHTLY COUPLED INLINE COUPLED INLINE ACCELERATORS ACCELERATORS Crypto accelerators(IPsec,TLS)Compression(storage)Data Encryption Erasure Cod
21、ingSECURITYSECURITYRoot of trust,secure boot,secure firmware upgradesDPUDPUPCIePCIeNetworkNetworkSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.10CURRENT SMARTNIC LANDSCAPENVIDIANVIDIABLUEFIELD 2BLUEFIELD 2 Essentially 8 x A72 ARM CPU+ConnectX6 DX NIC in the same die PCIe Gen4 x 16,2 x 100GbE B
22、ROADCOMBROADCOMSTINGRAY STINGRAY PS1100RPS1100R Essentially 8 x A72 ARM CPU+NetExtreme NIC in the same die PCIe Gen3,1 x 100GbEMARVELL MARVELL LIQUIDIOLIQUIDIO III III 24 x ARM CPUs PCIe GEN4 x 16,2 x 100GbE More targeted to SDN than SDSFUNGIBLE FUNGIBLE F1 DPUF1 DPU 52 x MIPS64 CPUs 4 x PCIe GEN4 x
23、 16,8 x 100GbEKALRAYKALRAYMPPAMPPA DPU DPU COOLIDGECOOLIDGESee next slide DPUDPUPENSANDOPENSANDODSC-200DSC-200 Arm CPUs for exception PCIe GEN4 x 16,2 x 100GbE Application specific processors SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.11KALRAY MPPA3 COOLIDGE:AN ADVANCED DPUKALRAYS MPPA3 COO
24、LIDGE 80 highly efficient VLIW independent CPU cores,gathered into 5 clusters,running at 1GHzPOWER EFFICIENCYPOWER EFFICIENCY20W TypHIGH-SPEED I/OHIGH-SPEED I/O2x100Gbps,PCIeGen4,DDR4FULLY PROGRAMMABLEFULLY PROGRAMMABLE Control&Mgmt Plane:16 cores SMP CPU running Linux Data Plane:64 cores running SP
25、DKTIGHTLY COUPLED TIGHTLY COUPLED ACCELERATORSACCELERATORS10 Crypto accelerators,Erasure coding acceleration,advanced programmable DMAsSECURITYSECURITYRoot of trust,secure boot,secure vaultSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.12D I R E C T-AT TA C H E D S S D sD I S A G G R E G AT E D
26、 S S D sUSE CASE#1A DPU SmartNIC Allows Storage DisaggregationUSE CASE#1 NVMe-oF SERVERS CAN BE COMPOSED ON-THE-FLY WITH JUST THE STORAGE REQUESTED WORKLOADS CAN MOVE AND RE-ATTACH TO THEIR VOLUMES SCALE STORAGE AND COMPUTE INDEPENDENTLY+DPU-based SmartNIC can perform ALL storage services-All storag
27、e devices appear as local devices-12nSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.13D I S A G G R E G AT E D S S D sNVMe-oFUSE CASE#2SmartNIC for Hyper-Scale InfrastructureUSE CASE#2 D I S A G G R E G AT E D S S D s W I T H S T O R A G E A D PAT E R SNVMe-oF ANY OS ON HOST SERVERS SUPPORTED E
28、NABLES BARE-METAL STORAGE VIRTUALIZATION ENABLES BOOT FROM NVMe-OF DISKS NETWORK AND STORAGE SERVICES ON INITIATOR SIDE OFFLOAD SERVER CPU+SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.14S TA N D A R D H C IUSE CASE#3SmartNIC for Hyper-Converged InfrastructureUSE CASE#3 PROVIDE A GLOBAL DATA S
29、TORE REPOSITORY ENABLES BARE-METAL STORAGE VIRTUALIZATION OFFLOAD DATA SERVICES FROM SERVER CPU+H C I W I T H S T O R A G E A D A P T E R SSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.15USE CASE#3Storage Adapter for Hyper-Converged Infrastructure USE CASE#3 THE DPU TAKES THE DPU TAKES OWNERSH
30、IP OF THE OWNERSHIP OF THE LOCAL DRIVES IN LOCAL DRIVES IN SERVERSERVER Using PCIe peer-to-peer technology.1.THE DPU PRESENTS THE DPU PRESENTS ITSELF AS LOCAL ITSELF AS LOCAL NVMNVMe e DISKS TO THE DISKS TO THE HOST SERVER HOST SERVER No requirement on the operating system or hypervisor that will be
31、 deployed on the bare-metal server.2.THE HOST SERVERS THE HOST SERVERS SEE A GLOBAL DATA SEE A GLOBAL DATA STORE STORE The global data store is made of all the drives of each HCI server.Each DPU acts as both a storage target and a storage initiator.Storage is fully virtualized without needing a hype
32、rvisor.The virtualization is fully SW defined.3.SmartNIC Summit 2022-Kalray SA.-All Rights Reserved.16DATA SERVICES ENABLED BY DPU SMARTNICBASICSERVICES Bare-metal storage virtualization NVMe emulation NVMe-oF target and initiator Networking stack and QoS Networking configuration fully SW definedDAT
33、AREDUCTION Compression De-duplication Zero-detection Data reduction on initiator side results in lower network bandwidth DATAAVAILABILITY Distributed Erasure Coding enables better reliability while improving storage efficiency Mapping of volumes fully SW defined Data availability algorithms on targe
34、t side improves network effeciency QoS defined auto-tiering DATASECURITY Encryption in motion transparent to the host server Security Configuration fully SW definedSmartNIC Summit 2022-Kalray SA.-All Rights Reserved.17CONCLUSIONA DPU based SmartNIC provides all the standard and advanced network func
35、tions and offloadsA DPU based SmartNIC offers all the standard Networking and Storage offloads in hardware where inline performance is critical A DPU based SmartNIC offers programmability to manage variable QoS requirements demanded by SDx.A DPU based SmartNIC can offload Computation Storage-like fu
36、nctions Building the Next Generation of Storage Solution With DPU technologySmartNIC Summit 2022-Kalray SA.-All Rights Reserved.17SmartNIC Summit 2022-Kalray SA.-All Rights RReferenceTHANK YOUGuru BSmartNIC Summit 2022-Kalray SA.-All Rights RDISCLAIMERKalray makes no guarantee about the accuracy of
37、the information contained in this document.It is intended for information purposes only and shall not be incorporated into any contract.It is not a commitment to deliver any material,code or functionality,and should not be relied upon in making purchasing decisions.The development,release and timing of any features or functionality described for Kalray products remains at the sole discretion of Kalray.Trademarks and logos used in this document are the properties of their respective