《SNIA-SDC23-Stenfort-NVM-Express-State-of-the-Union.pdf》由会员分享,可在线阅读,更多相关《SNIA-SDC23-Stenfort-NVM-Express-State-of-the-Union.pdf(33页珍藏版)》请在三个皮匠报告上搜索。
1、1|2023 SNIA.All Rights Reserved.Virtual ConferenceSeptember 28-29,2021NVM Express State of the Union and an overview of Live MigrationPresented byRoss Stenfort,MetaMike Allison,Samsung2|2023 SNIA.All Rights Reserved.Ross StenfortHardware Systems EngineerSpeakersMike AllisonSr.Director NAND Product P
2、lanning3|2023 SNIA.All Rights Reserved.NVMe Specifications The Language of StorageEnterprise SSD Capacity Shipment Forecast by InterfaceSource:IDC Worldwide Solid State Drive Forecast,2023-2027 Doc#US49401623,Apr 2023SASSATAPCIe/NVMeOther4|2023 SNIA.All Rights Reserved.NVMe Technology Powers the Con
3、nected UniversePetabytes20224202520262027Enterprise32,48342,97337,09448,60265,70182,499106,106Cloud73,19186,30753,53489,678128,164175,730237,949Client145,610157,304200,391274,530350,518437,054517,991Consumer Client Embedded Enterprise Cloud Source:Data and projections provided by Forward
4、Insights Q2235|2023 SNIA.All Rights Reserved.NVM Express OrganizationBoard of DirectorsChair:Amber HuffmanTreasurer:Curtis BallardSecretary:Dave LandsmanTechnical WorkgroupChair:Peter OnufrykMarketing WorkgroupChair:Cameron Brett,Kerry MunsonSUBGROUPSComputational StorageChairs:Kim Malone,Bill Marti
5、nFabric&Multi-Domain SubsystemChair:Fred Knight,Erik SmithManagement InterfaceChairs:Austin Bolen,John GeldmanInteroperability and ComplianceChair:Ryan HolmqvistErrataChair:Mike AllisonNVMe-oF BootChairs:Phil Cayton,Rob Davis,Doug Farley6|2023 SNIA.All Rights Reserved.Board of DirectorsElections occ
6、ur yearly7|2023 SNIA.All Rights Reserved.Organizational EnhancementsTooling Updates Zoom,Causeway,Bugzilla Website RedesignErrata TaskgroupSoftware Taskgroup Framework8|2023 SNIA.All Rights Reserved.Modernizing the NVM Express WebsiteRefreshed pagesUpdated user interfaceConsolidated&reorganized Spec
7、ificationsBlogs Webinars9|2023 SNIA.All Rights Reserved.Resources to Learn About NVMe Technology10|2023 SNIA.All Rights Reserved.NVMe 2.0 Family of SpecificationsNVMe 2.0 specifications were released on June 3,2021Refer to nvmexpress.org/developersNVMe Base SpecificationCommand SetSpecificationsTran
8、sportSpecificationsNVMe ManagementInterface SpecificationNVMe NVM Command Set SpecificationNVMe Zoned Namespace Command Set SpecificationNVMe over PCIeTransport SpecificationNVMe over RDMATransport SpecificationNVMe Key Value Command Set SpecificationNVMe over TCPTransport SpecificationNetwork Boot/
9、UEFI Specification11|2023 SNIA.All Rights Reserved.Activity Since Release of NVMe 2.0 Family of Specifications*New AuthorizedTechnical Proposals60RatifiedTechnical Proposals69Ratified ECNs13*Activity as of 7/28/202312|2023 SNIA.All Rights Reserved.NVMe Specifications Feature Roadmap202120222023Q2Q3Q
10、4Q1Q2Q3Q4Q1Q2Q3Q4Scalable ResourceManagementNVMe-oF Automated DiscoveryNetwork Boot/UEFIFlexible Data Placement(FDP)Key Per I/ODispersed NamespacesNVMe 2.0 Family of Specifications ReleasedRatified Feature(left edge indicates ratification quarter)Planned Feature(left edge indicates planned ratificat
11、ion quarter)Planned New Specification(left edge indicates planned ratification quarter)Ratified New Specification(left edge indicates planned ratification quarter)2024Q1Q2Q3Q4Computational ProgramsSubsystem Local MemoryLive Migration Cross Namespace Copy13|2023 SNIA.All Rights Reserved.Specification
12、 AdvancementsFlexible Data PlacementReducing Write AmplificationLive Migration new feature!Seamlessly Move Data across vMachinesNetwork Boot/UEFINew Network Storage FunctionalityComputational StorageExecuting Programs within a Device14|2021 Storage Developer Conference.Insert Company Name Here.All R
13、ights Reserved.NVMe Live Migration15|2023 SNIA.All Rights Reserved.BenefitsNVM Express is adding capabilities to allow host to manage the migrating VM from one NVM subsystem to a different NVM subsystem by supporting the migration of the controller being used by the VM which includes the attached na
14、mespaces and the controller state.Pre-Copy Phase Host ActionsRequests the controller to track LBA changes(dirty LBAs)of the attached namespacesMigrate the allocated LBAs of the attached namespaces Migrate the dirty LBAsHost may use a new mechanism to throttle commands processing by migrating control
15、ler to slow down changesStop-and-Copy Phase Host ActionsRequests the controller to pause causing all fetched commands to be completedMigrate any remaining dirty LBAsPost-Copy PhaseMigrate controller state Resume the migrated controller 16|2023 SNIA.All Rights Reserved.Building the Pieces TP4165 Trac
16、king LBA Allocation with GranularityReporting of allocated LBAs within a namespace for migrating a namespaceUsable in Snapshot use cases TP4159 PCIe Infrastructure for Live MigrationDeveloping the theory of operation A TPAR to:Support limit the BW and IOPS of a controller to allow slowing down of co
17、mmand processing on a migrating controller17|2023 SNIA.All Rights Reserved.Pre-Copy Phase StartNVMSubsystemTarget HostAdminHostControllerGControllerHNVMSubsystemSource HostAdminHostControllerXControllerYNamespace Source Admin Host initiates a migration of a controller by requesting to log LBA change
18、s(dirty LBAs)A Migration Queue is establishedStart Logging Controller YStart Logging Controller YMigrationQueueQueuesNamespaceAllocation MapNamespaceVM18|2023 SNIA.All Rights Reserved.Pre-Copy Phase StartNVMSubsystemTarget HostAdminHostControllerGControllerHNVMSubsystemSource HostAdminHostController
19、XControllerYNamespace Source Admin Host initiates a migration of a controller by requesting to log LBA changes(dirty LBAs)A Migration Queue is established The memory associated with the migrating VM can be moved anytime by the Source Admin HostMigrationQueueQueuesVMVMNamespaceAllocation MapNamespace
20、VMVM19|2023 SNIA.All Rights Reserved.Pre-Copy Phase Initial Namespace MigrationSource Admin Host issues Get LBA status command to obtain the allocated LBAsNVMSubsystemSource HostVMAdminHostControllerXControllerYNVMSubsystemTarget HostVMAdminHostControllerGControllerHNamespaceGet LBA StatusGet LBA St
21、atusQueuesNamespaceAllocation MapNamespaceMigrationQueue20|2023 SNIA.All Rights Reserved.Pre-Copy Phase Initial Namespace MigrationSource Admin Host issues Get LBA status command to obtain the allocated LBAs Controller returns a list of descriptors.Each descriptor indicates an LBA rangeNVMSubsystemS
22、ource HostVMAdminHostControllerXControllerYNVMSubsystemTarget HostVMAdminHostControllerGControllerHNamespaceQueuesNamespaceAllocation MapNamespaceMigrationQueueAllocatedLBA Ranges21|2023 SNIA.All Rights Reserved.Pre-Copy Phase Initial Namespace MigrationSource Admin Host issues Get LBA status comman
23、d to obtain the allocated LBAs Controller returns a list of descriptors.Each descriptor indicates an LBA range The Source Admin Host uses these LBA ranges to issue read commands to copy the allocated LBAs to the destinationNVMSubsystemSource HostVMAdminHostControllerXControllerYNVMSubsystemTarget Ho
24、stVMAdminHostControllerGControllerHNamespaceQueuesNamespaceAllocation MapNamespaceMigrationQueue22|2023 SNIA.All Rights Reserved.Pre-Copy Phase Migrating Controller ContinuesNVMSubsystemSource HostVMNamespaceAllocation MapAdmin HostControllerXControllerYNamespaceNVMSubsystemTarget HostVMAdmin HostCo
25、ntrollerGControllerHNamespaceNVMe commands that cause LBA changes to the namespace are logged in the Migration Queue Write commands LBA deallocation due to the Dataset Management commandWriteWriteLBAsMigrationQueueLBAsQueues23|2023 SNIA.All Rights Reserved.Stop-and-Copy Phase Pause Migrating Control
26、lerNVMSubsystemSource HostVMNamespace AAllocation MapAdminHostControllerXControllerYNVMSubsystemTarget HostVMAdminHostControllerGControllerHNamespaceANamespaceAfter coping the allocated LBAs to the destination,the Source Admin Host may migrate the dirty LBAsMigrationQueueLBAsVMQueuesLBAsLBAs24|2023
27、SNIA.All Rights Reserved.Stop-and-Copy Phase Pause Migrating ControllerNVMSubsystemSource HostVMNamespace AAllocation MapAdminHostControllerXControllerYNVMSubsystemTarget HostVMAdminHostControllerGControllerHNamespaceANamespaceAt some point the Source Admin Host pauses the VMIssues a command to Paus
28、e the migrating controller to have the controller:Stop fetching commands Complete all previously fetched commandsPausePauseControllerYMigrationQueueLBAsLBAsLBAsQueuesPause CQE25|2023 SNIA.All Rights Reserved.Stop-and-Copy Phase Finish MigratingNVMSubsystemSource HostVMNamespaceAllocation MapAdminHos
29、tControllerXControllerYNVMSubsystemTarget HostVMAdmin HostControllerGControllerHNamespaceNamespaceQueuesControllerYSource Host Completes migration of VMMigrationQueueLBAsLBAsLBAsQueues26|2023 SNIA.All Rights Reserved.Stop-and-Copy Phase Finish MigratingNVMSubsystemSource HostVMNamespaceAllocation Ma
30、pAdminHostControllerXControllerYNVMSubsystemTarget HostVMAdmin HostControllerGControllerHNamespaceNamespaceQueuesControllerYSource Host Completes migration of VM Completes Migration of namespace dirty LBAsMigrationQueueLBAsLBAsLBAsQueues27|2023 SNIA.All Rights Reserved.Post-copy Phase Migrate Contro
31、ller StateNVMSubsystemNVMSubsystemSource HostVMNamespaceAllocation MapAdminHostControllerXControllerYTarget HostVMAdminHostControllerGControllerHNamespaceNamespaceControllerYSource Admin Host Issuing command to get the migrating controller state and put that state into the destination controllerGet
32、StateSet StateSet StateGet StateQueuesQueues28|2023 SNIA.All Rights Reserved.Post-copy Phase Resuming Migrated Controller StateTarget HostVMNVMSubsystemSource HostVMNamespaceAllocation MapVMManagerControllerXControllerYNVMSubsystemVMManagerControllerGControllerHNamespaceNamespaceQueuesControllerYTar
33、get Admin Host Resume VM Issues a command to resume controller that was migratedResumeResumeQueues29|2023 SNIA.All Rights Reserved.Post-copy Phase Resuming Migrated Controller StateNVMSubsystemSource HostNamespaceAllocation MapVMManagerControllerXControllerYNVMSubsystemTarget HostVMVMManagerControll
34、erGControllerHNamespaceNamespaceQueuesTarget Admin Host Resume VM Issues a command to resume controller that was migratedSource Admin Host Remove VM Reset the migrated controllerVM30|2023 SNIA.All Rights Reserved.Building the Pieces TP4165 Tracking LBA Allocation with GranularityReporting of allocat
35、ed LBAs within a namespace for migrating a namespaceUsable in Snapshot use cases TP4159 PCIe Infrastructure for Live MigrationDeveloping the theory of operation A TPAR to:Support limit the BW and IOPS of a controller to allow slowing down of command processing on a migrating controller31|2023 SNIA.All Rights Reserved.The Union is Strong and Delivering Value!32|2023 SNIA.All Rights Reserved.Architected for Performance33|2023 SNIA.All Rights Reserved.Please take a moment to rate this session.Your feedback is important to us.