《SNIA-SDC23-Ahlvers-Comprehensive-SNIA-Swordfish-Overview.pdf》由会员分享,可在线阅读,更多相关《SNIA-SDC23-Ahlvers-Comprehensive-SNIA-Swordfish-Overview.pdf(40页珍藏版)》请在三个皮匠报告上搜索。
1、1|2023 SNIA.All Rights Reserved.Virtual ConferenceSeptember 28-29,2021Comprehensive SNIA Swordfish OverviewRichelle Ahlvers,Storage Technology Enablement Architect,IntelChair,SNIA SSM TWG and Storage Management Initiative2|2023 SNIA.All Rights Reserved.Abstract SNIA Swordfish provides a comprehensiv
2、e standards-based interface to manage scalable storage.This presentation provides a broad look at the Swordfish ReSTful hierarchies,maps these to some common applications,and provides an overview of the Swordfish tools and documentation ecosystem developed by SNIAs Scalable Storage Management Techni
3、cal Work Group(SSM TWG).It will also provide an overview added in the 1.2.5a release,including enhancements to metrics for volumes,drives,and storage controllers,as well as support for NVMe SMART Metrics,enhanced NVMe-oF discovery controller capabilities managing NVMe-oF centralized discovery contro
4、llers.The presentation will also provide pointers to get started working with Swordfish,as well as information on related programs,including the Swordfish Conformance Test Program.3|2023 SNIA.All Rights Reserved.About the PresenterRichelle is a Storage Technology Enablement Architect at Intel,where
5、she promotes and drives enablement of new technologies and standards strategies.Richelle has spent over 25 years in Enterprise R&D teams in a variety of technical roles,leading the architecture,design and development of storage array software,storage management software user experience projects incl
6、uding mobility,developing new storage industry categories including SAN management,storage grid and cloud,and storage technology portfolio solutions.Richelle has been engaged with industry standards initiatives for many years and is actively engaged with many groups supporting manageability includin
7、g SNIA,DMTF,NVMe,OFA and UCIe.She is Vice-Chair of the SNIA Board of Directors,Chair of the Storage Management Initiative,leads the SSM Technical Work Group developing the Swordfish Scalable Storage Management API,and has also served as the SNIA Technical Council Chair and been engaged across a brea
8、dth of technologies ranging from storage management,to solid state storage,to cloud,to green storage.She also serves on the DMTF Board of Directors as the VP of Finance and Treasurer.Richelle AhlversStorage Technology Enablement Architect,Intel4|2023 SNIA.All Rights Reserved.What are Redfish and Swo
9、rdfish?DMTF Redfish covers server,data center,basic fabric management REST API with JSON payloads;choice of CSDL,JSON and YAML schema for developmentSNIA Swordfish:Storage Management Specification with REST Based API extends DMTFs Redfish SpecificationSwordfish adds storage management to all of thes
10、e use cases,plus storage fabric management Covers block,file,and object storage Extend traditional storage domain coverage to include converged environments(servers,storage and fabric together)Provides the option for implementation to utilize Class of Service(intent or service level)based provisioni
11、ng,management,and monitoring NVMe/NVMe-oF devices(through an Alliance partnership with NVM Express and DMTF)Storage Fabric Management:An alliance partnership with OFA,DMTF is expanding support in RF/SF for fabrics and storage fabrics management in OFA Sunfish5|2023 SNIA.All Rights Reserved.Basic Red
12、fish Hierarchy/redfish/v1Logical ViewCollectionResourceSingletonResourceVolumesSubordinateResourceCollectionsService RootComputer SystemSingletonResource./SystemsSystems/ProcessorsProcessors/BMC./Managers/Management./ManagersPhysical ViewChassis./ChassisChassis/./EventService./AccountService./Sessio
13、nServiceRedfish services for account management,events,logs,tasks,session/certificates,etc.VolumesVolumesVolumesPowerVolumesThermalVolumesDrivesVolumes/Drives/6|2023 SNIA.All Rights Reserved.Building on the Redfish Hierarchy for Swordfish Advanced Storage/redfish/v1StorageCollectionCollectionResourc
14、eSingletonResourceVolumesSubordinateResourceCollectionsService RootSingletonResourceReference(link)to Volume./StorageStorage/VolumesVolumes/StoragePoolCollection./StoragePoolsStoragePools/SwordfishNVMeDrive,v1.0.0/redfish/v1/Registries/AdvertisedFeaturesFeatures Registry contains the published suppo
15、rted Features.Swordfish schema(Controllers,Volumes,StoragePools,etc)attach to storage./RegistriesChassisCollection./ChassisChassis/VolumesDrive InstanceDrivesDrives/StoragePoolCollectionVolume(Namespace)Instance./AllocatedVolumesAllocatedVolumes/./EventService./AccountService./SessionServiceStorageC
16、ontrollersCollection./ControllersControllers/Redfish services for account management,events,logs,tasks,session/certificates,etc.Drives contained in chassis,managed in storage pools.7|2023 SNIA.All Rights Reserved.Simple External Array(The Basics)Navigation Link(odata.id)singleton resourceSubordinate
17、 objectcollection resourceVolumesControllersArrayController1ServiceRootAccountServiceSessionServiceEventServiceUpdateServiceTelemetryServiceManagerBlockVolume1StorageExternalArrayNot in mockupsArrayController1ChassisDriveBayDrivesPowerAndThermalDrive1ThermalDrive2StoragePoolsPool1CapacitySourceSourc
18、e1AllocatedVolumesBlockVolume18|2023 SNIA.All Rights Reserved.Simple External Array(Adding Mapping)Navigation Link(odata.id)singleton resourceSubordinate objectcollection resourceVolumesControllersArrayController1ServiceRootAccountServiceSessionServiceEventServiceUpdateServiceTelemetryServiceManager
19、BlockVolume1StorageExternalArrayNot in mockupsArrayController1ChassisDriveBayDrivesPowerAndThermalDrive1ThermalDrive2StoragePoolsPool1CapacitySourceSource1AllocatedVolumesBlockVolume1FabricsDeviceConnectionsConnectionsEndpointsHost1ToVol1InitiatorEPTarget EP9|2023 SNIA.All Rights Reserved.NVMe Funct
20、ionality NVM Subsystem NVM Controllers(IO,admin,discovery)Namespaces Endurance groups NVM SetsSwordfish maps NVMe objects to existing RF/SF model NVMe DomainsCreates new objects where needed10|2023 SNIA.All Rights Reserved.NVMe Subsystem ModelRedfish/SwordfishNVMeNamespace(NVMe)Subsystem(NVMe)I/O Co
21、ntroller(NVMe)CapacityCapacity SourceSetDefault Set(0)Default Endurance GroupSetorNamespace(NVMe)Namespace(NVMe)Endurance GroupEndurance GroupStoragePoolStoragePoolStoragePoolStoragePoolVolumeAllocatedVolumesI/O Controller(NVMe)NVMe Chassis:Physical Device Information1.1ChassisM.1StorageStorageContr
22、ollerController(I/O)Drive(used for drive FRU)Admin ControllerLegend Equivalent objects Relationship in model Relationship in modelLink between objectsDiscovery ControllerController(Admin/Disc)CorrespondingRedfish/SwordfishBase storage model objectCorrespondingNVMe Object11|2023 SNIA.All Rights Reser
23、ved.Swordfish and NVMe:Basic Functionality/redfish/v1“Subsystem”CollectionCollectionResourceSingletonResourceVolumesSubordinateResourceCollectionsService RootSingletonResourceReference(link)to Namespace./StorageStorage/VolumesVolumes/NVMe PoolsCollectionEndurance Group,NVM Set./StoragePoolsStoragePo
24、ols/SwordfishNVMeDrive,v1.0.0SwordfishNVMeAdvancedFeatures,v1.0.0/redfish/v1/Registries/AdvertisedFeaturesFeatures Registry contains the published supported Features./RegistriesChassisCollection./ChassisChassis/DrivesDriveDrivesDrives/StoragePoolCollectionNamespace./AllocatedVolumesAllocatedVolumes/
25、./EventService./AccountService./SessionServiceNVMe Device Usage:Storage=SubsystemStorageController=NVMe Controllers(IO,Admin,Discovery)Volume=NamespaceStoragePool=Endurance Group/NVM SetChassis/Drive=Physical Entity InformationNVMe Controllers IO,Discovery,Admin./ControllersControllers/12|2023 SNIA.
26、All Rights Reserved.Adding Network and Fabric12Redfish/SwordfishNVMeFabricsEndpoints(Logical Port)ZonesConnections(Allowed Hosts)Subsystem ModelStorageControllerComputerSystem(Redfish)ControllerStorageSubsystem(NVMe)I/O Controller(NVMe)ConnectPCIe Root ComplexCapacityCapacity SourceSetDefault Set(0)
27、Default Endurance GroupSetorEndurance GroupEndurance GroupStoragePoolStoragePoolStoragePoolStoragePoolI/O Controller(NVMe)NVMe Chassis:Physical Device Information1.1ChassisNamespace(NVMe)Namespace(NVMe)Namespace(NVMe)VolumeVolumeHost ComputerSystem(Redfish)Host Connect:Fabric Connect(i.e.,Ethernet,F
28、C)NVMe-oF Model:Subsystem Target ViewDrive(used for drive FRU)Network AdapterNetworkPortNetwork Device FunctionSwitchesPortsCorrespondingRedfish/SwordfishNetwork model objectCorrespondingNVMe ObjectCorrespondingRedfish/SwordfishBase storage model objectCorrespondingRedfish/SwordfishFabric model obje
29、ct13|2023 SNIA.All Rights Reserved.Simple NVMe DriveNavigation Link(odata.id)singleton resourceSubordinate objectcollection resourceVolumesChassisSimplestNVMeSSDStorageSimplestNVMeSSDDrivesControllersNVMeIOControllerServiceRootAccountServiceSessionServiceEventServiceUpdateServiceTelemetryServiceMana
30、gerPowerAndThermalSimplestNVMeSSDSimpleNamespaceStorageSystemsSys-1SimplestNVMeSSDCorresponding Mockup:http:/simple-ssd- in mockupsThermal14|2023 SNIA.All Rights Reserved.AllocatedVolumesArray with NVMe Front-end,SAS Backend(Hybrid)Namespace1AllocatedVolumesNavigation Link(odata.id)singleton resourc
31、eSubordinate objectcollection resourceVolumesChassisEnclosureStorageNVM Subsystem-1DrivesControllersNVM IO Controller 1ServiceRootAccountServiceSessionServiceEventServiceUpdateServiceTelemetryServiceManagerPowerAndThermalSAS-1StoragePoolsStoragePool1Namespace-1CapacitySourceProvidingDrivesSAS-2SAS-3
32、SAS-4ModuleNVM IO Controller 2NVM Admin Controller Namespace-2Namespace-3Namespace-4Namespace2Namespace3Namespace4StoragePool2CapacitySourceProvidingDrivesCorresponding Mockup:http:/nvme-opaque-array- in mockups15|2023 SNIA.All Rights Reserved.Redfish/Swordfish Hierarchy:Managing Extended Connectivi
33、ty/redfish/v1CollectionCollectionResourceSingletonResourceVolumesService RootSingletonResourceReference(link)to Volume./StorageStorage/VolumesVolumes/Collection./StoragePoolsStoragePools/CollectionVolume(Namespace)Instance./AllocatedVolumesAllocatedVolumes/Fabric representation for connectivity:Swit
34、ch/Endpoint/ZoneStorageControllersCollection./ControllersControllers/Collection./FabricsFabrics/Collection./SwitchesSwitches/Collection./ZonesZones/Collection./EndpointsEndpoints/16|2023 SNIA.All Rights Reserved.Redfish/Swordfish Hierarchy:Adding Multi-System Access Management/redfish/v1CollectionCo
35、llectionResourceSingletonResourceVolumesSubordinateResourceCollectionsService RootSingletonResourceReference(link)to Volume./StorageStorage/VolumesVolumes/Collection./StoragePoolsStoragePools/CollectionVolume(Namespace)Instance./AllocatedVolumesAllocatedVolumes/Access ManagementConnections/Endpoints
36、StorageControllersCollection./ControllersControllers/Collection./FabricsFabrics/Collection./ConnectionsConnections/Collection./EndpointsEndpoints/17|2023 SNIA.All Rights Reserved.Developing the OpenFabrics Framework and Mapping to Redfish and Swordfish/redfish/v1CollectionCollectionResourceSingleton
37、ResourceVolumesService RootSingletonResourceReference(link)to Volume./StorageStorage/VolumesVolumes/Collection./StoragePoolsStoragePools/CollectionVolume(Namespace)Instance./AllocatedVolumesAllocatedVolumes/StorageControllersCollection./ControllersControllers/Collection./FabricsFabrics/Collection./S
38、witchesSwitches/Collection./ZonesZones/Collection./EndpointsEndpoints/OpenFabrics Management Framework18|2023 SNIA.All Rights Reserved.Sample NVMe-oF Instance19|2023 SNIA.All Rights Reserved.Whats New in 1.2.5a Expanding Functionality NVMe and NVMe-oF mapping expanded to align with NVMe 2.0cSupport
39、for NVMe Smart MetricsManagement of centralized discovery controllers Metrics for Volumes,Drives,and Storage Controllers Enhanced mapping and masking model20|2023 SNIA.All Rights Reserved.Adding MetricsNavigation Link(odata.id)singleton resourceSubordinate objectcollection resourceVolumesChassisSimp
40、lestNVMeSSDStorageSimplestNVMeSSDDrivesControllersNVMeIOControllerServiceRootAccountServiceSessionServiceEventServiceUpdateServiceTelemetryServiceManagerPowerAndThermalSimplestNVMeSSDSimpleNamespaceStorageSystemsSys-1SimplestNVMeSSDCorresponding Mockup:NVMe SMART Metrics MockupNot in mockupsThermalM
41、etricsMetricsMetrics21|2023 SNIA.All Rights Reserved.StorageControllerMetrics contains NVMeSmartMetricsSee example here:https:/simple-ssd-smart-metrics- SNIA.All Rights Reserved.Centralized Discovery ControllerA Centralized Discovery Controller aggregates discovery information from several NVMe stor
42、age systems to report discovery information for the full fabric.22Host AHost AHost NCentralized Discovery ControllerAggregated Discovery InformationNVMe Storage SystemNVMe Storage SystemNVMe Storage SystemNVMe Storage SystemNVMe Storage System23|2023 SNIA.All Rights Reserved.Discovery Controllers re
43、quire no configuration by the end user/client.So,we have created an extremely simplified,read-only model with information in two places:1.Subsystems.Subsystems have pointers to subsystems which contain discovery controllers 2.Discovery Controllers.Discovery controllers have pointers to the subsystem
44、s they have discoveredSwordfish Representation of Discovery ControllersNavigation Link(odata.id)singleton resourceSubordinate objectcollection resourceServiceRootStorageNVMe-1ControllersNVMeIO ControllerVolumesLogicalNamespace1Discovery ControllerNVMe-2NVMe-3ControllersNVMeIO ControllerVolumesLogica
45、lNamespace1ControllersNVMeIO ControllerVolumesLogicalNamespace124|2023 SNIA.All Rights Reserved.Mockup of Subsystem25|2023 SNIA.All Rights Reserved.Mockup of Discovery Controller26|2023 Storage Developer Conference.SNIA.All Rights Reserved.How to Demonstrate Conformance to Swordfish27|2023 SNIA.All
46、Rights Reserved.In the Service:Implement the Features Registry What are Features(or Supported Features)?Descriptions of functionality that an implementation is advertising that it supports.This corresponds to a detailed list of behaviors and properties defined in a profilehttps:/simple-ssd- SNIA.All
47、 Rights Reserved.Swordfish Features/Profiles Inheritance HierarchySwordfish DiscoverySwordfish Block ProvisioningSwordfishClass Of Service DiscoveryEvent NotificationLocal ReplicationRemote ReplicationCoS Local ReplicationCoS Remote ReplicationMapping and MaskingBlock IO PerformanceBlock Capacity Ma
48、nagementEnergyStar for StorageSwordfish File ProvisioningFile Capacity ManagementNVMe DriveNVMe Ethernet Attach DriveNVMe Advanced FeaturesNVMe Front-endNVMe EBOFConnectivity RightsConnectivity Rights for RDMAConnectivity Rights for EthernetPCIe JBOFAccess RightsAccess Rights for EthernetManagement
49、Controller29|2023 SNIA.All Rights Reserved.How CTP Works30|2023 SNIA.All Rights Reserved.Why Do SNIA Swordfish CTP?31|2023 SNIA.All Rights Reserved.CTP Logo and Version The CTP Program logos are numbered to correspond to the versions of Swordfish that the SSM TWG chooses to release as SNIA Standards
50、 Easy for clients to match your implementations with specifications Identifiable logos to use in marketing materials32|2023 SNIA.All Rights Reserved.Framework and Test Overview3233|2023 SNIA.All Rights Reserved.Test Framework The test framework leverages the“Redfish-Test-Framework”,an open source fr
51、amework from the Redfish Forum No need to learn complex setup:Framework is bundled with simple command-line interface specific to Swordfish Test early and often CTP supports checking compliance level using mockups Or,use an emulator as a test/development tool:Swordfish API Emulator enhanced to suppo
52、rt CTP compliance Enhancements(some work in progress,some TBD):SNIA authenticated self-run test result mechanism(e.g.,certificate based authentication for CTP members for submitted test results)34|2023 SNIA.All Rights Reserved.Test Results:Summary Results Available from Individual Test Runs Each run
53、 shows results of each test run Submit results when desired tests are passing Redfish service-level tests required Swordfish Discovery feature required From final/validated test results,these results will be transformed into results posted online at snia.org/ctp Results will be categorized as Base R
54、edfish,and by Swordfish Feature only“passed”features published35|2023 SNIA.All Rights Reserved.Test Results:Published ResultsFinal/validated test results will be posted online at snia.org/swordfish-ctp Results will be categorized as Base Redfish,and by Swordfish Feature Only“passed”features publishe
55、d36|2023 SNIA.All Rights Reserved.Service validator checks general conformance to schemaRedfish Service Tests37|2023 SNIA.All Rights Reserved.Descriptive messages show issues with any failures or warnings Additional log files available for more detailed reportingTroubleshooting from Test Results38|2
56、023 SNIA.All Rights Reserved.Each test run has parameters,system infoResults show PASS/FAIL for each item Individual Features Tests39|2023 SNIA.All Rights Reserved.Where to Find More InfoSNIA SwordfishSwordfish StandardsSchemas,Specs,Mockups,User and Practical Guides,https:/www.snia.org/swordfish Sw
57、ordfish Specification Forum Ask and answer questions about Swordfishhttp:/ Storage Management(SSM)TWGTechnical Work Group that defines SwordfishInfluence the next generation of the Swordfish standardJoin SNIA&participate:https:/www.snia.org/member_com/join-SNIA Join the SNIA Storage Management Initi
58、ativeUnifies the storage industry to develop and standardize interoperable storage management technologieshttps:/www.snia.org/forums/smi/about/join DMTF RedfishRedfish StandardsSpecifications,whitepapers,guides,https:/www.dmtf.org/standards/redfishOpen Fabric Management FrameworkOFMF Working Group(O
59、FMFWG)Description&Links https:/www.openfabrics.org/working-groups/OFMFWG mailing list subscriptionhttps:/lists.openfabrics.org/mailman/listinfo/ofmfwgJoin the Open Fabrics Alliancehttps:/www.openfabrics.org/membership-how-to-join/NVM ExpressSpecifications https:/nvmexpress.org/developers/Join:https:/nvmexpress.org/join-nvme/40|2023 SNIA.All Rights Reserved.Please take a moment to rate this session.Your feedback is important to us.