《通过以服务为中心的故障排除方法缩短问题解决时间.pdf》由会员分享,可在线阅读,更多相关《通过以服务为中心的故障排除方法缩短问题解决时间.pdf(63页珍藏版)》请在三个皮匠报告上搜索。
1、#CiscoLive#CiscoLivePaola Arosio,MIG Product Manager Leaderarosio_paolaBRKSPG-2474Reduce resolution time with a service-centric approach to troubleshooting 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveEnter your personal notes hereCisco Webex App Questions?Use Cisco Web
2、ex App to chat with the speaker after the sessionFind this session in the Cisco Live Mobile AppClick“Join the Discussion”Install the Webex App or go directly to the Webex spaceEnter messages/questions in the Webex spaceHowWebex spaces will be moderated by the speaker until June 9,2023.12343https:/ 2
3、023 Cisco and/or its affiliates.All rights reserved.Cisco PublicBRKSPG-24743Agenda 2023 Cisco and/or its affiliates.All rights reserved.Cisco PublicToday,Operator ChallengesThe Concept of Heuristic PackageCodify Know HowThe Operator ExperienceKnow How ExtensionConclusionBRKSPG-24744 2023 Cisco and/o
4、r its affiliates.All rights reserved.Cisco Public#CiscoLiveOperational Challenges in Numbers*Forrester ResearchesBRKSPG-2474574%74%80%80%30%30%VISIBILITY/AGILITYCUSTOMER EXPERIENCEPRODUCTIVITY*MTTI/MTTK*MTTI/MTTK*Issue found*Issue found by endby end-useruserRepetitive Repetitive IssuesIssues 2023 Ci
5、sco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveVISIBILITY/AGILITY Challenge 80%80%VISIBILITY/AGILITYMTTI/MTTKMTTI/MTTKBRKSPG-2474680%80%VISIBILITY/AGILITYMTTI/MTTKMTTI/MTTKIS MY SERVICE HEALTY?IS MY SERVICE HEALTY?IP Service 2023 Cisco and/or its affiliates.All rights reserved.C
6、isco Public#CiscoLiveCUSTOMER EXPERIENCE Challenge BRKSPG-2474774%74%Issue found Issue found by endby end-useruserCUSTOMER EXPERIENCEIS MY SERVICE IS MY SERVICE MEETING SLA?MEETING SLA?2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLivePRODUCTIVITY Challenge 30%30%PRODUCTIVIT
7、YRepetitive Repetitive IssuesIssuesBRKSPG-2474830%30%PRODUCTIVITYRepetitive Repetitive IssuesIssuesIP ServiceSERVICE IS DEGRADING.WHEREWHERE IS THE PROBLEM?2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveCrosswork Automated Assurance Use Cases Know your Customer Personas:R
8、ole and Know-How its differentBRKSPG-24749Domain ControllerDomain ControllerFirst Level Service OperationCenterSecond Level Network OperationCenterDomain SMEIs the service degrading?degrading?Is the service meeting SLAs?SLAs?Service is DEGRADING!WHERE WHERE is the problem and WHYWHY?I see a congesti
9、on in the network,WHATWHAT is the cause?Is the infrastructure OPERATINGOPERATINGaccording to planned performance objectives?QUESTIONS TO ANSWERQUESTIONS TO ANSWERServices&SLA Services&SLA DashboardDashboardHierarchical Hierarchical ControllerControllerDomain ControllerDomain ControllerDomain Control
10、lerDomain ControllerAGILITY/AGILITY/VISIBILITYVISIBILITYCUSTOMERCUSTOMEREXPERIENCEEXPERIENCEPRODUCTIVITYPRODUCTIVITY 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveA Different Approach is Needed BRKSPG-247410EndEnd-toto-endend service visibilityBridgeBridge customer exper
11、ience to network healthExpedite MTTIMTTI/MTTK/MTTKVisibilityVisibilityInsightInsightActionAction1 12 23 3Service centric operationsDynamically tietie Intent to telemetryCapture knowledge to automatetroubleshootingRequirementRequirementHowHowChallengeChallenge1 12 23 3Is my Service Healthy?Is Service
12、 meeting SLA?Service is degrading!Where is the problem?IP ServiceIP ServiceThe Concept of Heuristic Package 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveService Health-IETF Architecture DraftIETF:Service Assurance for Intent based Networking Architecture12BRKSPG-2474If
13、the service is broken or degraded,WHERE and WHYWHERE and WHY?If a network component is degrading/failing WHICH WHICH are the services impacted?IP ServiceStart from the definition of the services andTie Health across the layersService Centric Approach Monitor only network component that can influence
14、 the service health stateDynamically Tie Intent to TelemetryDynamically Tie Intent to TelemetryCodify networking troubleshooting Know-How to automateAutomate TroubleshootingAutomate TroubleshootingIntent-Based Network AssuranceIntent-Based Network ProvisioningInfrastructureHealthTransportHealthEnd t
15、o End Probing 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveWhat is the Heuristic Package?BRKSPG-247413The Heuristic Package tie intent to telemetryA subservice focuses on a specific feature or sub-part of the network system.Heuristic Package matches to a specific servic
16、e type.Expression encodes logic to deduce the health status of subservice from the collected metrics.Each devicedevice-independent metric independent metric used in the sub-services maps to a list of devicedevice-specific metric specific metric implementations(YANG path,SNMP Object or CLI command)th
17、at precisely define how to fetch values for that metric.Service Intent and Device ConfigurationServicesSubservicesExpressionsMetric 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveFrom Heuristic Package to Assurance GraphBRKSPG-247414Service Type and Device ConfigINTENTL2
18、VPNPath ReachabilityFallback Path HeathSR-TE/RSVP HealthPath SLAY.1731 Probe HealthVPWS CtrlPlane HealthPCEPSession HealthVPN If HealthEVPN HealthDevice HealthBGP Nbr HealthBGP NextHop HealthRULESAssurance GraphService Intent and Device ConfigurationServicesSubservicesExpressionsMetric Codify Know H
19、ow 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveTroubleshooting a L2 VPNL2 VPNPath ReachabilityFallback Path HeathSR-TE/RSVP HealthPath SLAY.1731 Probe HealthVPWS CtrlPlane HealthPCEPSession HealthVPN If HealthEVPN HealthDevice HealthBGP Nbr HealthBGP NextHop HealthIP R
20、eachabilityBRKSPG-247416 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveCheck Service StatusRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show l2vpn xconnect Fri Feb 12 19:10:32.844 EST Legend:ST=State,UP=Up,DN=Down,AD=Admin Down,UR=Unresolved,SB=Standby,SR=Standby Ready,(PP)=Partially
21、 Programmed XConnect Segment 1 Segment 2 Group Name ST Description ST Description ST-l2vpn-xc-2601 p2p-2601 UP Te0/0/0/2.2601 UP EVPN 2601,2,10.255.255.103 UP-RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#*This need to be done on both PEsIf the Status is DOWNthen we need to further check possible causes:The Attac
22、hment Circuit interface could be DOWNThe Control Plane info from remote PE could be DOWNPossible Crossconnect issues on Local-PEBRKSPG-247417 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveCheck Attachment Circuit StatusRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show int Ten0/0/0/2.
23、2601 Fri Feb 12 19:21:16.351 EST TenGigE0/0/0/2.2601 is up,line protocol is up Interface state transitions:3 Hardware is VLAN sub-interface(s),address is 008a.966e.6808 Description:L2VPN-Dynamic-02 Layer 2 Transport Mode MTU 1518 bytes,BW 10000000 Kbit(Max:10000000 Kbit)reliability Unknown,txload Un
24、known,rxload Unknown Encapsulation 802.1Q Virtual LAN,Outer Match:Dot1Q VLAN 2601 Ethertype Any,MAC Match src any,dest any loopback not set,Last link flapped 00:00:14 Last input never,output never Last clearing of show interface counters never 0 packets input,0 bytes 0 input drops,0 queue drops,0 in
25、put errors 0 packets output,0 bytes 0 output drops,0 queue drops,0 output errors RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#Check Attachment Circuit sub-interface,and if DOWN check also the Interface.If Interface is DOWN possible causes are:Admin shut down Fiber or Cable issuesRemote switch/optical shut downBR
26、KSPG-247418 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveCheck EVPN Control PlaneDiscover BGP identity19BRKSPG-2474RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show bgp l2vpn evpn summary Fri Feb 12 19:24:35.296 EST BGP router identifier 10.255.255.102,local AS number 65001 BGP gene
27、ric scan interval 60 secs Non-stop routing is enabled BGP table state:Active Table ID:0 x0 RD version:0 BGP main routing table version 819 BGP NSR Initial initsync version 1(Reached)BGP NSR/ISSU Sync-Group versions 0/0 BGP scan interval 60 secs BGP is operating in STANDALONE mode.Process RcvTblVer b
28、RIB/RIB LabelVer ImportVer SendTblVer StandbyVer Speaker 819 819 819 819 819 0 Neighbor Status Codes:m-Under graceful maintenance Neighbor Spk AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down St/PfxRcd 10.255.255.143 0 65001 101083 101065 819 0 0 3d23h 1RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#Possible value for S
29、t/PfxRcd:Not a number but something like Activeor Idle,then BGP session to the Route Reflector is not UP.PfxRcd is 0(from EVPN Router Reflector)then session is fine,but we did not get any EVPN route.Normally redundant RRs are deployed so we need to get non-zero routes from at-least one RR.PfxRcd is
30、notnot 0 then we look at all routes with Route Distinguisher our BGP ID and EVI(EVPN instance ID)specified for this service instance.Any neighbors shown,means that there is no single active BGP session to a EVPN Route Reflector.2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoL
31、iveRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show bgp l2vpn evpn rd 10.255.255.102:2601 Fri Feb 12 19:26:15.451 EST BGP router identifier 10.255.255.102,local AS number 65001 BGP generic scan interval 60 secs Non-stop routing is enabled BGP table state:Active Table ID:0 x0 RD version:0 BGP main routing table
32、version 819 BGP NSR Initial initsync version 1(Reached)BGP NSR/ISSU Sync-Group versions 0/0 BGP scan interval 60 secs Status codes:s suppressed,d damped,h history,*valid,best i-internal,r RIB-failure,S stale,N Nexthop-discard Origin codes:i-IGP,e-EGP,?-incomplete Network Next Hop Metric LocPrf Weigh
33、t Path Route Distinguisher:10.255.255.102:2601(default for vrf VPWS:2601)*10000.0000.0000.0000.00001/120 0.0.0.0 0 i*i10000.0000.0000.0000.00002/120 10.255.255.103 100 0 i Processed 2 prefixes,2 paths RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#Remote-PEWe have a remote-PE advertising auto discovery EVPN route
34、for this service instance(EVI=2601)Check EVPN Control Plane(PfxRcd not 0)Check Route Distinguisher with BGP ID and EVI of ServiceBRKSPG-247420 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show bgp l2vpn evpn rd 10.255.255.102:2601 10000.0
35、000.0000.0000.00001/1$Sat Feb 13 11:37:42.301 ESTBGP routing table entry for 10000.0000.0000.0000.00001/120,Route Distinguisher:10.255.255.102:2601Versions:Process bRIB/RIB SendTblVerSpeaker 819 819Local Label:24011(no rewrite);Flags:0 x00040001+0 x00000000;Last Modified:Feb 12 19:21:02.678 for 16:1
36、6:39Paths:(1 available,best#1)Advertised to peers(in unique update groups):10.255.255.143 Path#1:Received by speaker 0Flags:0 x402002000504000b,import:0 x00,EVPN:0 x0Advertised to peers(in unique update groups):10.255.255.143 Local0.0.0.0 from 0.0.0.0(10.255.255.102)Origin IGP,localpref 100,valid,re
37、distributed,best,group-best,import-candidate,rib-installReceived Path ID 0,Local Path ID 1,version 819This is what local-PE is sending to Remote-PE seen on local-PE sideCheck EVPN Control Plane(PfxRcd not 0)Check Route Distinguisher with BGP ID and EVI of Service Local-PEBRKSPG-247421 2023 Cisco and
38、/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRP/0/RP0/CPU0:vtstmesr1-ncs5k-3#show bgp l2vpn evpn rd 10.255.255.103:2601 10000.0000.0000.0000.00001/120 detailSat Feb 13 11:40:44.430 ESTBGP routing table entry for 10000.0000.0000.0000.00001/120,Route Distinguisher:10.255.255.103:2601Ve
39、rsions:Process bRIB/RIB SendTblVerSpeaker 489 489Flags:0 x00001001+0 x00000000;Last Modified:Feb 12 19:21:02.754 for 16:19:41Paths:(1 available,best#1)Not advertised to any peerPath#1:Received by speaker 0Flags:0 x4000020005060005,import:0 x80,EVPN:0 x0Not advertised to any peerLocal10.255.255.102(m
40、etric 30)from 10.255.255.143(10.255.255.102)Received Label 24011 Origin IGP,localpref 100,valid,internal,best,group-best,import-candidate,imported,rib-installReceived Path ID 0,Local Path ID 1,version 489Extended community:RT:65001:2601 Originator:10.255.255.102,Cluster list:10.255.255.143Source AFI
41、:L2VPN EVPN,Source VRF:default,Source Route Distinguisher:10.255.255.102:2601RP/0/RP0/CPU0:vtstmesr1-ncs5k-3#This is what Remote PE is getting for the above route.Check EVPN Control Plane(PfxRcd not 0)Check Route Distinguisher with BGP ID and EVI of Service Remote-PE(1)BRKSPG-247422 2023 Cisco and/o
42、r its affiliates.All rights reserved.Cisco Public#CiscoLiveRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show bgp l2vpn evpn rd 10.255.255.102:2601 10000.0000.0000.0000.00002/120 detailSat Feb 13 11:43:25.513 ESTBGP routing table entry for 10000.0000.0000.0000.00002/120,Route Distinguisher:10.255.255.102:2601Vers
43、ions:Process bRIB/RIB SendTblVerSpeaker 817 817Flags:0 x00001001+0 x00000000;Last Modified:Feb 12 19:04:53.678 for 16:38:32Paths:(1 available,best#1)Not advertised to any peerPath#1:Received by speaker 0Flags:0 x4000020005060005,import:0 x80,EVPN:0 x0Not advertised to any peerLocal10.255.255.103(met
44、ric 30)from 10.255.255.143(10.255.255.103)Received Label 24005 Origin IGP,localpref 100,valid,internal,best,group-best,import-candidate,imported,rib-installReceived Path ID 0,Local Path ID 1,version 817Extended community:RT:65001:2601 Originator:10.255.255.103,Cluster list:10.255.255.143Source AFI:L
45、2VPN EVPN,Source VRF:default,Source Route Distinguisher:10.255.255.103:2601RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#This is what local-PE is getting from remotePE(for other direction)Check EVPN Control Plane(PfxRcd not 0)Check Route Distinguisher with BGP ID and EVI of Service Local-PE(2)BRKSPG-247423 2023 C
46、isco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show l2vpn xconnect detail Fri Feb 12 19:32:32.803 ESTGroup l2vpn-xc-2601,XC p2p-2601,state is up;Interworking noneAC:TenGigE0/0/0/2.2601,state is upType VLAN;Num Ranges:1Rewrite Tags:VLAN ranges:260
47、1,2601MTU 1504;XC ID 0 x1;interworking noneStatistics:packets:received 0,sent 0bytes:received 0,sent 0drops:illegal VLAN 0,illegal length 0EVPN:neighbor 10.255.255.103,PW ID:evi 2601,ac-id 2,state is up(established)XC ID 0 xc0000001Encapsulation MPLSSource address 10.255.255.102Encap type Ethernet,c
48、ontrol word enabledSequencing not setPreferred path Active:SR TE srte_c_2002_ep_10.255.255.103,Statically configured,fallback disabledTunnel:UpEVPN Local Remote -Label 24011 24005 MTU 1504 1504 Control word enabled Encamp AC ID 1 2 EVPN type Ethernet Encamp -Create time:12/02/2021 19:04:51(00:27:41
49、ago)Last time status changed:12/02/2021 19:21:02(00:11:30 ago)Last time PW went down:12/02/2021 19:14:58(00:17:34 ago)Statistics:packets:received 0,sent 0bytes:received 0,sent 0RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#The service labels are shown which should be as learned from BGP EVPN in previous step.Data
50、 Plane TroubleshootingIs traffic going via SRTE or IGP path?BRKSPG-247424 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show l2vpn forwarding interface tenGigE 0/0/0/2.2601 detail location 0/0/CPU$Fri Feb 12 19:38:54.984 ESTLocal interface
51、:TenGigE0/0/0/2.2601,Xconnect id:0 x1,Status:upSegment 1AC,TenGigE0/0/0/2.2601,status:BoundStatistics:packets:received 0,sent 0bytes:received 0,sent 0packets dropped:PLU 0,tail 0bytes dropped:PLU 0,tail 0Segment 2MPLS,Tunnel interface:srte_c_2002_ep_10.255.255.103,status:BoundLocal Pseudowire label:
52、24011Remote Pseudowire label:24005Control word enabledStatistics:packets:received 0,sent 0bytes:received 0,sent 0packets dropped:PLU 0,tail 0,out of order 0bytes dropped:PLU 0,tail 0,out of order 0RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#Check Packet countersCheck StatisticsCheck Packet counters on the servi
53、ce and service labelsBRKSPG-247425 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show segment-routing traffic-eng policy name srte_c_2002_ep_10.255.255.103 Fri Feb 12 19:41:01.871 ESTSR-TE policy database-Color:2002,End-point:10.255.255.10
54、3Name:srte_c_2002_ep_10.255.255.103Status:Admin:up Operational:up for 00:40:51(since Feb 12 19:00:10.611)Candidate-paths:Preference:101(configuration)(active)Name:srte_c_2002_ep_10.255.255.103Requested BSID:dynamicPCC info:Symbolic name:cfg_srte_c_2002_ep_10.255.255.103_discr_101PLSP-ID:1Dynamic(pce
55、 10.255.255.141)(valid)Metric Type:TE,Path Accumulated Metric:30 24002 Adjacency-SID,10.102.141.1-10.102.141.224000 Adjacency-SID,10.141.143.1-10.141.143.224000 Adjacency-SID,10.103.143.2-10.103.143.1Attributes:Binding SID:24010Forward Class:Not ConfiguredSteering BGP disabled:noIPv6 caps enable:yes
56、RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#Since the service is bound to a SRTE Policy,check the SR TE Policy Check SR-TE HealthBRKSPG-247426 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show segment-routing traffic-eng forwarding policy name srte_c
57、_2002_ep_10.255.$Fri Feb 12 19:42:45.899 ESTSR-TE Policy Forwarding database-Color:2002,End-point:10.255.255.103Name:srte_c_2002_ep_10.255.255.103Binding SID:24010Active LSP:Candidate path:Preference:101(configuration)Name:srte_c_2002_ep_10.255.255.103Local label:24009Segment lists:SL0:Name:dynamicP
58、ackets/Bytes Switched:0/0Paths:Path0:Outgoing Label:24000Outgoing Interface:TenGigE0/0/0/1Next Hop:10.102.141.2Switched Packets/Bytes:0/0FRR Pure Backup:NoECMP/LFA Backup:NoLabel Stack(Top-Bottom):24000,24000 Path1:Outgoing Label:16141Outgoing Interface:TenGigE0/0/0/47Next Hop:10.101.102.1Switched P
59、ackets/Bytes:0/0FRR Pure Backup:YesECMP/LFA Backup:NoLabel Stack(Top-Bottom):16141,24000,24000 Policy Packets/Bytes Switched:0/0RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#Check the packet counters on the policy,and verify if it is going through desired path or is it via Loop Free Alternate path(LFA)Check SR-TE
60、 HealthBRKSPG-247427 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveCheck SR-TE HealthCheck FallbackRP/0/RP0/CPU0:vtstmesr1-ncs5k-2#show route 10.255.255.103Fri Feb 12 19:48:23.330 ESTRouting entry for 10.255.255.103/32Known via isis site1,distance 115,metric 30,labeled S
61、R,type level-2Installed Feb 9 23:00:06.797 for 2d20hRouting Descriptor Blocks10.101.102.1,from 10.255.255.103,via TenGigE0/0/0/47,Backup(Local-LFA)Route metric is 4010.102.141.2,from 10.255.255.103,via TenGigE0/0/0/1,ProtectedRoute metric is 30No advertising protos.RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#sh
62、ow cef 10.255.255.103Fri Feb 12 19:48:30.033 EST10.255.255.103/32,version 5610,labeled SR,internal 0 x1000001 0 x83(ptr 0 x97dbf268)1,0 x0(0 x97f83f68),0 xa28(0 x98f8e768)Updated Feb 9 23:00:06.801 local adjacency 10.102.141.2Prefix Len 32,traffic index 0,precedence n/a,priority 1via 10.101.102.1/32
63、,TenGigE0/0/0/47,16 dependencies,weight 0,class 0,backup(Local-LFA)flags 0 x300path-idx 0 NHID 0 x0 0 x98e239b0 0 x0next hop 10.101.102.1/32local adjacencylocal label 16103 labels imposed 16103via 10.102.141.2/32,TenGigE0/0/0/1,8 dependencies,weight 0,class 0,protected flags 0 x400path-idx 1 bkup-id
64、x 0 NHID 0 x0 0 x9966db30 0 x0next hop 10.102.141.2/32local label 16103 labels imposed 16103RP/0/RP0/CPU0:vtstmesr1-ncs5k-2#If Fallback is enabled Check RIB(Routing information Base)and FIB(forwarding information base)BRKSPG-247428 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#Ci
65、scoLiveHeuristic Package=Codify Know-HowHeuristic Package codify the troubleshooting“Know How”.SubSub-service service definitiondefinitionMetric Metric EngineEngineConfig.Config.ProfilesProfiles.so that all the manual tasks can be automated!RulesRulesBRKSPG-247429 2023 Cisco and/or its affiliates.Al
66、l rights reserved.Cisco Public#CiscoLiveHeuristic Package=Codify Know-HowRules:Define“what to monitor”Capture the assurance schema that applies to a specific type(s)of services:what are the subservices to be created,their payload and their dependency relationship.This schema gets applied to dynamica
67、lly discovered service instances to generate their respective Service Assurance Graphs.RulesRulesL2 Point2Point VPN Health Status depends:Connectivity between the VPN endpoints A&BTranslates to Subservice called XconnectHealth:A-BHealth status of each endpoint devices A&BTranslates to 2 Subservices
68、DeviceHealthA&DeviceHealthBPayload is Device Name for each end pointRule ExampleL2 VPNPath ReachabilityPath SLAVPWS CtrlPlane HealthPCEPSession HealthBRKSPG-247430 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveCodify Know How=Heuristic PackageRules:Define“what to monitor
69、”and Model it in an Assurance GraphService Type and Device ConfigINTENTRULESL2 VPNPath ReachabilityFallback Path HeathSR-TE/RSVP HealthPath SLAY.1731 Probe HealthVPWS CtrlPlane HealthPCEPSession HealthVPN If HealthEVPN HealthDevice HealthBGP Nbr HealthBGP NextHop HealthIP ReachabilityBRKSPG-247431 2
70、023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHeuristic Package=Codify Know-HowConfiguration Profiles:Define ThresholdsCapture the thresholds against which I want to monitor the services and sub-services.To the operator we are exposing only the thresholds related to the s
71、ervice intent.Config.Config.ProfilesProfilesMEMFREE_THRESHOLD_MINDescription:Threshold for minimum free memory to be available on the deviceType:VAL_FLOAT floatVal 2Unit:GBVal:10 Thresholds ExampleL2 VPNPath ReachabilityPath SLAVPWS CtrlPlane HealthPCEPSession HealthBRKSPG-247432 2023 Cisco and/or i
72、ts affiliates.All rights reserved.Cisco Public#CiscoLiveHeuristic Package=Codify Know-HowSub-service definition-DependenciesSubservice definition will specify the underlying Metrics and details about how the health status for that subservice needs to be computed.Subservice Fields includes:Dependenci
73、es:Dependencies:List of Subservices and/or Metric Instances,Soft/Hard DependencySubservice Eval Expression:Subservice Eval Expression:How to derive the health status Symptoms:Symptoms:Subservice evaluates underlying metrics and subservices and records symptoms when prescribed expression is violated.
74、SubSub-service service definitiondefinitionL2 VPNSubserviceClass/subserviceVpwsCpHealth.json:Checks whether XConnect is up(Checks for both AC and EVPN segment status)Supporting Metrics:-MetricClass/metricXConnectState.json-MetricClass/metricXConnectAcState.json-MetricClass/metricXConnectEvpnState.js
75、onDependenciesVPWS CtrlPlane HealthVPN If HealthEVPN HealthDevice HealthBGP Nbr HealthIP ReachabilityBGP NextHop HealthBRKSPG-247433 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHeuristic Package=Codify Know-HowSub-service definition Subservices Eval ExpressionSubservic
76、e definition will specify the underlying Metrics and details about how the health status for that subservice needs to be computed.Subservice Fields includes:Dependencies:Dependencies:List of Subservices and/or Metric Instances,Soft/Hard DependencySubservice Eval Expression:Subservice Eval Expression
77、:How to derive the health status Symptoms:Symptoms:Subservice evaluates underlying metrics and subservices and records symptoms when prescribed expression is violated.SubSub-service service definitiondefinitionrootExpressions:cpu_healthy&memory_healthy,dependencies:type:DEP_TYPE_EXPRESSION,label:cpu
78、_healthy,eval_expression:cpu_load 1000“Eval ExpressionL2 VPNVPWS CtrlPlane HealthVPN If HealthEVPN HealthDevice HealthBGP Nbr HealthIP ReachabilityBGP NextHop HealthBRKSPG-247434 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHeuristic Package=Codify Know-HowSub-service d
79、efinition-SymptomsSubservice definition will specify the underlying Metrics and details about how the health status for that subservice needs to be computed.Subservice Fields includes:Dependencies:Dependencies:List of Subservices and/or Metric Instances,Soft/Hard DependencySubservice Eval Expression
80、:Subservice Eval Expression:How to derive the health status Symptoms:Symptoms:Subservice evaluates underlying metrics and subservices and records symptoms when prescribed expression is violated.SubSub-service service definitiondefinitionrootExpressions:cpu_healthy&memory_healthy,symptom:format_strin
81、g:Heavier than expected resource consumption on the device.,level:DEGRADEDSymptomsL2 VPNVPWS CtrlPlane HealthVPN If HealthEVPN HealthDevice HealthBGP Nbr HealthIP ReachabilityBGP NextHop HealthBRKSPG-247435 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveSymptomsname:subse
82、rvice.device.health,namespace:system,params:name:DEVICE,type:PARAM_TYPE_NON_LIST“,symptom:format_string:Heavier than expected resource consumption on the device.,level:DEGRADED,rootExpressions:cpu_healthy&memory_healthy,dependencies:type:DEP_TYPE_EXPRESSION,label:cpu_healthy,eval_expression:cpu_load
83、 1000,type:DEP_TYPE_METRIC,label:cpu_load,eval_expression:metric.device.cpu.load,paramMap:device:DEVICE“,type:DEP_TYPE_METRIC,label:memory_free,eval_expression:metric.device.memory.free,paramMap:device:DEVICE“Device HealthEval ExpressionDependenciesHeuristic Package is encoded in human readable form
84、at(json)and is designed to be extended in the field by experts to cover variations in service bringing in flexibility to customers.BRKSPG-247436 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveCodify Know-How:Heuristic PackageMetric EngineMetric defines the methods to fetc
85、h different operational data from different device types.Depending on the platform,different methods may be supported.Each metric definition specifies the different query methods supported for different device platform types.MetricsMetricsEngineEngineimplementations:generic IOS XR:MDTMetric:sensor_p
86、ath:Cisco-IOS-XR-ifmgr-oper:interface-properties/interfaceinterface-name=GigabitEthernetgigEthIfId/state”,precedence:2 ,SNMP IOS XR:SNMPMetric:oid:IF-MIB:ifOperStatus,key:GigabitEthernetgigEthIfId,mapping_oid:IF-MIB:IF-MIB/ifTable/ifEntry”,precedence:20 Metric MappingL2 VPNVPWS CtrlPlane HealthVPN I
87、f HealthEVPN HealthDevice HealthBGP Nbr HealthIP ReachabilityBGP NextHop HealthBRKSPG-247437The Operator Experience 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveToday Operation Experience MTTI/MTTKMonitor Multiple ServicesHi,I cannot reach Hi,I cannot reach salesforcesa
88、lesforceEye on GlassMajor Incident MgmtRoot Cause AnalysisProblem ManagementKPI analysisDeep AnalysisMultiple People check different domainTroubleshootingLevel 1 OperationLevel 2 and Level 3Front Line SupportCustomerBRKSPG-247439 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#Cisc
89、oLiveEnable Service MonitoringEnable for selected service with a specific policy/profile.BRKSPG-247440 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveEnable Service MonitoringEnable for selected service with a specific policy/profile.BRKSPG-247441 2023 Cisco and/or its af
90、filiates.All rights reserved.Cisco Public#CiscoLiveService Health Status reportedIndication on Service Detailed viewHealthBRKSPG-247442 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLivePath Health StatusTracked as part of the service health details view.BRKSPG-247443 2023 C
91、isco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveService details with symptomsExpedite troubleshooting by pointing to possible symptomsBRKSPG-247444 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveAssurance graph renderingHelp in pin-point the sub-servi
92、ces impacting the help of the serviceBRKSPG-247445 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveTimeline View Ability to browse through snapshot of the service/sub-service status across timeline up to 60 daysBRKSPG-247446Video:Sneak view on Service Health 2023 Cisco and
93、/or its affiliates.All rights reserved.Cisco Public#CiscoLiveProactively notify customer with possible causes Hi,cannot reach sales force.Eye on GlassTomorrow Operation Experience Extend Heuristic Package with additional subservices.Automate TroubleshootingLevel 1 OperationLevel 2 and Level 3Front L
94、ine SupportCustomerMTTI/MTTKEnd to End View of the services shared across operator and adapted to the operator knowledge.Proactively notify Level 2 and Level 3 and frontline supportProactive Problem ManagementYes,the device supporting your area is dropping packet.BRKSPG-247448Know How Extension 2023
95、 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRulesConfig Profiles Sub-service definition Metric EngineKnow How ExtensionCustomization and extension for greenfield deployment Adjust threshold settings;ex.add a bronze config profile Add more metrics to monitor;ex.TWAMP Light
96、metrics for L3VPN,QoS related metrics Reduce number of out-of-the-box metrics monitoring to conserve device resource consumption when applicableExtension to support additional Cisco and 3rd party platformsCustomization and extension for NSO brownfield deploymentBRKSPG-247450 2023 Cisco and/or its af
97、filiates.All rights reserved.Cisco Public#CiscoLiveKnow How ExtensionUse Case:Include mtu size for interface health of a l2vpn service.Sub Sub ServiceServiceMetricsMetricsConfig Config RulesRulesRulesRules“MTU_SIZE”:“description:”MTU Size for Jumbo frames”,“type”:“VAL_INT”“intVal”:“unit”:“NA”,“val”:
98、4000BRKSPG-2474 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveKnow How ExtensionUse Case:Include mtu size for interface health of a l2vpn service.name:subservice.interface.health,namespace:“custom,“description:“Subservice to reflect interface health,params:name:“device“,
99、name:“ifID“rootExpressions:evalExpression”:“oper_up&low_in_errors&low_in_discards&low_out_errors&low_out_discards&mtu_size_4K”,dependencies:-type:DEP_TYPE_METRIC,label:“mtu_size_4k,eval_expression:“metric.interface.mtu,paramMap:device:“device“gigaEthIfId:“ifId”Sub Sub ServiceServiceMetricsMetricsCon
100、fig Config RulesRulesRulesRulesBRKSPG-2474 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveKnow How ExtensionUse Case:Include mtu size for interface health of a l2vpn service.Sub Sub ServiceServiceMetricsMetricsConfig Config RulesRulesRulesRulesname:“metric.interface.mtu,n
101、amespace:“custom,“description:“Interface MTU,“display label”:“ifMTU”,“parameters:“device:“description“:”Device to which the interface belogs”,“gigEthIfId:“description“:”Gigabit Ethernet Interface Id.Includes subinterface id.”,“m_type”:“int_t”:“implementation:SNMP IOS XR:SNMPMetric:oidPathConfig:IF-M
102、IB:IF-MIB/ifTable/ifEntry,oidPathExact:IF-MIB:IF-MIB/ifTable/ifEntryifName=gigEthIfId/ifMTU,“matches:“implementation:SNMP IOS XR“,“conditions:“os_model:“type”:”exact_match”,“match”:“Cisco IOS XR”BRKSPG-2474Video:CustomHeuristic PackageConclusion 2023 Cisco and/or its affiliates.All rights reserved.C
103、isco Public#CiscoLiveCrosswork Automated Assurance Use Cases Avoid service disruptions with a holistic,serviceservice-centric approach centric approach to mitigating service-impacting issuesBRKSPG-247456Reduction in time-to-detect service issues and remediationImproved user experience and operator p
104、roductivityVisibility:Visibility:Expedite troubleshooting by providing deep visibilityInsights:Insights:True Service Impact by combining empirical data plane verification with infrastructure health status in a single viewActions:Actions:Codified Assurance Intent and Network“Know-How”enable to automa
105、te troubleshooting step.(Crosswork Hierarchical Controller)Topology-based correlation and Assurance(Accedian Skylight)Proactive service quality analyticsCisco Multivendor IP Controller(Crosswork NetworkController)COCCOCCisco OpticalControllerAny 3rdPartyControllerAIOps Based Incident Management(Via
106、AIOps)AIOps based Incident and PerformanceManagement(Vitria VIA AIOps)Business OutcomeBusiness Outcome 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveCX focus is to match the unique needs of each customerCX Customization Use CasesCustomization and extension for greenfield
107、 Customization and extension for greenfield deploymentdeploymentAdjust threshold settings;ex.add a bronze config profileAdd more metrics to monitor;ex.TWAMP Light metrics for L3VPN,QoS related metricsReduce number of out-of-the-box metrics monitoring to conserve device resource consumption when appl
108、icableExtension to support additional Cisco and 3rd Extension to support additional Cisco and 3rd party platformsparty platformsCustomization and extension for NSO Customization and extension for NSO brownfield deploymentbrownfield deploymentBRKSPG-247457 2023 Cisco and/or its affiliates.All rights
109、reserved.Cisco Public#CiscoLiveFill out your session surveys!Attendees who fill out a minimum of four session surveys and the overall event survey will get Cisco Live-branded socks(while supplies last)!These points help you get on the leaderboard and increase your chances of winning daily and grand
110、prizesAttendees will also earn 100 points in the Cisco Live Challenge for every survey completed.BRKSPG-247458 2023 Cisco and/or its affiliates.All rights reserved.Cisco PublicContinue your educationVisit the Cisco Showcase for related demosBook your one-on-oneMeet the Engineer meetingAttend the int
111、eractive education with DevNet,Capture the Flag,and Walk-in LabsVisit the On-Demand Library for more sessions at www.CiscoL Your Experience Share Your Experience Win prizes by participating in hands on activities about API quality and insights while working with Crosswork Automation&Data Center prod
112、ucts.60BRKSPG-2474Booth#214 Booth#214 DevNetDevNet ZoneZoneCNC CNC ACIACINDFCNDFC 2023 Cisco and/or its affiliates.All rights reserved.Cisco PublicThank you#CiscoLive 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLive62Gamify your Cisco Live experience!Get points Get points
113、for attending this session!for attending this session!Open the Cisco Events App.Click on Cisco Live Challenge in the side menu.Click on View Your Badges at the top.Click the+at the bottom of the screen and scan the QR code:How:123462 2023 Cisco and/or its affiliates.All rights reserved.Cisco PublicBRKSPG-2474#CiscoLive