1、#CiscoLive#CiscoLiveLukas Krattiger,Distinguished EngineerCCIE21921BRKDCN-2913Architecture and TechnologyVXLAN BGP EVPN Multi-Site 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveEnter your personal notes hereCisco Webex App Questions?Use Cisco Webex App to chat with the s

2、peaker after the sessionFind this session in the Cisco Live Mobile AppClick“Join the Discussion”Install the Webex App or go directly to the Webex spaceEnter messages/questions in the Webex spaceHowWebex spaces will be moderated by the speaker until June 9,2023.1234https:/ 2023 Cisco and/or its affil

3、iates.All rights reserved.Cisco PublicBRKDCN-29133Agenda 2023 Cisco and/or its affiliates.All rights reserved.Cisco PublicIntroductionWhat is Multi-Site?Use CasesMulti-Site A Deeper LookConclusionBRKDCN-29134Introduction 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveIntr

4、oductionA brief touchpoint of the work at the IETF(Internet Engineering Task Force)and what RFC(Request for Comment)are Standard and what InformationalWhat is this Multi-Site about why do we have it and what is it good forUse Cases and Deployment ScenariosThe Border Gateway(BGW)BRKDCN-29136What is M

5、ulti-Site 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveWhat is RFC 9014?By the Standards BodyInternet Engineering Task Force(IETF)Request for Comment(RFC)Categorized for Standards TrackInternet Standard since 2021Existing Industry AdoptionInterconnect Solution for Ether

6、net VPN(EVPN)Overlay NetworksCo-Authored by CiscoRFC 9014https:/datatracker.ietf.org/doc/html/rfc9014BRKDCN-29138 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRFC 9014 at a glanceBy the Standards BodyDCI EVPN Overlay(aka RFC 9014)Interconnect Solution for Ethernet VPN(E

7、VPN)Overlay NetworksFrom the Abstract“extend the Layer 2 connectivity required for some tenants.”VXLAN BGP EVPNVXLAN BGP EVPNGWGWBGP Autonomous System(AS)65001BGP Autonomous System(AS)65002eBGP EVPN*Address-FamilyLayer-2*RFC 9014 supports more than just EVPN for the Interconnect Network/=tunnel stit

8、ching point at GW/=tunnel stitching point at GWBRKDCN-29139 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRFC 9014 Gateway Model Side-by-Side Decoupled and Integrated GatewayVXLAN BGP EVPNGatewayVXLAN BGP EVPNGatewayBGP AS65001BGP AS65002Decoupled Gateway(Section 3)WAN E

9、dgeWAN EdgeLayer-2 EVPN*VLAN HandoffVLAN HandoffVXLAN BGP EVPNGatewayVXLAN BGP EVPNGatewayBGP AS65001BGP AS65002Integrated Gateway(Section 4)Layer-2 EVPN*RFC 9014 supports more than just EVPN for the Interconnect NetworkBRKDCN-291310 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#

10、CiscoLiveRFC 9014 Gateway Model Side-by-Side Decoupled and Integrated GatewayVXLAN BGP EVPNGatewayVXLAN BGP EVPNGatewayBGP AS65001BGP AS65002Decoupled Gateway(Section 3)WAN EdgeWAN EdgeLayer-2 EVPN*VLAN HandoffVLAN HandoffVXLAN BGP EVPNGatewayVXLAN BGP EVPNGatewayBGP AS65001BGP AS65002Integrated Gat

11、eway(Section 4)Layer-2 EVPN*RFC 9014 supports more than just EVPN for the Interconnect NetworkWhat about Layer-3?BRKDCN-291311 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLivedraft-sharma-bess-multi-site-evpnMulti-Site Solution for Ethernet VPN(EVPN)OverlayBRKDCN-291312 20

12、23 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveWhat is Multi-Site?By the Standards BodyInternet Engineering Task Force(IETF)Request for Comment(RFC)Categorized as InformationalInternet Draft since 2016Currently in Version 3Overall,8 versionsUpdated and Maintained by BESS ve

13、rsion of draftdraft-sharma-bess-multi-site-evpnShipping since 2017Multi-Site(BESS version)https:/datatracker.ietf.org/doc/html/draft-sharma-bess-multi-site-evpnPre-Cursor Draft(replaced by BESS version)https:/datatracker.ietf.org/doc/html/draft-sharma-multi-site-evpnBRKDCN-291313 2023 Cisco and/or i

14、ts affiliates.All rights reserved.Cisco Public#CiscoLiveMulti-SiteBy the Standards BodyMulti-Site Solution for Ethernet VPN(EVPN)Overlay(draft-sharma-bess-multi-site-evpn)Interconnect Solution for Ethernet VPN(EVPN)Overlay NetworksFrom the Abstract“support extension of Layer-2 and Layer-3,Unicast&Mu

15、lticast,VPNs”VXLAN BGP EVPNVXLAN BGP EVPNBGWBGWBGP Autonomous System(AS)65001BGP Autonomous System(AS)65002eBGP EVPNAddress-FamilyLayer-2&Layer-3/=tunnel stitching point at BGW/=tunnel stitching point at BGWBRKDCN-291314 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRFC9

16、014 and Multi-Site-Side by SideDCIDCI-EVPNEVPN-OverlayOverlay(RFC 9014)(RFC 9014)MultiMulti-Site EVPNSite EVPN(draft(draft-sharmasharma-bessbess-multimulti-sitesite-evpnevpn)InterconnectIntegrated(1-Box),Decoupled(2-Box)Integrated(1-Box)DCI EncapVPLS,PBB-VPLS,EVPN-MPLS,PBB-EVPN,VXLANVXLANGateway Mod

17、eMultipath PIPAnycast VIPMultipath PIPECMPUnderlay and OverlayUnderlayUnderlay and OverlayEVPN RT-1Consumed and GeneratedNoneConsumed and GeneratedEVPN RT-2Re-Originated with I-ESIRe-Originated with ESI 0Re-Originated with I-ESIEVPN RT-3Consumed and GeneratedConsumed and GeneratedConsumed and Genera

18、tedEVPN RT-4Consumed and GeneratedConsumed and GeneratedConsumed and GeneratedEVPN RT-5ipvpn-evpn-interworking draftRe-OriginatedRe-OriginatedRoute Distinguisher(RD)Separate RD for Intra and Inter DCSeparate RD for VIP and PIPRoute-Target(RT)Separate RT for Intra and Inter DCSame RT for Intra and In

19、ter DCVNI AllocationGlobal and DownstreamGlobal and DownstreamDF ElectionBased on EVPN RT-4Based on EVPN RT-4IdentifierI-ESII-ESI(=Site-ID)Split HorizonLocal BiasLocal BiasESI-TypeType 0 (Operator Managed)Type 3(MAC Based)or Type 5(AS based)BUM Tree#2,GW stitched(Intra and Inter DC)2,GW stitched(Int

20、ra and Inter DC)BRKDCN-291315 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveRFC9014 and Multi-Site Side by SideIn a Nutshell*BGW Border Gateway(BGW);Ciscos name for the VXLAN EVPN to VXLAN EVPN GatewayRFC 9014Base Standard for Interconnecting EVPNDefines the Layer-2 Stit

21、chingTwo Gateway ModelMultiple EncapsulationsLeverages Overlay and Underlay ECMPVXLAN BGP EVPNVXLAN BGP EVPNGWGWBGP Autonomous System(AS)65001BGP Autonomous System(AS)65002eBGPEVPNAddress-FamilyLayer-2Multi-SiteExtends RFC 9014 for Interconnecting EVPNDescribes Layer-2 and Layer-3 StitchingSingle Ga

22、teway Model (Two BGW*Model)Focus only on VXLAN EncapsulationDifferent ECMP model depending on BGW ModelVXLAN BGP EVPNVXLAN BGP EVPNGWGWBGP Autonomous System(AS)65001BGP Autonomous System(AS)65002eBGPEVPNAddress-FamilyLayer-2&Layer-3/BRKDCN-291316Use Cases 2023 Cisco and/or its affiliates.All rights

23、reserved.Cisco Public#CiscoLiveUse Case#1-CompartmentalizationSSSSDC Core/Super SpineServerServerLLLBBFabric#1ServerServerLLLBBFabric#2Multiple Fabrics,single Data CenterSingle or Multiple Data HallsWithin a Geographic LocationsControl at BGW(Border Gateway)Allows Extension of Layer-2Allows Extensio

24、n of Layer-3 Allows Extension of Layer-2 and Layer-3Allows Traffic Control(BUM*)Defines VNI allocation and stitchingOptimizes BUM*Replication*BUM Broadcast,Unknown Unicast,MulticastBRKDCN-291318 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveBUM OptimizationUse Case#1 Com

25、partmentalization*BUM Broadcast,Unknown Unicast,MulticastSSSSDC Core/Super SpineServerServerLLLSSFabric#1ServerServerLLLSSFabric#2Single Fabric BUM with Ingress ReplicationSingle BUM Packet,5x ReplicatedSingle BUM Packet,5x Replicated3 Replication over DC Core/Super Spine(Between)2 Replication for F

26、abric#1(Local)SSSSDC Core/Super SpineServerServerLLLBBFabric#1ServerServerLLLBBFabric#2Multi-Site BUM with Ingress ReplicationSingle BUM Packet,3x ReplicatedSingle BUM Packet,3x Replicated1 Replication over DC Core/Super Spine(Between)3 Replication for Fabric#1(Local)3 Replication for Fabric#2(Local

27、)BRKDCN-291319 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveUse Case#2-ScaleSSSSDC Core/Super SpineServerServerLLLBBFabric#1ServerServerLLLBBFabric#128Multiple Fabrics,single or multiple Data CenterSingle or Multiple Data HallsWithin or between Geographic LocationsContr

28、ol at BGW(Border Gateway)Reduces Remote VTEP CountExpands VTEP scaleScale through HierarchyMultiply VTEP with SitesUp to 256 VTEP per FabricUp to 128 Sites per Multi-Site DomainUp to 256 VTEP per FabricBRKDCN-291320 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveUse Case#

29、2-ScaleSSSSDC Core/Super SpineServerServerLLLBBFabric#1ServerServerLLLBBFabric#128Multiple Fabrics,single or multiple Data CenterSingle or Multiple Data HallsWithin or between Geographic LocationsControl at BGW(Border Gateway)Reduces Remote VTEP CountExpands VTEP scaleScale through HierarchyMultiply

30、 VTEP with Sites32768 VTEP to extend Layer-2 or/and Layer-3 segments toUp to 256 VTEP per FabricUp to 128 Sites per Multi-Site DomainUp to 256 VTEP per FabricBRKDCN-291321 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveVTEP ScaleUse Case#2-Scale*BUM Broadcast,Unknown Unic

31、ast,MulticastSSSSDC Core/Super SpineServerServerLLLSSFabric#1ServerServerLLLSSFabric#2Single Fabric or Multi-PODLeaf#1 sees every VTEP,5 VTEP PeerLeaf#1 sees every VTEP,5 VTEP Peer3 VTEP Peer for Fabric#2(Between)2 VTEP Peer for Fabric#1(Local)SSSSDC Core/Super SpineServerServerLLLBBFabric#1ServerSe

32、rverLLLBBFabric#2Multiple Fabric with Multi-SiteLeaf#1 sees only local VTEP,3 VTEP PeerLeaf#1 sees only local VTEP,3 VTEP Peer1 VTEP Peer for Exit,BGW(Between)2 VTEP Peer for Fabric#1(Local)BRKDCN-291322 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveUse Case#3 Data Cente

33、r Interconnect(DCI)LLLBBMultiple Fabrics,Geographically DispersedClassic DCI Use CaseAllows Extension of Layer-2Allows Extension of Layer-3 Allows Extension of Layer-2 and Layer-3Allows Traffic Control(BUM*)Defines VNI allocation and stitchingOptimizes BUM*ReplicationLLLBBLLLBBLLLBB*BUM Broadcast,Un

34、known Unicast,MulticastBRKDCN-291323 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveUse Case#3 Data Center Interconnect(DCI)LLLBBMultiple Fabrics,Geographically DispersedClassic DCI Use CaseAllows Extension of Layer-2Allows Extension of Layer-3 Allows Extension of Layer-2

35、 and Layer-3Allows Traffic Control(BUM*)Defines VNI allocation and stitchingOptimizes BUM*ReplicationLLLBBLLLBBLLLBB*BUM Broadcast,Unknown Unicast,MulticastWorks Within a Geographic Location Works Between Geographic LocationsBRKDCN-291324 2023 Cisco and/or its affiliates.All rights reserved.Cisco Pu

36、blic#CiscoLiveUse Case#4 Integration with Legacy NetworksSSSSDC Core/Super SpineServerServerLLLBBFabric#1ServerServerBIntegrating Fabrics with Legacy NetworksBGW Frontends Legacy NetworkBGW Frontends New NetworkHost Mobility and MigrationProvides Distributed Default GatewayAllows Layer-2 Extension w

37、here neededBenefits from all Multi-Site functionsLayer-2,Layer-3 Multicast and Unicast VPNs between different Networks for Migration or Co-ExistanceBAccessAccessAccessAggAggBRKDCN-291325 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveServerServerLLLBBFabric#1Extending fro

38、m On-Prem to Public CloudUsing BGW to terminate VXLAN EVPN Tunnel from CloudTransported via Internet or Direct Connect/Express RouteEncryption Optional(IPSec)Multi-Tenancy to the CloudExtends Layer-3 with VRF awarenessMultiple On-Prem VRF mapped or integrated with Virtual Cloud Instances(ie VPC or V

39、NET)Leveraging Cisco Cloud RouterC8kv(Catalyst 8000 Virtual)in the Cloud as termination pointReplacing CSR1000vUse Case#5 Hybrid Cloud ConnectivityBRKDCN-291326Multi-SiteA Deeper Look 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveAs we Talk about ScaleHardware SupportMin

40、imum Hardware and Software Requirements for BGW(Border Gateway)Minimum Hardware and Software Requirements for BGW(Border Gateway)Cisco Nexus HardwareCisco Nexus 9300 EX platformCisco Nexus 9300 FX platformCisco Nexus 9300 FX2 platformCisco Nexus 9300 FX3 platformCisco Nexus 9300 GX platformCisco Nex

41、us 9300 GX2 platformCisco Nexus 9364C platformCisco Nexus 9332C platformCisco Nexus 9500 platform with X9700-EX line cardCisco Nexus 9500 platform with X9700-FX line cardCisco Nexus 9500 platform with X9700-GX line card Cisco Nexus Software(NX-OS)Cisco NX-OS Software Release 7.0(3)I7(1)or later*Chec

42、k for Hardware Specific Support ReleasesBRKDCN-291328 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveAs we Talk about ScaleScalability Values as of NX-OS 10.2(3)FMultiMulti-Site ScaleSite ScaleNumber of Sites128Number of BGW per Site6Number of VTEP per Site(internal)256*T

43、he values provided in these tables focus on the scalability of one particular Route scale at a timeBorder Gateway(BGW)ScaleBorder Gateway(BGW)ScaleEXEXFX2FX2FX,FX3,GX,GX2FX,FX3,GX,GX2N9364C&N9332CN9364C&N9332CNumber of Layer-2 VNI(VLAN)3900Number of Layer-3 VNI(VRF)2000MAC per BGW92kIPv4 Host Routes

44、 per BGW*450k 450k1.1M96kIPv4 Network Routes per BGW*450k450k1.1M8kIPv6 Host Routes per BGW*24k260k620k48kIPv6 Network Routes per BGW*200k 290k620k2kBRKDCN-291329 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveSome Notes on BGW and VXLAN TunnelsMulti-SiteTunnels are Stitc

45、hed at the BGW(Border Gateway)Intra Fabric Tunnel goes from Leaf to Leaf or Leaf to BGWInter Fabric Tunnel goes from BGW to BGWVXLAN BGP EVPNVXLAN BGP EVPNBGWBGWBGP Autonomous System(AS)65001BGP Autonomous System(AS)65002eBGP EVPNAddress-FamilyLayer-2&Layer-3/=tunnel stitching point at BGW/=tunnel s

46、titching point at BGWBRKDCN-291330 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveSome Notes on the Interconnect and UnderlayMulti-SiteFabric#1 Underlay(VTEP,Point-2-Point,Loopback etc)is not aware of Fabric#2Each Fabric maintains their Unique Network Topology,Protocols a

47、nd IP AddressingOnly BGW IP Addressing must be Unique and Aligned between SitesVXLAN BGP EVPNVXLAN BGP EVPNBGWBGWBGP Autonomous System(AS)65001BGP Autonomous System(AS)65002Fabric#1 UnderlayLeaf:10.1.1.110.1.1.210.1.1.310.1.1.410.1.1.510.1.1.610.1.1.7Fabric#2 UnderlayLeaf:10.2.2.110.2.2.210.2.2.310.

48、2.2.410.2.2.510.2.2.610.2.2.7Multi-Site UnderlayBGW Fabric#2:10.0.2.110.0.2.210.0.2.3BGW Fabric#1:10.0.1.110.0.1.210.0.1.3BRKDCN-291331 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveMulti-Site-A Deeper LookBorder Gateway Deployment ConsiderationsBRKDCN-291332 2023 Cisco

49、and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveBorder Gateways Deployment ConsiderationsBBBBFabricLLLLLLFabricBBAnycast Border GatewayvPC Border GatewayBorder Gateways used for two main functions:Interconnecting each site to the Inter-Site network(for East-West traffic flows)Connect

50、ing each site to the external Layer 3 domain(for North-South traffic flows)May also be used to connect endpoints and/or network service nodes(FWs,ADCs)Possible deployment models:Anycast Border Gateways vPC Border Gateways BGW function enablement in the VXLAN EVPN fabric:BGWs on Leaf node(Border Gate

51、way Leaf)BGWs on Spine node(Border Gateway Spine)BRKDCN-291333 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveAnycast Border GatewayAnycast Border GatewayUp to 6 Border GatewaysBorder GatewayDeploying as a Leaf node 7.0(3)I7(1)Deploying as a Spine node 7.0(3)I7(2)Two Mode

52、 of Operation:Can Operate as Multi-Site Anycast BGW with VIPFocuses on Scale and ConvergenceUsing Virtual IP(VIP)for Tunnel StitchingUses Overlay ECMPCan Operate in RFC 9014 BGW Mode with PIPFocuses on 3rdParty InteropUsing Primary IP(PIP)for Tunnel StitchingUses Underlay and Overlay ECMPBBBBFabricL

53、LLBRKDCN-291334 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLivevPC Border GatewayvPC Border GatewayUp to 2 Border GatewaysBorder GatewayDeploying as a Leaf node 9.2(1)Common Use CaseLegacy Network Integration or MigrationProvides Multi-Chassis Link AggregationIntegrates w

54、ith Ethernet and FabricPathHosts the Distributed Anycast GatewayAttachment of Network ServicesDual-Attachment of Firewalls and ADCsActs like a vPC when it comes to RoutingLLLFabricBBBRKDCN-291335 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveWhen to use what BGWBBBBFabri

55、cLLLLLLFabricBBAnycast Border GatewayUp to 6 BGW Shared Nothing Simple Failure ScenariosAny Deployments No End-Point or Network Services Connectivity on BGWGreenfield DeploymentsvPC Border Gateway2 BGW with physical vPC Peer-LinkSmall Deployments End-Point or Network Services Connectivity on BGWMigr

56、ation Use-Cases(Brownfield)Classic Ethernet/FabricPath to VXLAN EVPNBRKDCN-291336 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveDetails on the Different BGWBBBBFabricLLLLLLFabricBBMulti-Site VIP10.0.1.1PIP10.1.1.1PIP10.1.1.2PIP10.1.1.3PIP10.1.1.4Both Anycast and vPC Bord

57、er Gateway needs to be configured with a common Multi-Site VIP address and an individual Primary IP(PIP)addressvPC Border Gateways share a secondary IP address to be used as vPC virtual IP(vPC VIP)PIP10.2.2.1PIP10.2.2.2vPC VIP10.2.2.254Multi-Site VIP10.0.2.1Anycast Border GatewayvPC Border GatewayBR

58、KDCN-291337 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveMulti-Site-A Deeper LookControl and Data PlaneBRKDCN-291338 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveControl-and Data-PlaneMP-eBGP EVPN for between Multiple SitesLeverages Natural

59、 BGP Next-hop behaviorVXLAN tunnel termination and re-originationLoop protection(as-path attribute)Full mesh of MP-eBGP EVPN adjacencies between sites Fabric#2Fabric#1BGP AS 65001BGP AS 65002eBGP EVPNAddress-FamilyLayer-2&Layer-3/=tunnel stitching point at BGW/=tunnel stitching point at BGWLBBGWLBBG

60、WBRKDCN-291339 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveControl-and Data-PlaneTwo main options for underlay and overlay Control-Plane(CP)deploymentI-E-I(Recommended)Within Fabric:IGP(OSPF,IS-IS)as underlay CP,iBGP as overlay CPE-E-E*Within and Between Fabrcis:eBGP f

61、or both underlay and overlay CPsFabric#2Fabric#1BGP AS 65001BGP AS 65002eBGP EVPNAddress-Family/=tunnel stitching point at BGW/=tunnel stitching point at BGWLBBGWLBBGW*For more information on why eBGP for both underlay and overlay CP is not a good idea:https:/ 2023 Cisco and/or its affiliates.All ri

62、ghts reserved.Cisco Public#CiscoLiveControl-and Data-PlaneFull mesh of MP-eBGP EVPN adjacencies between sites Recommended to deploy a couple of Route-Servers(RS)with 3 or more sitesRS resides in a separate AS and only performs control plane functions“eBGP Route-Reflectors”,IETF RFC 7947RS functions:

63、EVPN routes reflection,next-hop-unchanged,route-target rewriteFabric#2Fabric#1BGP AS 65001BGP AS 65002/=tunnel stitching point at BGW/=tunnel stitching point at BGWLBBGWLBBGWRRSeBGP EVPNAddress-FamilyLayer-2&Layer-3BRKDCN-291341 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#Cisco

64、LiveIt all starts with a Network DeviceThe Dating Network-When Control-meets Data-PlaneNetworkDeviceBRKDCN-291342 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveFabric#1It all starts with a Network DeviceThe Dating Network-When Control-meets Data-PlaneNetworkDeviceHost AH

65、ost AHost SideAccessDownlinkLBRKDCN-291343 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveFabric#1Making the Network Device an NVEThe Dating Network-When Control-meets Data-PlaneNetworkDeviceHost AHost AHost SideAccessDownlinkLThe VTEPgoes hereVBRKDCN-291344 2023 Cisco an

66、d/or its affiliates.All rights reserved.Cisco Public#CiscoLiveFabric#1Making the Network Device an NVEThe Dating Network-When Control-meets Data-PlaneNetworkDeviceHost AHost AHost SideAccessDownlinkLVStill a SwitchRouterNetwork Deviceor Edge DeviceNetwork Virtualization EdgeBRKDCN-291345 2023 Cisco

67、and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveExpanding to the BGW A“special”NVEThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost AHost SideAccessDownlinkBetween Sites,Multi-SiteCore,UplinkLBV/Stitching Point between-Local VTEP(L)-Remote VTEP(B)-Individu

68、al VTEP in Fabric#2 are“hidden”Network Virtualization EdgeBRKDCN-291346 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesThe BGW and Some Important TableThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACIPMaskNext-Hop

69、VRFMACVLANInterfaceBRKDCN-291347 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesAlways Remote Learning on a BGWThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpIPMaskNext-HopVRFMACVLANInterfaceBRKDCN-291348 2023

70、 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRemote Learning from Fabric External The Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpEVPN NLRIEVPN NLRIRoute Type5IP/Length10.10.10.0/24Label50000Route-Target65002:500

71、00Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2IPMaskNext-HopVRFMACVLANInterfaceBRKDCN-291349 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRemote Learning from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB

72、/FIBMACbgpEVPN NLRIEVPN NLRIRoute Type5IP/Length10.10.10.0/24Label50000Route-Target65002:50000Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2vrf importIPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-AMACVLANInterfaceBRKDCN-291350 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware

73、TablesRemote Learning from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpEVPN NLRIEVPN NLRIRoute Type5IP/Length10.10.10.0/24Label50000Route-Target65002:50000Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2vrf export/redistribute/advertiseIPMask

74、Next-HopVRF10.10.10.02410.0.2.1VRF-AMACVLANInterfaceBRKDCN-291351 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRemote Learning from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpEVPN NLRIEVPN

75、 NLRIRoute Type5IP/Length10.10.10.0/24Label50000Route-Target65002:50000Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2vrf export/redistribute/advertisebgpIPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-AMACVLANInterfaceBRKDCN-291352 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardwa

76、re TablesRemote Learning from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpEVPN NLRIEVPN NLRIRoute Type5IP/Length10.10.10.0/24Label50000Route-Target65002:50000Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2vrf export/redistribute/advertisebgp

77、EVPN NLRIEVPN NLRIRoute Type5IP/Length10.10.10.0/24Label50000Route-Target65001:50000Next-Hop10.0.1.1Router MACX1X1.X1X1.X1X1IPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-AMACVLANInterfaceBRKDCN-291353 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRemote Learnin

78、g from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpEVPN NLRIEVPN NLRIRoute Type2MAC/Length0003.0000.100B/48IP/Length192.168.1.12/32Label130001Label250000Route-Target165002:30001Route-Target265002:50000Next-Hop10.0.2.1Router MACX2X2.X2

79、X2.X2X2IPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-AMACVLANInterfaceBRKDCN-291354 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRemote Learning from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgp

80、EVPN NLRIEVPN NLRIRoute Type2MAC/Length0003.0000.100B/48IP/Length192.168.1.12/32Label130001Label250000Route-Target165002:30001Route-Target265002:50000Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2vrf importIPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-A192.168.1.123210.0.2.1VRF-AMACVLANInterface0003.0000.100B1

81、010.0.2.1vrf importBRKDCN-291355 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRemote Learning from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpEVPN NLRIEVPN NLRIRoute Type2MAC/Length0003.00

82、00.100B/48IP/Length192.168.1.12/32Label130001Label250000Route-Target165002:30001Route-Target265002:50000Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2vrf export/redistribute/advertiseIPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-A192.168.1.123210.0.2.1VRF-AMACVLANInterface0003.0000.100B1010.0.2.1vrf export/red

83、istribute/advertiseBRKDCN-291356 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRemote Learning from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpEVPN NLRIEVPN NLRIRoute Type2MAC/Length0003.00

84、00.100B/48IP/Length192.168.1.12/32Label130001Label250000Route-Target165002:30001Route-Target265002:50000Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2bgpvrf export/redistribute/advertiseIPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-A192.168.1.123210.0.2.1VRF-AMACVLANInterface0003.0000.100B1010.0.2.1vrf export/

85、redistribute/advertiseBRKDCN-291357 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRemote Learning from Fabric ExternalThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACbgpbgpEVPN NLRIEVPN NLRIRoute Type2MAC/Length0

86、003.0000.100B/48IP/Length192.168.1.12/32Label130001Label250000Route-Target165002:30001Route-Target265002:50000Next-Hop10.0.2.1Router MACX2X2.X2X2.X2X2EVPN NLRIEVPN NLRIRoute Type2MAC/Length0003.0000.100B/48IP/Length192.168.1.12/32Label130001Label250000Route-Target165001:30001Route-Target265001:50000

87、Next-Hop10.0.1.1Router MACX1X1.X1X1.X1X1vrf export/redistribute/advertiseIPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-A192.168.1.123210.0.2.1VRF-AMACVLANInterface0003.0000.100B1010.0.2.1vrf export/redistribute/advertiseBRKDCN-291358 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#Cisco

88、LiveHardware TablesRouting from Local VTEP to Remote BGWThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACSIPSIPDIPDIPVNIVNISMACSMACDMACDMACSIPSIPDIPDIPPayloadPayload1.1.1.110.0.1.150000A1A1.A1A1.A1A1X1X1.X1X1.X1X1192.168.0.12192.168.1.12Outer IPVNIInner MAC

89、Inner IPVXLANIPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-A192.168.1.123210.0.2.1VRF-AMACVLANInterfaceBRKDCN-291359 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesRouting from Local VTEP to Remote BGWThe Dating Network-When Control-meets Data-PlaneFabric#2Fabri

90、c#1BGWHost AHost ALBVRIB/FIBMACSIPSIPDIPDIPVNIVNISMACSMACDMACDMACSIPSIPDIPDIPPayloadPayload10.0.1.110.0.2.150000X1X1.X1X1.X1X1X2X2.X2X2.X2X2192.168.0.12192.168.1.12Outer IPVNIInner MACInner IPVXLANIPMaskNext-HopVRF10.10.10.02410.0.2.1VRF-A192.168.1.123210.0.2.1VRF-AMACVLANInterfaceBRKDCN-291360 2023

91、 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveHardware TablesBridging from Local VTEP to Remote BGWThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACSIPSIPDIPDIPVNIVNISMACSMACDMACDMACSIPSIPDIPDIPPayloadPayload1.1.1.110.0.1.1300010003

92、.0000.100A0003.0000.100B192.168.1.5192.168.1.12Outer IPVNIInner MACInner IPVXLANIPMaskNext-HopVRF192.168.1.5321.1.1.1VRF-A192.168.1.123210.0.2.1VRF-AMACVLANInterface0003.0000.100A101.1.1.10003.0000.100B1010.0.2.1BRKDCN-291361 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiv

93、eHardware TablesBridging from Local VTEP to Remote BGWThe Dating Network-When Control-meets Data-PlaneFabric#2Fabric#1BGWHost AHost ALBVRIB/FIBMACSIPSIPDIPDIPVNIVNISMACSMACDMACDMACSIPSIPDIPDIPPayloadPayload10.0.1.110.0.2.1300010003.0000.100A0003.0000.100B192.168.1.5192.168.1.12Outer IPVNIInner MACIn

94、ner IPIPMaskNext-HopVRF192.168.1.5241.1.1.1VRF-A192.168.1.123210.0.2.1VRF-AMACVLANInterface0003.0000.100B101.1.1.10003.0000.100A1010.0.2.1VXLANBRKDCN-291362Conclusion 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveConclusion#1Border Gateway(BGW)A Gateway(GW)to stitch mult

95、iple VXLAN BGP EVPN domainsProvides Control-and Data-Plane separationExtends Layer-2 and Layer-3 with ControlAllows to Scale beyond any Fabric ScaleFacilitates Multi-DC and Multi-Pod Use-CasesMore than just a Data Center Interconnect(DCI)#2VXLAN BGP EVPN Multi-SiteA Simple add or drop-inFirst introd

96、uced in September 2017 proven and deployedA Solution combining EVPN DCI Overlay(RFC9014)and IPVPN-EVPN interworking(draft-ietf-evpn-ipvpn)Provides Layer-2 and Layer-3 extensionWide Hardware SupportFlexible Deployment Option-Not just for VXLAN FabricsBRKDCN-291364 2023 Cisco and/or its affiliates.All

97、 rights reserved.Cisco Public#CiscoLiveResources Cisco NX-OSVXLAN EVPN Multi-Site Design and Deployment White Paperhttps:/ since NX-OS 7.0(3)I7(1)EX,FX,FX2,FX3,GX,GX2NextGen DCI with VXLAN EVPN Multi-Site Using vPC Border Gateways White Paperhttps:/ since NX-OS 9,.2(1)EX,FX,FX2,FX3,GX,GX2BRKDCN-2913

98、65 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLiveResources IETFdraft-sharma-bess-multi-site-evpn Multi-Site Solution for Ethernet VPN(EVPN)Overlay(Layer-2 and Layer-3)https:/datatracker.ietf.org/doc/html/draft-sharma-bess-multi-site-evpnRFC 9014 Interconnect Solution for

99、 Ethernet VPN(EVPN)Overlay Networks(Layer-2 only)https:/datatracker.ietf.org/doc/html/rfc9014draft-ietf-bess-evpn-ipvpn-interworking EVPN Interworking with IPVPN(Layer-3 only)https:/datatracker.ietf.org/doc/html/draft-ietf-bess-evpn-ipvpn-interworkingBRKDCN-291366 2023 Cisco and/or its affiliates.Al

100、l rights reserved.Cisco Public#CiscoLiveFill out your session surveys!Attendees who fill out a minimum of four session surveys and the overall event survey will get Cisco Live-branded socks(while supplies last)!These points help you get on the leaderboard and increase your chances of winning daily a

101、nd grand prizesAttendees will also earn 100 points in the Cisco Live Challenge for every survey completed.BRKDCN-291367 2023 Cisco and/or its affiliates.All rights reserved.Cisco PublicContinue your educationVisit the Cisco Showcase for related demosBook your one-on-oneMeet the Engineer meetingAtten

102、d the interactive education with DevNet,Capture the Flag,and Walk-in LabsVisit the On-Demand Library for more sessions at www.CiscoL you#CiscoLive 2023 Cisco and/or its affiliates.All rights reserved.Cisco Public#CiscoLive70Gamify your Cisco Live experience!Get points Get points for attending this s

103、ession!for attending this session!Open the Cisco Events App.Click on Cisco Live Challenge in the side menu.Click on View Your Badges at the top.Click the+at the bottom of the screen and scan the QR code:How:123470 2023 Cisco and/or its affiliates.All rights reserved.Cisco PublicBRKDCN-2913#CiscoLive