L2 bridging with VMware NSX-T
by Michal Grzeszczak
My name is Michal Grzeszczak and I am a senior consultant at Xtravirt (www.xtravirt.com), an independent cloud consulting business and VMware Master Services Competent Partner. Â In this blog, Iâd like to share with you my experience of L2 bridging with VMwareÂŽ NSX-T Data Center and help you to understand some of the differences between NSX-T and NSX-V, as well as cover some NSX use cases. Â
Customer background:
The customer is one of the leading organisations in the betting and gambling industry and have been using NSX-V for some time now. When it came to their new greenfield environment, they decided to deploy NSX-T 2.4 Data Center. This decision was largely based on the fact that NSX-T Data Center provides bridging firewalls natively for L2 software bridging, which was their main requirement. Also, given that NSX-T will be the de facto network and security virtualisation platform offered by VMware going forward, by specifying it for this environment the customer is able to future proof the deployment.Â
Future upgrades are also accounted for as upgrading from NSX-T 2.4 to future NSX-T releases is simpler than performing upgrades from a previous version of V or T.
NSX-T 2.4 was a major update and brought many changes to the architecture of the product, the main ones being:
The NSX Manager and NSX Controllers were merged into one appliance deployed in a Cluster of 3 Nodes therefore minimising the footprint of the solution and operational complexity.Â
The other major change was the introduction of the new Simplified UI which ârequires just the bare minimum of user input, offering strong default values with prescriptive guidance for ease of use. This means fewer clicks and page hops are required to complete configuration tasks.â
NOTE: In NSX 2.4 two UIs are presented - one is the new Simplified UI, the other one is Advanced. The latter is taken from NSX-T 2.3. The future plan is to remove the Advanced UI and provide all of the functionality via the Simplified UI.
 What are the key benefits of choosing NSX-T over NSX-V?
 There are many benefits of NSX-T over NSX-V, to name a few:
NSX-T doesnât require vCenter, however it can be added to NSX-T as a Compute Manager and allows for up to 16 Compute Managers per NSX 2.4 solution . There is no longer a 1:1 requirement like there was with NSX-V.Â
KVM Hypervisor support
Bare Metal Edges provide sub-second failoverÂ
Data Plane Development Kit (DPDK) Optimising Forwarding - DPDK is a set of data plane libraries and network interface controller drivers for fast packet processing
New, more flexible Overlay technology - Geneve replaces   VXLAN  https://docs.vmware.com/en/VMware-Validated-Design/4.3/com.vmware.vvd.sddc-nsxt-design.doc/GUID-CF3C47CA-9BEB-4213-8F08-1494261BF3EC.htmlÂ
Bi-directional Forwarding Detection support
BGP (Border Gateway Protocol) expanded functionality with features like Route Maps
Much clearer User Interface (UI)
What were the specific use cases for this case customer and the design considerations?
USE CASE 1 - NSX-T Edge L2 Bridging - Integration of physical, non-virtualised database servers that require L2 connectivity to the virtualised environment.Â
Design considerations:
In NSX-T 2.4 two options are possible to bridge L2 workloads - using ESXi Bridge Clusters or Edge Bridge Profiles. The latter is recommended to use as the former will be deprecated in future.Â
Ideally the use of dedicated Bare Metal Edges, however this is not a requirement.Â
The possibility to deploy Edge Bridges in collapsed vSphere Clusters > Â Â Management + Edge or Compute + Edge
Consider having active and standby Edge Nodes on different hosts to avoid throughput drop, because VLAN traffic needs to be forwarded to both Edge Nodes in promiscuous mode.
Overlay traffic can be tagged on a Distributed Port Group or Uplink Profile, but please avoid double tagging.Â
VLAN traffic should not be tagged on the Uplink Profile.
Distributed Port Group for VLAN traffic connecting to the Edge Node should be in a Trunk Mode. The reason for this is due to the fact that Edge doing Bridging adds 802.1Q tag when transposing Overlay traffic to VLAN.Â
Consider having the same MTU value across your environment - if you can, choose MTU of 9000 for better performance.Â
Several Bridge Profiles can be configured, and a given Edge can belong to several Bridge Profiles. By creating two separate Bridge Profiles, alternating active and backup Edge in the configuration, the user can easily make sure that two Edge nodes simultaneously bridge traffic between Overlay and VLAN
Constraints:
Edge Cluster with minimum 2 Edge Nodes in Active/Standby mode is needed.
Standby uplinks are not supported on the Edge Node.
Source Based Load Based Teaming is not supported on the Edge Node.
The port group on the VSS/VDS sending and receiving traffic on the VLAN side should be in promiscuous mode, allowing MAC Address changes and Forge Transmits.
Deployment:
Follow the deployment guide here - https://youtu.be/IwpujflzJhYÂ
Or here https://docs.vmware.com/en/VMware-NSX-T-Data-Center/2.3/com.vmware.nsxt.admin.doc/GUID-7B21DF3D-C9DB-4C10-A32F-B16642266538.htmlÂ
Validation:
Log in to the Edge Node with your credentials.
Type ânsxcliâ.
âGet l2bridge-ports-configâ will show the Bridge Port State (Active Edge will have Forwarding, Standby will have Stopped), VLAN ID configured and Bridge UUID which can be copied and used to do a packet capture on the Edge Node.
To do the packet capture type âstart capture interface âcopied Bridge UUIDâ and hit enter, ping from VM to Physical Server to see the flows.Â
USE CASE 2 - NSX bridging firewall - Secure communication between physical database servers and Overlay workloads.
The configuration of the bridging firewall can be done currently only on the Advanced UI.
Security rules are configured per Logical Switch aka Segment in Simplified UI.Â
NSX-T grouping objects like NSGroups can be used to provide abstraction from the IP based approach.
USE CASE 3 - vRealize Network Insight - Monitoring tool that can provide visibility into both Physical and Virtual environments.Â
NSX-T 2.4 is fully supported with the latest vRealize Network Insight version 4.1.
Make sure you are allowing ports for communication between vRNI and other devices after the deployment. For example, ESXi Hosts to vRNI Collector on UDP 2055. The full list of ports needed can be found here - https://docs.vmware.com/en/VMware-vRealize-Network-Insight/3.9/com.vmware.vrni.install.doc/GUID-FDDA5F2F-7C3B-472A-A17D-39582FBD5996.htmlÂ
There is a new website that provides in-depth information about new features in vRNI, definitely worth visiting - https://vrealize.vmware.com/t/vmware-network-management/ Â
What were the outcomes?
Overall, this deployment was a complete success as we were able to satisfy all of the requirements that the customer had. All the production physical databases were able to communicate on the same L2 segments, virtualised and connected to NSX-T segments workloads. On top of that, communication between those workloads was secured by NSX-T Bridging Firewall. vRealize Network Insight was used to provide visibility into the environment. Its ability to quickly troubleshoot network and firewall related issues in both virtual and physical realms allows admins to take a breath in the never-ending battle of making the networks stable.
I hope you enjoyed my blog, if youâd like to talk to Xtravirt about your businessâs networking and security requirements, then please send an email to [email protected]
Some Useful links:
You can read more about the NSX-T 2.4 release here: https://blogs.vmware.com/networkvirtualization/2019/02/introducing-nsx-t-2-4-a-landmark-release-in-the-history-of-nsx.html/Â










