vSphere

Record and Replay vSphere Inventory using govc and vcsim

01/04/2021 by William Lam 2 Comments

Happy New Year! 🥳

I wanted kick off 2021 with something I had just learned about right at the end of 2020 which I think this will be useful going into the new year for a number of different use cases. Back in 2017, I wrote about a new and lighter weight version of the vCenter Simulator (vcsim) which had been developed as part of the govmomi (vSphere SDK for Go) project. Since then, the govmomi project has grown exponentially and is now integral to a number of popular open source projects such as Packer builder for vSphere, Terraform provider for vSphere and Kubernetes Cluster API for vSphere (CAPV) to just name a few.

Govmomi is also heavily used internally by VMware for both development and testing purposes. In fact, it has been used to build a number of new VMware features such as the vSphere Integrated Containers (VIC) solution and most recently the vSphere with Tanzu capability that was introduced in vSphere 7.0.

Getting back to vcsim, this has been an invaluable tool for both our VMware developers but also the general VMware community. The ability to "simulate" a mocked vSphere environment with a basic inventory can be extremely useful for learning about the vSphere API and interacting with this endpoint using any vSphere SDK including PowerCLI. For automation folks, this can be useful for designing and creating your scripts in an offline mode before testing it against a real environment. For folks building 3rd party solutions that includes a visual interface, this is an easy way to test out your UI and ensure that there are no issues for large vSphere inventories which can be difficult to validate in a development environment.

Simulating a fake vSphere inventory is great, but it also has its limitations. There are so many unrealized use cases if you could capture a real vSphere inventory and then replay that back using vcsim. Just think about a bug reproduction use case and being able to share a real vSphere inventory with a development or QA team without needing to provide them direct access to the production environment?

In my opinion, this was the missing key feature from the original vcsim. To my surprise, this functionality was actually added to govc/vcsim earlier last year and I was quite happy with its implementation! Let's now take a closer look at how the record and replay functionality of govc/vcsim works.

Adobe Flash is going away, is your VMware environment and IT Organization ready for it?

10/29/2020 by William Lam 11 Comments

Hopefully this news should not come as a surprise to anyone but at the end of this year (December 31, 2020), Adobe and all mainstream web browsers will remove Flash functionality preventing users from interacting with any Flash-based web applications. This will also impact usage of VMware products that still uses Flash such as older versions of vSphere with the vSphere Flash Web Client or vCloud Director with their Flash-based Tenant UI as an example.

The large majority of VMware customers have already migrated off to newer versions of VMware products that no longer rely on Flash and this announcement will be a no-op for them. However, the reality is that not every customer has been able to meet this deadline for one reason or another will still have VMware products running in their Production environment that uses Flash even after the official end of life.

For these customers, it is really important to understand what are some of the implications and considerations to be aware of leading up to end of the year.

Using ESXi-Arm Fling as a lightweight vSphere Automation environment for PowerCLI and Terraform

10/09/2020 by William Lam 1 Comment

A set of use cases that I was really excited for when I first heard about ESXi-Arm a few years ago was around the topic of vSphere Automation and Development. I speak with many customers who are just starting out on their Automation journey whether that is using PowerCLI, one of our many vSphere Automation SDK or even directly to the new vCenter REST API which all new features are being exposed through these days.

One of the biggest challenge for new comers is simply getting access to hardware that they can start playing around with and although there are is plethora of vSphere Homelab choices, it does require some amount of investment, which is definitely worth it in the long run. However, if you are just getting started and maybe you want something that is a bit more lighter weight, there are not too many options outside of an Intel NUC. I know many consultants actually carry around an Intel NUC that contains several VM images that they use to with their clients, including demos.

With the small form factor, low cost and reduced power consumption of the Raspberry Pi, I think this really opens up the door for some interesting creative solutions:

Basic vSphere footprint that can be used for work or learning purposes
Easy way to learn and explore the vSphere API with an actual host and enabling real VM deployments
Trying out Infrastructure-as-Code (IaC) tools such as Terraform and Ansible
Quick way to run through basic demos in front of customers
On-demand and self-contained lab environment for small Hackathon at your local VMUG or even at VMworld

Something I was really interested in early on was to be able to use ESXi-Arm with the Raspberry Pi to not only have a basic ESXi environment but also have PowerCLI environment up and running in an Arm VM. My first thought was to get this setup using Photon OS, which not only has Arm distribution but also has support for Powershell and PowerCLI. I was hoping with some tinkering, I could easily get Powershell for Arm to run on PhotonOS (which it did) but I then ran into issues installing PowerCLI itself.

I decided to give up for now and take a look at Ubuntu which also supports Powershell for Arm, but the Microsoft documentation only listed instructions for 32-bit and ESXi-Arm requires a 64-bit. Taking a look at the Powershell release files, I noticed there was 64-bit package and with a few minor adjustments to the commands, I got PowerCLI installed and connected back to my rPI which was attached to my x86 vCenter Server!

vSAN Witness using Raspberry Pi 4 & ESXi-Arm Fling

10/08/2020 by William Lam 32 Comments

As hinted in my earlier blog post, you can indeed setup a vSAN Witness using the ESXi-Arm Fling running on a Raspberry Pi (rPI) 4b (8GB) model. In fact, you can even setup a standard 2-Node or 3-Node vSAN Cluster using the exact same technique. For those familiar with vSAN and the vSAN Witness, we will need to have at least two storage devices for the caching and capacity tier.

For the rPI, this means we are limited to using USB storage devices and luckily, vSAN can actually claim and consume USB storage devices. For a basic homelab, this is probably okay but if you want something a bit more reliable, you can look into using a USB 3.0 to M.2 NVMe chassis. The ability to use an M.2 NVMe device should definitely provide more resiliency compared to a typical USB stick you might have lying around. From a capacity point of view, I had two 32GB USB keys that I ended up using which should be plenty for a small setup but you can always look at purchasing large capacity given how cheap USB devices are.

Disclaimer: ESXi-Arm is a VMware Fling which means it is not a product and therefore it is not officially supported. Please do not use it in Production.

With the disclaimer out of the way, I think this is a fantastic use case for an inexpensive vSAN Witness which could be running at a ROBO/Edge location or simply supporting your homelab. The possibilities are certainly endless and I think this is where the ESXi-Arm team would love to hear whether this is something customers would even be interested in and please share your feedback to help with priorities for both the ESXi-Arm and vSAN team.

In my setup, I have two Intel NUC 9th Pro which make up my 2-Node vSAN Cluster and then an rPI as my vSAN Witness. Detailed instructions can be found below including a video for those wanting to see vSAN Witness in action by actually powering on an actual workload 😀

My Raspberry Pi 4 BOM for ESXi-Arm Fling

10/07/2020 by William Lam 12 Comments

With the release of the highly anticipated ESXi-Arm Fling, I thought it would be useful to share my hardware build-of-materials that I am currently using with ESXi-Arm Fling, especially as folks have been asking about what is possible or things to be aware of before purchasing a Raspberry Pi.

I do want to stress that the components listed below is just one of many options, it is highly recommend folks carefully review the ESXi-Arm Fling documentation to understand which accessories are supported along with some of their constraints prior to making a purchase.

Devices from Left to Right:

ESXi on Arm Fling is LIVE!

10/06/2020 by William Lam 17 Comments

The highly anticipated ESXi on Arm Fling has just been announced and is NOW generally available as a new VMware Fling! Head over to https://flings.vmware.com/esxi-arm-edition and be sure to carefully read through the Requirements and documentation before try out the bits.

History

Although ESXi-Arm was publicly demo'ed at VMworld Europe 2018 during the closing keynote by Ray O'Farrell (former CTO of VMware), the reality was there was a ton more to do before ESXi-Arm could be a reality for VMware customers. The newly formed ESXi-Arm team at VMware has been hard at work these last couple of years working with both Arm and its eco-system in extending hardware standards, firmware standards (open contribution to UEFI), and certification beyond the existing Arm server ecosystem, which enabled us to support platforms like SmartNICs and the ubiquitous Raspberry Pi. This is just a glimpse into what it took to get where we are at today.

I am also excited to share that the Virtually Speaking Podcast crew has invited us back for an exclusive episode featuring both Andrei Warkentin and myself to dive deeper into the development of ESXi-Arm project at VMware. This is an episode you will not want to miss!

Hardware

The ESXi-Arm Fling supports a number of different Arm platforms ranging from a traditional Datacenter form-factor to both Near and Far Edge systems including the highly requested Raspberry Pi (rPI)! With the rPI, only the 4b model will be supported and although both the 4GB and 8GB memory model works with ESXi-Arm. We highly recommend folks invest in the 8GB model to be able to take advantage of more vSphere features and be able to run more workloads.

For a complete list of supported Arm hardware platforms, please refer to the Requirements section of the Fling website. If there are other platforms you would like to see get added, do not hesitate to either leave a comment here and/or post directly on the ESXi-Arm Fling page.

vCenter Support

For customers with an existing x86 vCenter Server or those that would like to deploy a new vCenter Server, you will be able to attach and manage ESXi-Arm hosts just like you normally would as long as you are using vCenter Server 7.0 or greater.

We expect the majority of vSphere platform features to "just work" like vMotion but there may be some features that may not work or have additional requirements.

For example, to enable vSphere HA and/or vSphere FT, the Fault Domain Manager (FDM) Client VIB must be installed on an ESXi-Arm host. Today, this VIB is distributed as part of vCenter Server and only x86 version of the client is available. We do provide FDM Client VIBs for ESXi-Arm as part of the ESXi-Arm Fling, but support will be limited to vCenter Server 7.0c and 7.0d. For detailed instructions, please refer to the ESXi-Arm documentation.

VMware Tools

VMware Tools for ESXi-Arm GuestOS is not bundled as part of ESXi-Arm Fling, but can be installed. To do so, you will need to compile open-vm-tools for your respective GuestOS. Instructions can be found in the ESXi-Arm Fling documentation and below, you can see a screenshot of VMware Tools for Arm successfully running on Ubuntu 20.04 GuestOS running on ESXi-Arm on the rPI 4.

vSAN Witness

Lastly, a popular use case that has been brought up when ESXi-Arm was initially demo'ed was the use of the rPI as an inexpensive vSAN Witness, which is a fantastic use case for ROBO & Edge locations. I am very happy to share that using an rPI 8GB as a vSAN Witness works! As you can see from the screenshot below, I have two physical Intel NUC 9th Pro configured in a 2-Node vSAN Cluster and I am using the rPI as vSAN Witness 😀

In case this was not clear, this is NOT officially supported but it does demonstrate the viability of this concept and and feedback from the our users would help drive the priority and the potential support for such a configuration. More details will be shared in a future blog post outlining the instructions on using rPI as vSAN Witness. Stay tuned!

As you can see, this is just a small taste of what can be done with the ESXi-Arm Fling and the possibilities are truly endless! The ESXi-Arm team is very excited to see what the community will do with the ESXi-Arm Fling, what type of use cases are you solving or workloads that you are running. Below are a few ways in how you can engage with the ESXi-Arm team and community.

ESXi-Arm Engagement

For general questions/issues, please leave a Comment and/or file Bug on the ESXi-Arm Fling site
Follow ESXi-Arm on Twitter: @esxi_arm
Follow the official ESXi-Arm Blog: https://blogs.vmware.com/arm
Chat with the ESXi-Arm team and community on Slack: #esxi-arm-fling on VMware {code}
For other inquiries or engaging with ESXi on ARM Product Team, you can send an email to esxionarm [at] vmware [dot] com