#vsphere5

vSphere 5 から Image Builder という機能が増えました。 ドライバーやパッチをプリインストールしたブータブル ESXi イメージが作れるという機能です。

何台も ESXi を立てる時に Ethernet や HBA の最新ドライバーを入れたり、VMware のパッチを 当てたりするのが面倒なので、動作確認をしてみました。 # vCenter があれば Update Manager が使えるって話もあるけど、使えない時もあるよね。

とりあえず、PowerCLI が入ってるものとして話を進めます。

まず VMware から素の ESXi5 ImageProfile を持ってきます。マニュアルには書いてないけど、 海外のブログを参考にしました。

PowerCLI D:\> Add-EsxSoftwareDepot -DepotUrl https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/vmw-depot-index.xml Depot Url --------- https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/vmw-depot-index.xml

これでローカルの作業領域に ESXi5 ImageProfile が作られるので内容とかを確認します。

PowerCLI D:\> Get-EsxImageProfile Name                           Vendor          Last Modified   Acceptance Level ----                           ------          -------------   ---------------- ESXi-5.0.0-20110904001-notools VMware, Inc.    2011/08/26 1... PartnerSupported ESXi-5.0.0-469512-no-tools     VMware, Inc.    2011/08/19 1... PartnerSupported ESXi-5.0.0-20110904001-stan... VMware, Inc.    2011/08/26 1... PartnerSupported ESXi-5.0.0-469512-standard     VMware, Inc.    2011/08/19 1... PartnerSupported

2011/09/20 時点では下記のものが登録されています。

ESXi-5.0.0-469512-standard

ESXi-5.0.0-469512-no-tools

ESXi-5.0.0-20110904001-standard

ESXi-5.0.0-20110904001-notools

469512 は 8/24 にリリースされた最初の 5.0.0 ですね。20110904001 は 9/4 に出たパッチが 適応されたものです。

standard/notools となっているのは VMware Tools の有無です。VMware Tools を含まない イメージは PXE boot などで利用するようです。詳細は KB2004018 参照。

今回は Image Builder を使って作ったカスタムイメージで普通にインストールしたいだけなので standard をベースにして、クローンします。

PowerCLI D:\> New-EsxImageProfile -CloneProfile ESXi-5.0.0-20110904001-standard -Name MyProfile -AcceptanceLevel CommunitySupported Name                           Vendor          Last Modified   Acceptance Level ----                           ------          -------------   ---------------- MyProfile                      VMware, Inc.    2011/08/26 1... CommunitySupported

ドライバーやパッチを入れる場合は、この Image Profile に offline-bundle を適応します。

ここでは試しに Brocade の HBA のドライバーを入れてみましょう。Brocade のサイトから HBA のドライバーを落とします。BCD-bfa-3.0.0.0-00000-offline_bundle-465342.zip です。

で、こんな感じでインストールします。

PowerCLI D:\> Add-EsxSoftwareDepot D:\BCD-bfa-3.0.0.0-00000-offline_bundle-465342.zip Depot Url --------- zip:D:\BCD-bfa-3.0.0.0-00000-offline_bundle-465342.zip?index.xml PowerCLI D:\> Get-EsxSoftwarePackage -Vendor Brocade Name                     Version                        Vendor     Release Date ----                     -------                        ------     ------------ scsi-bfa                 3.0.0.0-1OEM.500.0.0.406165    Brocade    2011/07/22 23... PowerCLI D:\> Add-EsxSoftwarePackage -ImageProfile MyProfile -SoftwarePackage scsi-bfa Name                           Vendor          Last Modified   Acceptance Level ----                           ------          -------------   ---------------- MyProfile                      VMware, Inc.    2011/09/20 1... CommunitySupported

途中、Get-EsxSoftwarePackage で -Vendor Brocade を指定していますが、指定しないと VMware の VIBs もズラズラと表示されてアレなので便宜上こうしてます。

vihostupdate.pl のように追加で投入したドライバーやパッチだけ表示してほしいですね。 まぁ、なんかやり方があるのかもしれませんが。

こんな感じでどんどん必要なドライバーやパッチを適応したら、最後に書き出して使います。 書き出し方法は ZIP と ISO が選べます。

ZIP のほうが、後で Add-EsxSoftwareDepot してパッチを足したりできるようなので、 ISO だけ必要な場合でも作っておくとメンテナンスが楽かも。

PowerCLI D:\> Export-EsxImageProfile -ImageProfile MyProfile -ExportToBundle D:\ESXi-5.0.0-474610+BCD-bfa.zip

ISO はブータブルになるので、これでインストールするとドライバーやパッチが適応された状態で インストールされます。

PowerCLI D:\> Export-EsxImageProfile -ImageProfile MyProfile -ExportToIso D:\ESXi-5.0.0-474610+BCD-bfa.iso

完成後のサイズはこんな感じ。

PowerCLI D:\> dir     ディレクトリ: D:\ Mode                LastWriteTime     Length Name ----                -------------     ------ ---- -a---        2011/09/20     14:38    1091422 BCD-bfa-3.0.0.0-00000-offline_bundle-465342.zip -a---        2011/09/20     15:07  306077696 ESXi-5.0.0-474610+BCD-bfa.iso -a---        2011/09/20     15:05  296550093 ESXi-5.0.0-474610+BCD-bfa.zip

ドライバーやパッチがキチンと適応されているかどうかは色々と確認方法がありますが、 今回は Local ESXi Shell で確認しました。

~ # esxcli software vib list | grep Brocade scsi-bfa              3.0.0.0-10EM.500.0.0.406165        Brocade  VMwareCertified   2011-09-20

I've been very slow to get this out so here it is.  I've been asked many times about the vTesseract homelab.  I've tweeted about the lab often and have received numerous recommendations.  My homelab is for personal use but while in operations I used it extensively for testing PowerShell scripts.  I've also used my homelab for various projects, blogging, and most importantly obtaining my VCAP certifications.  There is no greater investment in learning than a decent homelab.  TrainSignal subscription doesn't hurt either.

The vTesseract lab consists of 3 ESXi hosts, a small NAS, an old desktop, a managed switch, and a variety of useful VMs.  Like any good infrastructure design let's discuss the requirements.  The biggest point of discussion on twitter about my lab has been location.  The vTesseract Lab is required to be in my master bedroom.  As such the following requirements are largely driven based on this constraint.  Silly kids taking up all of my space!

Requirements

Space - Needs to be as compact as possible.

Power - Not trying to break the bank here.

Heat - Gear sits in master bedroom so this needs to be kept to a minimum.

Noise - Bedroom = Keep it quiet.

Compute - Do not need massive horsepower here.  Simple VMs

Storage - Size is primary but want iSCSI and NFS capabilities

Cost - Not a rich man so need it to be something that is relatively cost effective with a good ROI/TCO

Mrs. requires that all lights and flashy bits need to be covered...except the switch which is tucked away.

VMs

In the vTesseract lab I host a variety of VMs.  The primary ESXi installs and vCenter are vSphere 5.1.  Within the lab I host vSphere 4.1, 5.0, 5.1, and an undisclosed beta version.  I power these on and off on demand.  Supporting these VMs are:

 Active Directory server

CloudPhysics Observer

Veeam B&R Server for backup (in progress)

VMA,

VCMA iPad Interface :)

vCloud Director

vCO Appliance

Splunk server for logs (in progress)

Storage

At the core of the vTesseract lab is the Iomega IX4-200D NAS.  Right now I'm sitting with 4x1TB drives giving me 2.7TB usable space.  I split that up between iSCSI and NFS shares for hosting my VMware environment.  It's not the fastest storage on the planet and I truly wish I had a Synology but it's what I have.  This thing has been a great little NAS overall and with an 8"x8" base it has satisfied my requirements 1-4.  The only thing I come across is it can be noisy when doing operations.  I try not do these overnight because of that. 

I hope to upgrade in 2014 with a second higher performance array.  I want to splurge for a Synology but it will likely be another Iomega given discounting opportunities for that product.  Yes. I really want a small flash array. :)

I also have added an Iomega IX2 that I purchased from a co-worker who didn't need it any longer that gives me 2TB.  I'm configuring this to backup iPhone Videos and Photos as well as key VMs in my homelab using Veeam.  I've added it to the outline here because backup is important.  Especially if your house has been struck by lightning.

Storage Cost

Iomega IX-4 200D 4TB = $575

Iomega IX2 = $250

  Compute

This is the more controversial component of my homelab. I was inspired to use a Mac Mini when I saw William Lam @lamw made some posts showing how he was using one to run ESXi.  Truly the work he has posted, such as http://www.virtuallyghetto.com/2013/04/installing-esxi-51-update-1-on-mac-mini.html, has made my lab possible given some of the time constraints I've had.

I use a trio of Mac Mini computers with 16GB of memory each.  Only 48 GB of RAM in what some of my peers call "overpriced servers".  I don't disagree about the pricepoint but I have specific requirements.  My homelab is located on a small desk in my master bedroom (see photo below).  This means that while my children have their own spacious rooms for their toys, my toys must fit in an 8"x8" square stacked 11" tall.  The Mac Minis met all of my requirements, save having to pay a slight premium for the form factor.  I'll talk on this a bit more in a moment.

I have the Mac Mini 6,1 with the i5 dual core processor.  I had considered splurging for the i7 quad core. I have found that the i5 has provided plenty of horsepower for my needs and as such saved me lots of money overall.

The Mac Mini 6,1 comes with 4GB of RAM.  I performed an in-field upgrade to the maximum 16GB of RAM on each.  This ran me an additional $100-130 for each system.  I also added the $30 Thunderbolt NIC adapter.  One of the complaints about the Mac Mini as a homelab solution is the lack of NICs.  In truth in our new converged network adapter world I have found that a 2 NIC configuration matches up nicely and has provided all the bandwidth I "need".

Final component to the Mac Minis is that I'm booting ESXi from USB Flash drives I have acquired over the years as swag.  Most of them are of the 2GB variety and have served well.  My primary reason for doing this is that it a) meets my needs and b) allows me to pull the flash drive, reboot and I have a fully functioning Mac Mini.  This has come in handy multiple times and I eventually plan to upgrade each Mac Mini.  This should make re-purpose or resell a bit easier. 

The Mac Minis sit nicely on top of the Iomega IX4 array.  I use some rubber pot-holders between the Mac-Minis to provide some grip so they don't slide around.

Mac Mini Costs

3 x 750 = $2,250  | Best Buy 0% 18 months and on sale each purchase

Power Requirements = Low

Heat Output = Low

Space = Low

Resell Value = High

Performance = Reasonable

Compute p2

I also utilize my home desktop for my homelab running VMware  Workstation 9.  I was fortunate to get a free copy of Workstation 9 so that cost isn't being factored in.  The desktop is an old Dell Precision 690 Workstation with a quad-core Xeon processor.  I updated the memory to 20GB when pursuing my VCAPs and it serves nicely for side/non-critical VMs (think VMA, VCMA,etc).  Since it's a Xeon processor it requires fully buffered DIMMs which drove the cost up a bit.  This box served well but had some problems.

Only 20GB which I had to share with other applications

Had to shutdown entire lab in order to reboot the computer

Processor didn't support running nested 64-bit VMs which made deploying many appliances VERY challenging.  Inception is the only way to get by with 20GB of RAM.

Memory Upgrade = $400 | Amazon

Network

The core component of the my homelab network is the Cisco SG-300-10 Managed Switch.  This is a powerful little gigabit swtich that allows me to configure VLANs, which sadly I have done little of for a variety of reasons.

Since the lightning strike I discuss in the Power section blew up 2 ports on this switch I'll be looking to add a SG300-20 as my primary in the not too distant future.  I've also reached the port capacity on the SG300-10 even without having lost ports.  I'll then use the SG300-10 for redundancy, like a proper network design. :)

Cisco SG300-10 Switch  = $225 | Amazon.com

Cat6 Cables - Colored x 10 = ~$30 | Monoprice.com (I love Monoprice.com)

Coming Soon: Cisco SG300-20 Switch = $315 | Amazon.com

Power Protection

If there's one thing that can really destroy your homelab experience it is significant power issues.  I consider a lightning strike a significant power issue.  Last summer we got hit during a storm and the surge blew up my previous UPS and surge protectors.  This required me to replace nearly all networking gear and one of my drives in the Iomega IX4.

The best investment I've made in the entire homelab has been my APC BR1500G UPS.  Since everything is pretty low power draw this guy can keep things safe and running for quite a while.  I ended up purchasing 2 so I could protect my wireless router, the Iomega IX2, cable modem, etc. since they're located away from my desk.

UPS = $189 x2 = $378.00

Summary

The key to my homelab were my requirements and being realistic about my needs in order to run and test various applications.  I have received tremendous value out of my homelab.  It has allowed me to produce some interesting content, reproduce items, test scripting, obtain certifications.  While my lab isn't the most powerful, cheapest, or most flexible it does solve all of my primary requirements.

Cost Summary

Mac Minis - $2,250.00

Desktop Memory - $400.00

Iomega IX4 - $575.00

Iomega IX2 - $250.00

Cisco SG300-10 and Cables - $255.00

UPSs - $378.00

Total = ~ $4100 (over 2 years)

Exciting news everyone. Scott Lowe and Forbes Guthrie have joined forces again for the vSphere Design Book, 2nd Edition! It’s available to order!

Forbes mentions on his blog vreference.com that Maish Saidel-Keesing was not able to be a part of the update though his 1st Edition work is still evident. Disappointing as that may be it is great to see that they have included a new chapter on design considerations for vCloud Director. This section, written by fellow VCE employee Kendrick Coleman, should provide instruction for those interested in designing their vSphere environment to include vCloud components.

The book releases this coming week and I for one can’t wait to get my hands on it. Even though I’ve achieved VCAP-DCD I’m past due for an upgrade to v5. I anticipate this book to be a valuable resource for the exam just as the first edition was for VCAP4-DCD. You can order the book on Amazon

I mentioned briefly about the welcome addition of the vCloud chapter. I hope that in the near future the publisher can convince Kendrick or someone to put together an equally excellent resource specifically for the vCloud Suite as a value add for designing these environments and preparation for the VCAP-CID exam.

Grab the book and send feedback to Scott Lowe (@Scott_Lowe), Forbes Guthrie (@ForbesGuthrie), and Kendrick Coleman (@KendrickColeman). I’ll plan to make a review once I get an opportunity to read it.

vSphere 5 Video - iSCSI User Interface (by EricSloof)

The author over at vReference.com has created this amazingly thorough reference card for vSphere 5.0. I will be printing this and adding it to my arsenal of study materials for my VCP-510 exam in March.

Direct links:

A-4

Letter

Full page

2011 certainly ended on a pretty high note for me.  I'm one of those folks that need the next challenge and it is likely I'm setting myself up pretty well.  I'm outlining a few things here that I'm hoping to work on in 2012.  Some of them may not pan out while I'm sure new things will creep up throughout the year.  If last year was any indication I have no idea exactly what I'll be talking about next year at this time but I hope some of these things are included.

Personal

Work is great but nothing beats picking my son up from daycare or coming home and have him running to me for a hug.  My wife is amazing and very supportive of me.  In truth I think it doesn't hurt that she's looking forward to being a full-time stay at home mom again.  Regardless my family makes everything I do that much more rewarding.  That being said here are some things we're looking forward to in 2012.

Looking forward to Baby #2 due in May

Take some time off.  The new baby and a soon to be stay at home mom really makes me want to spend more time at home with the family.  I see no reason why I can't have both! :)

Potty Training 2.0 - yay

Start Learning Bourbon

Pick Spanish back up

Get a gun and learn proper safety

Get the family passports and plan a trip

Technologies

I am sure I will touch a wide variety of technologies in 2012 but here are a few that I know I'll be getting my hands on quite a bit.  Definitely looking forward to building up some knowledge and hopefully making some cool scripts and tools.

PowerCLI - Of course!

vCenter Orchestrator

Tidal Automation

vSphere 5

vCloud Director

Cisco UCS

NetApp

Community Organization

Since HS I've been an avid community organizer.  I've led a wide variety of groups under a multitude of topics.  I've found myself lately working in an advisory role and helping organize speakers.  This year I plan to really only lead the Raleigh VMUG and organize vBeers Raleigh but here's a list of some of the community stuff I plan to work on this year in some fashion or another.

  Raleigh VMUG - Really hoping to work with my co-leader Todd Robinson and ramp up our local VMUG in 2012

NC UCS Users Group - I've been working in an advisory role and helping with social media marketing for this group.  I'm hoping to keep that up in the coming year and help that organization grow.

#vBeersRaleigh - I really love organizing vBeers and I plan to do so at least once a month in 2012.

Carolina Users Summit in Charlotte - I've worked some with the organizers for this event and I'm hoping I can make some contributions as the planning continues.

Raleigh/Triangle PowerShell Group - Would love to see this crop up in the area.  While I don't think I'll have the time to do it myself

vCommunity Trust - I try to help these folks wherever I can.  If you don't know about them then I'm not doing my job so click the link already and give them some cash.

Certifications

Despite my recent behavior I'm not really a certification zealot.  They're a pain in the neck, they're costly, and depending on what you do they are borderline worthless.  However, I do like a challenge and I like that they force me to focus on something to a degree that I feel I might as well take the test and get the cert.  The VCAPs were very rewarding and I learned a fair amount during that process that translated to big help back at the office.  Therefore I'll keep going at them as time allows.

VCP5 - A Must before Feb 29

VCAP5-DCA and DCD - Yea, I'll probably have to update to these at some point in 2012

VCDX???  This one will really depend on a number of factors but chances are I'll start working on this during late 2012 or early 2013.

Other Certs?  Not out of the question but not a current goal right now.

Content Contributions

This year I'm really hoping to up the caliber of my content.  I'm not trying to go too crazy but I do think that I've gained enough experience over the last 6 months to know what works for me.  Having a new kid on the way will certainly eat in to my time and energy dramatically so I'll be taking time in 2012 to focus on a fewer items, but hopefully richer content.  Here are a few things I'm hoping to accomplish for 2012:

Submit presentation for VMworld on Automation

Plan to release Test-vMotion v2

A few other scripts up my sleeve and hopefully some workflows.

Hoping to start a monthly podcast

More Blog, More Twitter

MOVE BLOG to new platform and redesign (in the works)

2012 Is going to be a busy year and I'm so glad to get started.  Between expanding my family and branching into new technologies I think this year will be my most fulfilling yet!  If you're a regular reader of my blog I'm looking forward to going through the year with you.  If you're new then welcome and I hope I provide content that keeps you coming back.  Happy new year (belated)!

May the road rise up to meet you.