{"id":62,"date":"2021-09-20T01:59:21","date_gmt":"2021-09-20T01:59:21","guid":{"rendered":"https:\/\/bigdata.lol\/?p=62"},"modified":"2022-04-19T07:44:18","modified_gmt":"2022-04-19T07:44:18","slug":"hlb-part-1-storage","status":"publish","type":"post","link":"https:\/\/bigdata.lol\/?p=62","title":{"rendered":"HLB part 1: storage"},"content":{"rendered":"<p>After I&#8217;d had a chance to get my hands on and evaluate the Supermicro E300-9D-4CN8TP Superservers, it became clear pretty quickly that these servers would work nicely as hosts for my new lab. They were compatible with all of the requirements I&#8217;d laid out when I began work on this project, which were for the new lab environment to:<\/p>\n<p style=\"padding-left: 40px;\">1.) Have enough resources to carry all of my personal development app and database servers, plus redundant capacity.<\/p>\n<p style=\"padding-left: 40px;\">2.) Be cost-effective. (e.g., whenever it makes sense and is possible, choose decommissioned\/used enterprise-grade gear, choose previous-generation components, choose less performant components if potential cost-savings are significant)<\/p>\n<p style=\"padding-left: 40px;\">3.) Not take up a ton of (physical) space in my house.<\/p>\n<p style=\"padding-left: 40px;\">4.) Not run up my electricity bill much more than is necessary.<\/p>\n<p>Just looking at one of these Superservers next to one of my old ThinkServer towers, it was clear that these compact form-factor servers were going to go a long way toward meeting requirement number three.<\/p>\n<p style=\"padding-left: 40px;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-34 \" src=\"https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/IMG_20200104_013605.resized-e1631477508881.jpg\" alt=\"Supermicro E300-9D-4CN8TP compact server\" width=\"564\" height=\"299\" srcset=\"https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/IMG_20200104_013605.resized-e1631477508881.jpg 773w, https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/IMG_20200104_013605.resized-e1631477508881-300x159.jpg 300w, https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/IMG_20200104_013605.resized-e1631477508881-768x407.jpg 768w\" sizes=\"auto, (max-width: 564px) 100vw, 564px\" \/><\/p>\n<p>For my purposes, and because I intend to evaluate VMware vSAN in my homelab, each of my hosts will require at least three storage devices:<\/p>\n<ul>\n<li>Storage for the hypervisor OS (ESXi)<\/li>\n<li>Storage for the vSAN caching tier<\/li>\n<li>Storage for the vSAN capacity tier<\/li>\n<\/ul>\n<p>After some research and after referring to VMware&#8217;s documentation, as well as\u00a0<a href=\"https:\/\/tinkertry.com\/files\/Paul-Braren-from-TinkerTry-at-vBrownBag-VMworld-2018-US-final.pdf\">Paul Braren&#8217;s VMworld talk on vSAN storage device selection<\/a>, I felt more or less confident that I could use a thumb drive and a M.2 device for the first and second storage device requirements respectively.<\/p>\n<p>The choice for an M.2 device was not immediately obvious to me. I&#8217;d first thought to myself, &#8220;okay, this is cache so it needs to be as fast a possible, right? better look at NVMe PCIe devices&#8221;. However after some more research, I was second guessing my assumption. In short, here&#8217;s why: Power Loss Protection (PLP) and write endurance.<\/p>\n<p>While researching, I saw a recurring theme (e.g., <a href=\"https:\/\/communities.vmware.com\/t5\/VMware-vSAN-Discussions\/Buy-HCL-Listed-SATA-or-SAS-SSD-s-Why-consumer-grade-SATA-SSD-s\/m-p\/2724482#M11274\">here on VMware&#8217;s vSAN community discussion board<\/a>, and <a href=\"https:\/\/tinkertry.com\/video-overview-3-node-superserver-vsan-with-ssd-and-m2-storage\">here<\/a>) on the importance of selecting devices that had Power Loss Protection (PLP) capability for shared storage applications, including vSAN. After poring over product datasheets for several consumer-grade PCIe and SATA storage devices, I found PLP mentioned in only a couple datasheets. Maybe my search wasn&#8217;t thorough enough, but I couldn&#8217;t find any M.2 PCIe NVMe devices that were equipped with PLP <em>and<\/em> available on the used market. However I did find a handful of M.2 SATA device models that I could positively confirm as being PLP-capable.<\/p>\n<p><strong>UPDATE:<\/strong> Around a year or so after I completed my lab build, I started to see a couple M.2 form-factor models of enterprise-grade PCIe NVMe SSDs popping up on eBay. Keep your eyes peeled for Seagate&#8217;s Nytro SSDs and for Micron 7300 SSDs. They are both PLP-capable and are also worth considering for folks looking for M.2 form-factor PCIe devices for their vSAN caching tier!<\/p>\n<p>If you&#8217;re going through the process of reviewing datasheets for storage devices, you may want to also look out for write endurance specs. Write endurance isn&#8217;t necessarily critically important for every application, but it&#8217;s another point to consider. It&#8217;s worth noting that the datasheet for one model of PLP-equipped SATA SSD featured a write endurance nearly double that of (what were, at the time) the best performing NVMe SSDs.<\/p>\n<p style=\"padding-left: 40px;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-79\" src=\"https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/micron_5100_write_endurance.png\" alt=\"\" width=\"787\" height=\"166\" srcset=\"https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/micron_5100_write_endurance.png 1057w, https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/micron_5100_write_endurance-300x63.png 300w, https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/micron_5100_write_endurance-1024x216.png 1024w, https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/micron_5100_write_endurance-768x162.png 768w\" sizes=\"auto, (max-width: 787px) 100vw, 787px\" \/><\/p>\n<p style=\"padding-left: 40px;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-80\" src=\"https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/samsung_970_write_endurance.png\" alt=\"Samsung 970 SSD write endurance\" width=\"509\" height=\"100\" srcset=\"https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/samsung_970_write_endurance.png 733w, https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/samsung_970_write_endurance-300x59.png 300w\" sizes=\"auto, (max-width: 509px) 100vw, 509px\" \/><\/p>\n<p>Now that I knew which devices would work, it was time to head to eBay. It wasn&#8217;t long before I found a good deal on a few Micron 5100 MAX SATA III solid-state drives, which also happen to be listed among the devices that VMware supports for use as vSAN cache devices (not a strict requirement for my homelab build, but definitely preferred).<\/p>\n<p style=\"padding-left: 40px;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-27\" src=\"https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/IMG_0007.resized.resized.jpg\" alt=\"M.2 SSD and USB flash drive installed in E300-9D-4CN8TP\" width=\"560\" height=\"420\" srcset=\"https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/IMG_0007.resized.resized.jpg 1008w, https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/IMG_0007.resized.resized-300x225.jpg 300w, https:\/\/bigdata.lol\/wp-content\/uploads\/2021\/09\/IMG_0007.resized.resized-768x576.jpg 768w\" sizes=\"auto, (max-width: 560px) 100vw, 560px\" \/><\/p>\n<p>Now that I&#8217;d solved for the first two storage devices, it was time to figure out what I was was going to do for each host&#8217;s vSAN capacity tier storage. As you can see, there&#8217;s only room for one 80mm M.2 device on the server motherboard and I had just filled that space. The E300-9D-4CN8TP motherboard has a few different ports that could be used for connecting one or more additional SATA devices, but there&#8217;s not really much room in the server chassis for anything else, except for maybe a single 2.5&#8243; HDD or SSD.<\/p>\n<p>To solve this problem and still adhere to my project requirements, it looked like I would need to locate my vSAN capacity devices externally. I cover the details of the solution I chose in my second post. Thank you for reading!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>After I&#8217;d had a chance to get my hands on and evaluate the Supermicro E300-9D-4CN8TP Superservers, it became clear pretty quickly that these servers would work nicely as hosts for my new lab. They were compatible with all of the requirements I&#8217;d laid out when I began work on this project, which were for the new lab environment to: 1.) Have enough resources to carry all of my personal development &hellip; <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-62","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/bigdata.lol\/index.php?rest_route=\/wp\/v2\/posts\/62","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bigdata.lol\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bigdata.lol\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bigdata.lol\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bigdata.lol\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=62"}],"version-history":[{"count":11,"href":"https:\/\/bigdata.lol\/index.php?rest_route=\/wp\/v2\/posts\/62\/revisions"}],"predecessor-version":[{"id":179,"href":"https:\/\/bigdata.lol\/index.php?rest_route=\/wp\/v2\/posts\/62\/revisions\/179"}],"wp:attachment":[{"href":"https:\/\/bigdata.lol\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=62"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bigdata.lol\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=62"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bigdata.lol\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=62"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}