This is the second in a series of posts about my new dual-Xeon Citrix lab project. All the components are in my hands—now it is time to put the server together!
More from the Lab!
- Building a Dual-Xeon Citrix Lab: Part 1 – Considerations
- Building a Dual-Xeon Citrix Lab: Part 2 – Hardware
- Building a Dual-Xeon Citrix Lab: Part 3 – Windows and Hyper-V installation
- Lab: Part 4 – Hyper-V Networking
- Lab: Part 5 – NetScaler 11 Architecture and Installation
- Lab: Part 6 – Configure NetScaler 11 High Availability (HA Pair)
- Lab: Part 7 – Upgrade NetScalers in HA
- Lab: Part 8 – Save, Backup and Restore NetScaler 11 configuration
- Lab: Part 9 – Install Microsoft SQL Server 2014 (Dedicated)
- Lab: Part 10 – Citrix Licensing demystified
- Lab: Part 11 – Install XenDesktop 7.6
- Lab: Part 12 – Setup NetScaler 11 Clustering (TriScale)
- Lab: Part 13 – Configure Published Applications with XenDesktop 7.6
- Lab: Part 14 – Citrix StoreFront 3.x
- Lab: Part 15 – Configure SSL in StoreFront
- Lab: Part 16 – StoreFront load balancing with NetScaler (Internal)
- Lab: Part 17 – Optimize and secure StoreFront load balancing with NetScaler (Internal)
- Lab: Part 18 – Secure LDAP (LDAPS) load balancing with Citrix NetScaler 11
- Lab: Part 19 – Configure Active Directory authentication(LDAP) with Citrix NetScaler 11
- Lab: Part 20 – RDP Proxy with NetScaler Unified Gateway 11
- Lab: Part 21 – Secure SSH Authentication with NetScaler (public-private key pair)
- Lab: Part 22 – Ultimate StoreFront 3 customization guide
- Lab: Part 23 – Securing Citrix StoreFront DMZ deployment
- Lab: Part 25 – Upgrade to Citrix StoreFront 3.7
- Lab: Part 26 – Install/Upgrade Citrix XenDesktop 7.11
- Lab: Part 27 – Getting started with Microsoft Azure
- Lab: Part 28 – Getting started with Citrix Cloud
- Lab: Part 29 – Configure XenDesktop And XenApp Service with Microsoft Azure and Citrix Cloud
- Lab: Part 30 – Configure Identity and Access Management in Citrix Cloud with Microsoft Azure AD
- Lab: Part 31 – Configure NetScaler Gateway Service for XenApp and XenDesktop Service in Citrix Cloud
- Lab: Part 32 – Configure MCS with XenDesktop and XenApp Service in Citrix Cloud
- Lab: Part 33 – Configure Azure Quick Deploy with XenDesktop and XenApp Service in Citrix Cloud
- Lab: Part 34 – Configure Site Aggregation for Citrix Workspace in Citrix Cloud with XenDesktop 7.x located on-premises
- Lab: Part 35 – Configure a Hybrid NetScaler MA Service environment in Citrix Cloud
- Lab: Part 36 – Configure ShareFile in Citrix Cloud with StorageZones on-premises
- Lab: Part 37 – Upgrade NetScaler HA pair with NetScaler MA Service in Citrix Cloud
- Lab: Part 38 – How to Configure Full VPN Setup with Citrix NetScaler in CLI
- Lab: Part 39 – Configure Multi-Factor Authentication with Azure MFA Service and Citrix Workspace
- Lab: Part 40 – Getting Started with Citrix App Layering
- Lab: Part 41 – Configure Citrix App Layering
- Lab: Part 42 – OS Layer with Citrix App Layering
- Lab: Part 43 – Platform Layer with Citrix App Layering
- Lab: Part 44 – Application Layers with Citrix App Layering
- Lab: Part 45 – Layered Image Deployment with Citrix App Layering
- Lab: Part 46 – Elastic deployment with Citrix App Layering
- Lab: Part 47 – User Layers with Citrix App Layering
- Lab: Part 48 – Windows 10 and PVS with Citrix App Layering
As you may have seen on Twitter, I received all the components in less than three days. Building the server is the quickest part of the project, as it usually takes only a few hours to assemble everything.
Lab components are here ! #citrix # lab pic.twitter.com/3R6SByPHS8
— Citrix Guru (@citrix_guru) August 11, 2015
Precautions
Before touching anything, Tomshardware.com has identified three common causes of failure while manually assembling components of a new server:
- ESD (accidental electrostatic discharge)
- Most modern components are able to resist ESD, however, the most basic precaution is to occasionally touch a ground to discharge your body.
- You could also use an antistatic mat.
- Dropped parts
- Build your server in an area with enough space! Laying out parts ahead of time will ensure that they stay in one piece.
- Breakage caused by force fitment or scratched circuits
- Most components require only a small amount of pressure to seat the connector.
Remove the previous components
The first step of the installation is to remove all the previous components from the case.
Note: As obvious as it seems, make sure that you have unplugged the server.
Installation
Location
Below is the motherboard with the location of all major components.
The parts are then installed in this order:
- CPU1 on the motherboard
- CPU2 on the motherboard
- Memory on the motherboard
- Heat sink CPU1
- Heat sink CPU2
- Video card on the motherboard
- Back panel shield in the case
- Motherboard in the case
- SDD/HDD and others drives
- Front panel buttons and LEDs
- PSU on the motherboard
Prepare the motherboard
Carefully take the motherboard out of the box and place it on top of the foam packing material to protect it.
CPU installation
Take the CPU from the box.
Open the socket and remove the black protection.
Socketed processors have followed a common theme for at least 20 years: An arrow on one corner of the CPU aligns to another arrow on the CPU socket. It is almost impossible to make a mistake, as the CPU will only fit in the socket if it is properly placed.
CPUs have zero insertion force (ZIF). So, DO NOT FORCE! They should just drop into the socket under its own weight, with no force applied.Then, lower the steel load plate over the CPU, and rotate the wire clamp into its locked position.
Repeat the process for the second CPU.
Memory installation
System memory only fits into the slot one way. But with dual channel, you need to insert the memory in specific slots.
Everything is explained in the manual of the motherboard:
I have 2 CPUs and 4 DIMMs, so I need to use the slots PI-DIMMA1, P1-DIMMB1, P2-DIMME1 and P2-DIMMF1.
The locations of the DIMMs are detailed in the Quick Reference Guide from SUPERMICRO.
Push the release tabs outwards on both ends of the DIMM slot to unlock it. Press both notches straight down into the memory slot at the same time.
Heat sink installation
The SNK-P0050AP4 heat sink model is specifically designed for SUPERMICRO motherboards, and is easy to install. There is no need to add more thermal grease, the required amount has already been applied on the connector.
Just remove the plastic, place the heat sink on top of the CPU so that the four mounting holes are aligned with those on the motherboard and the heat sink bracket underneath.
Repeat the process for the second CPU.
The last step of the installation is to plug the Heatsink fans on the motherboard. There are a lot fan ports on the motherboard, see below.
I plugged the fans on the closest ports.
Note: For optimized airflow efficiency, please follow your chassis airflow directions to install the heatsink.
GPU installation
I was surprised that the motherboard had no integrated GPU, but it turns out this was my mistake. The model with the onboard GPU chipset is the MBD-X10DRL-I-O motherboard, available for a few more bucks. Anyway, my plan was to use a dedicated chipset to take the load off the CPUs.
I have an old 9600 GS video card to install.
This card is using the PCI-E 2.0 x 16 bus.
I can put the card in any of the PCI-E 3.0 slot highlighted below.
I plugged the video card in the CPU1 SLOT3 PCI-E 3.0 x16.
Back panel & shield
The motherboard has the following connectors on the back panel.
The ATX form factors specifies the size and location of a rectangular plate, called an I/O shield which is delivered with the motherboard and fills the gaps around the ports and connectors on the back of the motherboard. I removed my previous shield (not compatible) and installed the new one.
Motherboard in the case
The new motherboard is in the same format than the previous one, so I only needed to install the board with the exact mounting points and make sure that it it was properly aligned with the back panel shield.
Mounting holes are identified on the schema below.
SSD/HDD & other drives
The motherboard has 10 SATA3 ports divided in 4 S-SATA3 and 6 I-SATA3 ports.
I-SATA0-5 are supported by the Intel PCH, and S-SATA0-3 are supported by the Intel SCU.
Two RAID controllers (AHCI and SCU) are supported by the Intel PCH. The AHCI controller supports SATA drives and the SCU controller supports both SATA and SAS drives. That does not mean they can only be used for RAID arrays, they simply provide that capability. Any drive with a SATA interface may be used with those ports.
I am only using SATA drives so I can put my disks on any of the ports as they all support SATA.
My configuration is below:
- 1x SSD 128 GB (OS)
- 1x SSD 512 GB (VM)
- 2x 640 GB – RAID 0 (TEMP)
- 3x 932 GB – RAID 5 (Software & Files)
- 1x BLURAY/DVD Player
Note: Software RAID managed by Windows Server 2012.
Front panel
The front panel pins are identified below:
As designed for SUPERMICRO chassis, I don’t have all the LEDs or buttons in my ANTEC case.
I only plugged PWR, Reset, HDD LED and Power LED.
Note: Make sure to identify the Ground on your connector. Usually there is an arrow on the other pin.
PSU on the motherboard
Everything is installed, the last step is to plug the PSU on the motherboard.
The X10DAL-i motherboard accommodates 24-pin ATX power supplies. Although most power supplies generally meet the specifications required by the CPU, some are inadequate. In addition, two 8-pin power connections are also required to ensure adequate power supply to the system.
For my configuration, I don’t need to use the two 8-pin power connections.
Boot
First try
The first boot was not what I expected. Nothing happened and the motherboard was showing a red light (LE6 LED).
At first I thought it was the memory, because that was the only part I bought which was not brand new.
But then I tried multiple configurations (1CPU, 1 DIMM, etc), and the server was still not booting, so I contacted SUPERMICRO support ([email protected]).
A few minutes later, they replied that LE6 refers to the standby power. If it’s red, then there is an onboard power issue… and they were right. The PSU that I was using is from Europe, and is not compatible with the 60hz line frequency. To fix that issue, I decided to buy a new PSU from Amazon. I picked Amazon to benefit from the same-day delivery available in New York City.
Second try
The new PSU installed, I was able to boot my server. Unfortunately, one of the HDD didn’t survive.
Nothing I could do here, so I removed the disk from the configuration.
Final result
As you can see, the case is almost full of hardware. There is not a lot of space for the cables!
Updated price summary
Component | Item | Retail price (USD) | Discounted price (USD) | Quantity | Total (USD) |
---|---|---|---|---|---|
Total | (without tax) | 1766.94 | |||
CPU | Intel Xeon E5-2620v3 Hexa-Core | 449.99 | 339.99 | 2 | 679.98 |
Motherboard | SUPERMICRO MBD-X10DAL-I-O ATX Server Motherboard Dual LGA 2011 Intel C612 | 299.99 | 264.99 | 1 | 264.99 |
Memory | SAMSUNG 16GB 288-Pin DDR4 SDRAM ECC Registered DDR4 2133 (PC4-17000) Server (M393A2G40DB0-CPB) | 166.99 | 112.50 | 4 | 450.00 |
SSD OS | Samsung 850 Pro 128GB 2.5-Inch SATA III Internal SSD (MZ-7KE128BW) | 98.99 | N/A | 1 | 98.99 |
SSD VM | Samsung 850 Pro 512GB 2.5-Inch SATA III Internal SSD (MZ-7KE512BW) | 249.99 | 149.99 | 1 | 149.99 |
CPU Coolers | SUPERMICRO SNK-P0050AP4 Heatsink | 39.99 | N/A | 2 | 79.98 |
Case | Antec Three Hundred Two Gaming Case, Black | 64.67 | N/A | 0 | N/A |
PSU (updated) | EVGA 500 W1 80+, 500W | 43.01 | N/A | 1 | 43.01 |
Video | HP 466762-001 NVIDIA GeForce 9600GS 768MB GDDR2 192-Bit PCIe x16 Video Card VGA | N/A | N/A | 0 | N/A |
In the next post, I’ll review the software configuration for my new lab.
More from the Lab!
- Building a Dual-Xeon Citrix Lab: Part 1 – Considerations
- Building a Dual-Xeon Citrix Lab: Part 2 – Hardware
- Building a Dual-Xeon Citrix Lab: Part 3 – Windows and Hyper-V installation
- Lab: Part 4 – Hyper-V Networking
- Lab: Part 5 – NetScaler 11 Architecture and Installation
- Lab: Part 6 – Configure NetScaler 11 High Availability (HA Pair)
- Lab: Part 7 – Upgrade NetScalers in HA
- Lab: Part 8 – Save, Backup and Restore NetScaler 11 configuration
- Lab: Part 9 – Install Microsoft SQL Server 2014 (Dedicated)
- Lab: Part 10 – Citrix Licensing demystified
- Lab: Part 11 – Install XenDesktop 7.6
- Lab: Part 12 – Setup NetScaler 11 Clustering (TriScale)
- Lab: Part 13 – Configure Published Applications with XenDesktop 7.6
- Lab: Part 14 – Citrix StoreFront 3.x
- Lab: Part 15 – Configure SSL in StoreFront
- Lab: Part 16 – StoreFront load balancing with NetScaler (Internal)
- Lab: Part 17 – Optimize and secure StoreFront load balancing with NetScaler (Internal)
- Lab: Part 18 – Secure LDAP (LDAPS) load balancing with Citrix NetScaler 11
- Lab: Part 19 – Configure Active Directory authentication(LDAP) with Citrix NetScaler 11
- Lab: Part 20 – RDP Proxy with NetScaler Unified Gateway 11
- Lab: Part 21 – Secure SSH Authentication with NetScaler (public-private key pair)
- Lab: Part 22 – Ultimate StoreFront 3 customization guide
- Lab: Part 23 – Securing Citrix StoreFront DMZ deployment
- Lab: Part 25 – Upgrade to Citrix StoreFront 3.7
- Lab: Part 26 – Install/Upgrade Citrix XenDesktop 7.11
- Lab: Part 27 – Getting started with Microsoft Azure
- Lab: Part 28 – Getting started with Citrix Cloud
- Lab: Part 29 – Configure XenDesktop And XenApp Service with Microsoft Azure and Citrix Cloud
- Lab: Part 30 – Configure Identity and Access Management in Citrix Cloud with Microsoft Azure AD
- Lab: Part 31 – Configure NetScaler Gateway Service for XenApp and XenDesktop Service in Citrix Cloud
- Lab: Part 32 – Configure MCS with XenDesktop and XenApp Service in Citrix Cloud
- Lab: Part 33 – Configure Azure Quick Deploy with XenDesktop and XenApp Service in Citrix Cloud
- Lab: Part 34 – Configure Site Aggregation for Citrix Workspace in Citrix Cloud with XenDesktop 7.x located on-premises
- Lab: Part 35 – Configure a Hybrid NetScaler MA Service environment in Citrix Cloud
- Lab: Part 36 – Configure ShareFile in Citrix Cloud with StorageZones on-premises
- Lab: Part 37 – Upgrade NetScaler HA pair with NetScaler MA Service in Citrix Cloud
- Lab: Part 38 – How to Configure Full VPN Setup with Citrix NetScaler in CLI
- Lab: Part 39 – Configure Multi-Factor Authentication with Azure MFA Service and Citrix Workspace
- Lab: Part 40 – Getting Started with Citrix App Layering
- Lab: Part 41 – Configure Citrix App Layering
- Lab: Part 42 – OS Layer with Citrix App Layering
- Lab: Part 43 – Platform Layer with Citrix App Layering
- Lab: Part 44 – Application Layers with Citrix App Layering
- Lab: Part 45 – Layered Image Deployment with Citrix App Layering
- Lab: Part 46 – Elastic deployment with Citrix App Layering
- Lab: Part 47 – User Layers with Citrix App Layering
- Lab: Part 48 – Windows 10 and PVS with Citrix App Layering
FINALLY! Someone who did a review on this particular board!
I have 1 single question for you… And it will take either much closer detailed photos, or a trial-n-error to answer.
PCIe Slot 6 vs Memory Interference?
I know they are close, very very close. But, can an expansion board actually fit in PCIe Slot 6 when you have the memory dims for CPU1 full?
By the pictures I see online, they seem to be offset by just a few millimeters.
There’s only one way to be sure: stick a PCIe x4/x8 card into that slot and see. But, that’s a $300 bet I am not willing to make just yet.
Please let me know ASAP!
Hi Eric,
I will give it a try tonight and come back to you !
My card fits but do you have the dimensions of yours ?
Did you not need to use the two 8-pin connectors because you were using low TDP CPUs?
im currently doing a build on with the same processors and board, im running into the red light issue. the strange thing is, im doing two of these builds side by side and they are both having this issue, i decided to try a different PS, (i had a 1000w) but i threw a 500w in it from a computer that i know works fine, and im getting the same red light on both builds. the odds of it being two bad boards like that has to be really low. im at a loss on what to do at this point. currently i have fedex picking up one of the boards in a few hours to send back while a continue to troubleshoot the other.
Have you tried with 1 CPU and/or with only 1 Memory slot. Make sure that you use the first memory slot.
According to Intel and to CPU-World.com
Intel Xeon E5-2620v3 Hexa-Core does not support DDR4 ECC Registered DDR4 2133 ram.
it only supports DDR up to 1866. How is this working?
Yep, that’s correct. The RAM is running at 1866Mhz instead of 2133Mhz.
did you have to make any BIOS changes to accommodate the 2133 RAM to run at 1866
No, it has been a std feature for motherboards for a while.
I built mine with X10DAL-i, 4x8gb Samsung ram that is tested by Supermicro. 2 x E5-2650 V3.
I get the 5 beeps at boot which is a memory error. RAM is running at 1866 where it is supposed to run at 2133. Tried one processor with 2 or for sticks……….. I also tried ram recommended by Crucial only to end up with the same results.
Do you get any beeps at boot?
I updated my BIOS to 2.0, suggested by supermicro tech support, at the beginning of the build as I was having another issue.
Have you updated your BIOS to 2.0 ?
Thanks
Hi ismail,
Were you able to boot after the beep? Could you give more details? I got 5 beeps about 30 seconds after I hit the power button. The are like 4 lower pitch beeps first, a pause, then a higher pitch beep. After that I see the bios logo and system boots fine. It’s just each time I boot I need to wait 30 sec and hear that 5 beeps. Have you resolved your issue?
Hi David.
According to supermicro there are 2 different sets of 5 beeps. One that indicates a memory issue and the other tells you that everything is fine.
The 5 beeps are described in the manual and the difference between them is the length of the fifth beep.
I also helped a friend of mine built a similar machine. He is getting the same 5 beeps as I am.
I am convinced that I am getting the 5 beeps that indicates everything is fine.
Thank you Ismail, it is reassuring to know! I missed that part of the manual. Just want to verify one more fact with you: it takes so much longer to boot this X10DALi (30 sec before logo shows, compared to 1 or 2 sec for a regular desktop motherboard) on my end — do you experience the same? I guess I can live with it as long as everything is fine but just wondering if you see the same. There’s not a lot info from the online community about this board so thanks for sharing!!
Hi,
I got the same motherboard and trying to find a ATX case and PSU?
Please confirm you used the below two;
1. Antec Three Hundred Two Gaming Case – were you able to mount the board properly?
2. EVGA 500 W1 80+ 500W – were you able to power both CPUs? I see only 1x8pin CPU connector?
Mathew