16. Hardware Setup — TrueNAS®11.1-U6 User Guide Table of Contents

# 16. Hardware Setup

The TrueNAS® M-Series (M40 and M50) consists of one or two 4U units. Optional ES12, ES24, or ES60 Expansion Shelves can be added to expand storage capacity.

The TrueNAS® X-Series (X10 and X20) consists of one or two 2U units. Optional Expansion Shelves can be added to expand storage capacity. The X10 supports the ES12 Expansion Shelf and the X20 supports the ES12, ES24, and ES60 Expansion Shelves.

Deployment Guides and data sheets for the M-Series, X-Series, Expansion Shelves, as well as EoL products, are available at https://www.ixsystems.com/blog/knowledgebase_category/truenas/.

Racking and connection information for the M-Series, X-Series, and Expansion Shelves is described below.

Note

Always perform the initial TrueNAS® setup in consultation with an iXsystems Support Representative.

## 16.1. Contacting iXsystems

For assistance, please contact iX Support:

Contact Method | Contact Options
--- | ---
Web | https://support.ixsystems.com
Email | `support@iXsystems.com`
Telephone | Monday - Friday, 8:00AM to 5:00PM Pacific Standard Time: 1 (855) 473-7449 option 2 (US-only toll-free) 1 (408) 943-4100 option 2 (local and international)
Telephone | After Hours (24x7 Gold Level Support only): 1 (855) 499-5131 (US-only toll-free) 1 (678) 835-6101 (local and international)

Copyright © 2018 iXsystems, Inc. All rights reserved.

All trademarks are the property of their respective owners.

## 16.2. M-Series Unified Storage Array

The TrueNAS® M-Series Unified Storage Array is a 4U, 24-bay, hybrid unified data storage array.

Note

TrueNAS® units are carefully packed and shipped with trusted carriers to arrive in perfect condition. If there is any shipping damage or any parts are missing, please take photos and contact iXsystems support immediately at `support@iXsystems.com` or 1-855-GREP4-iX (1-855-473-7449) or 1-408-943-4100.

Please locate and record the hardware serial numbers on the back or side of each chassis for easy reference.

Carefully unpack the shipping boxes and locate these components:

M-Series Unified Storage Array | M-Series Bezel
Set of rackmount rails | Up to 24 drive trays populated with drives
DB9 to 3.5mm serial cable | Accessory kit with 2 IEC C13 to NEMA 5-15P power cords, 2 IEC C14 to C13 cords, velcro cable ties, M4x4L screws, M5x18 screws, screw posts, and alternate pins for round hole racks

### 16.2.1. Become Familiar With the M-Series System

The M-Series has front panel indicators for power, locate ID, and fault. The fault indicator is on during the initial power-on self-test (POST) and turns off during normal operation. It turns on if the TrueNAS® software issues an alert.

The M-Series contains one or two storage controllers in an over-and-under configuration. The connectors and features on each storage controller are:

1: Redundant power supplies | 7: VGA monitor port
2: Serial port | 8: ID LED
3: 1Gb Ethernet Out of Band (OOB) management port, dual USB 2.0 ports | 9: HD Mini SAS3 connectors
4: Dual USB 3.0 ports | 10: Networking port
5: 10Gb Ethernet port | 11: Asterisk slot: Fibre Channel or additional networking
6: 10Gb Ethernet port | 12: Storage controller management port

Fig. 16.2.2 Back Panel

### 16.2.2. ES24 and M-Series Rail Kit Assembly

#### 16.2.2.1. Remove Cabinet Rails from Rack Rails

Extend the cabinet rail until it stops. To remove the cabinet rail, press the white release tab to the right while pulling the cabinet rail.

#### 16.2.2.2. Mount Cabinet Rails

The cabinet rails are mounted on both sides of the system cabinet. Align the cabinet rail keyholes with the three posts (ES24) or four posts (M-Series) on the side of the chassis and slide the rail until the post is wedged in the keyhole slot of the rail.

Align the rail hole with the screw hole and secure the rail with one M4x4L screw from the rail kit. Repeat this process to mount and secure the second cabinet rail on the other side.

#### 16.2.2.3. Mount the Rack Rails

Place the rail in the rack with the front end toward the front of the rack, aligning the pins with the mounting holes in the front of the rack. Push the pins into the holes until the latch clicks.

For the rear end of the rail, align the pins with the mounting holes on the rear rack. Pull the white latch toward the rear until the pins click in place. Repeat this process for the second rear rail.

#### 16.2.2.4. Mount the Unit in the Rack

Caution: Two people are required to safely lift the chassis for rack installation or removal. Do not install drives until after the chassis has been installed in the rack, and remove all drives before removing the chassis from the rack.

Pull the front rack rail forward until it stops. Align the cabinet rail with the inside of the front rack rail and slide the cabinet rail forward until it is fully seated inside the rack rail. Repeat the process for the second rail.

When both cabinet rails are secured inside of the rack rails, gently push the chassis until it stops halfway in. Slide the blue release tabs on both cabinet rails toward the front of the system while pushing the unit in until it is flush with the front of the rack.

Anchor the unit in the rack on both sides with the M5x18 screws included in the rail kit.

### 16.2.3. Install Drive Trays

Drive trays are used to mount drives in the array. Drive trays are installed in drive bays in the chassis. Each drive bay in the chassis has two indicator LEDs to the right of the tray. The status LED is blue when the drive is active, and the fault LED is red if a fault has occurred.

Press the silver button on the drive tray to open the latch. Carefully slide the tray into a drive bay until the right side of the latch touches the metal front edge of the chassis, then gently swing the latch closed until it clicks into place.

### 16.2.4. Connect Expansion Shelves

Refer to the installation instructions included with expansion shelves for details on connecting them.

### 16.2.5. Connect Network Cables

Note: Network cables vary by configuration and are not included. Please contact iX Support with any questions.

Connect network cables to the Ethernet ports and Out-of-Band (OOB) management port before attempting to power on and configure the M-Series for the the first time.

### 16.2.6. Connect Power Cords

Do not plug the power cords into a power outlet yet. Connect a power cord to the back of one power supply. Place the cord into the plastic clamp and press the tab into the latch to lock it in place. Repeat the process for the second power supply and cord.

After both power cords have been connected to the M-Series, they can be plugged into power outlets. The system is configured to automatically power on when connected to a power outlet. This design ensures that the M-Series comes back on when power is restored after a power failure.

### 16.2.7. Install Bezel (Optional)

The included bezel is not required for operation.

### 16.2.8. Perform TrueNAS® Initial Software Configuration

The console displays the IP address of the TrueNAS® M-Series graphical web interface, 192.168.100.231 in this example:

    The web user interface is at:

    http://192.168.100.231

Enter the IP address into a browser on a computer on the same network to access the web user interface.

Copyright © 2018 iXsystems, Inc. All rights reserved.

All trademarks are the property of their respective owners.

## 16.3. X-Series Unified Storage Array

The TrueNAS® X-Series Unified Storage Array is a 2U, 12-bay, hybrid unified data storage array.

Note

TrueNAS® units are carefully packed and shipped with trusted carriers to arrive in perfect condition. If there is any shipping damage or any parts are missing, please take photos and contact iXsystems support immediately at `support@iXsystems.com` or 1-855-GREP4-iX (1-855-473-7449) or 1-408-943-4100.

Please locate and record the hardware serial numbers on the back or side of each chassis for easy reference.

Carefully unpack the shipping boxes and locate these components:

X-Series Unified Storage Array | X-Series Bezel
Set of rackmount rails. The rails have a specific front end, identified by a label visible on the left above. The front ends of the rails must be installed facing the front of the rack. | A total of 12 populated or empty “air baffle” drive trays. Trays must be installed in all bays to maintain proper airflow for cooling. Up to ten drive trays are packed in a cardboard tray. Additional drive trays are packed with the accessory kit.
Accessory kit with 2 IEC C13 to NEMA 5-15P power cords, 2 IEC C14 to C14 cords, and velcro cable ties | Black USB to 3.5mm, 3.3V serial cable and rail extenders for racks over 30” deep

### 16.3.1. Become Familiar With the X-Series System

The X-Series has front panel indicators for power, locate ID, and fault. The fault indicator is on during the initial power-on self-test (POST) and turns off during normal operation. It turns on if the TrueNAS® software issues an alert.

The X-Series contains one or two storage controllers in a side-by-side configuration. The connectors and features on each storage controller are:

1,2: Gigabit Ethernet connectors | 7,8: HDmini SAS3 connectors 1 and 2
3: USB device (reserved, do not remove) | 9: PCIe x8 expansion port
4: USB 2.0 connector | 10: System console port (reserved)
5: Out-of-Band (OOB) serial port (3.5mm) | 11: MAC address label
6: Out-of-Band Management Ethernet connector | 12, 13: Redundant power supplies

Fig. 16.3.2 Back Panel

### 16.3.2. Rail Kit Assembly

On racks that are 30 inches deep or less, proceed to rail spring installation below.

Racks from 31 to 36 inches deep require installation of the included rail extenders. For these deeper racks, install cage nuts on the outside rear of the rack. The tabs on the cage nuts must be horizontal as shown. Using the included bolts, install the rail extender inside the rear of the rack. Repeat the process for the second extender, which is a mirror image of the first.

Install a spring on the silver posts in the side of each rail.

Open the clamp latches on the ends of each rail. Place the rail in the rack with the front end toward the front of the rack, aligning the pins on both ends of the rail with the mounting holes in the rack. Swing the clamp latch closed to hold the rail in place. Use two of the supplied screws to secure the back end of the rail in place. Repeat the process for the second rail.

Caution: Two people are required to safely lift the chassis for rack installation or removal. Do not install drives until after the chassis has been installed in the rack, and remove all drives before removing the chassis from the rack.

Carefully place the chassis onto the rails mounted in the rack. Push the chassis in until the ears are flush with the front of the rack. Use two of the supplied screws to secure each ear to the rack.

### 16.3.3. Install Drive Trays

Drive trays are used to mount drives in the chassis. Each drive tray has a status LED which is blue when active or amber if a fault has occurred.

A tray must be placed in each drive bay to maintain proper airflow for cooling. If fewer than twelve drives are connected, empty “air baffle” trays must be placed in the empty bays.

A standard drive tray installation order simplifies support and is strongly recommended:

- SSD drives for SLOG, if present
- SSD drives for L2ARC, if present
- Hard drives or SSD drives for data storage
- Air baffle filler trays to fill any remaining empty bays

Install the first drive tray in the top left drive bay. Install the next drive tray to the right of the first. Install remaining drive trays to the right across the row. After a row is filled with drives, move down to the next row and start again with the left bay.

This example shows the proper order for a SLOG SSD, an L2ARC SSD, eight hard drives, and two empty air baffle trays.

To load an individual drive tray into a bay, press the blue button to open the latch. Carefully slide the tray into a drive bay until the left side of the latch touches the metal front edge of the chassis, then gently swing the latch closed until it clicks into place.

### 16.3.4. Connect Expansion Shelves

Refer to the installation instructions included with expansion shelves for details on connecting them.

### 16.3.5. Connect Network Cables

Note: Network cables vary by configuration and are not included. Please contact iX Support with any questions.

Connect network cables to the Ethernet ports and Out-of-Band (OOB) management port before attempting to power on and configure the X-Series for the the first time. The Out-of-Band (OOB) management port on the X-Series must be connected to a shielded Ethernet cable.

### 16.3.6. Connect Power Cords

If any TrueNAS® expansion shelves are connected to the X-Series, power them on first, then wait at least two minutes before connecting power cables to the X-Series.

Do not plug the power cords into a power outlet yet. Connect a power cord to the back of one power supply. Place the cord in the plastic clamp and press the tab into the latch to lock it in place. Repeat the process for the second power supply and cord.

After both power cords have been connected to the X-Series, they can be plugged into power outlets. The system is configured to automatically power on when connected to a power outlet. This design ensures that the X-Series comes back on when power is restored after a power failure.

### 16.3.7. Install Bezel (Optional)

The included bezel is not required for operation. If desired, install the bezel by aligning it with the pins on the bezel ears and pressing it into place.

### 16.3.8. Discover Out-of-Band Management IP Address

Several methods are available to determine the IP address currently assigned to the X-Series Out-of-Band management interface.

#### 16.3.8.1. Preset

If the system was preconfigured by iXsystems, the Out-of-Band management interfaces have already been configured with the IP addresses requested by the user.

Otherwise, the Out-of-Band management IP addresses are set by default to static addresses:

Storage controller 1: 192.168.100.100, subnet mask 255.255.255.0

Storage controller 2 (if present): 192.168.100.101, subnet mask 255.255.255.0

#### 16.3.8.2. DHCP

If the Out-of-Band management IP address has been configured to be assigned by DHCP, the IP address assigned by the DHCP server can be determined by checking the local DHCP server logs for the MAC addresses on the back panel of each X-Series storage controller, #11 on Figure 16.3.2.

The local DHCP server can also be configured to provide a fixed IP address for the X-Series Out-of-Band management by using the MAC address.

#### 16.3.8.3. Serial Cable

The Out-of-Band management IP address can be identified or changed by temporarily connecting the black USB serial cable to the Out-of-Band serial port, #5 on Figure 16.3.2. Connect the USB end of the black cable to a laptop or desktop computer running serial terminal software.

Do not use the serial port for any purpose except checking the initial X-Series Out-of-Band management IP address or setting that address to be obtained by a different method. After use, disconnect the black USB serial cable from the X-Series.

Warning

The black USB serial cable is only for use with the Out-of-Band serial port on the X-Series. Do not attempt to use it with any other equipment.

##### 16.3.8.3.1. Out-of-Band Serial Terminal Communication Settings

Serial Port Device Names

The name of the serial port varies with operating systems. These are some typical examples: Windows: `COM4`, macOS: `/dev/tty.usbserialxynnn`, FreeBSD: `/dev/cuaU0`, Linux: `/dev/ttyUSB0`.

Serial Port Communication Parameters

Set the serial terminal program to use the appopriate port with these parameters: 38400 baud, 8 data bits, 1 stop bit, no parity, no flow control. Log in to the serial console with:

Username: sysadmin Password: superuser

The current Out-of-Band management IP address is displayed with:

    ifconfig eth0 | grep 'inet addr'
          inet addr:10.20.1.227  Bcast:10.20.1.255  Mask:255.255.254.0

The current Out-of-Band network configuration settings are displayed with:

    ipmitool -H 127.0.0.1 -U admin -P admin lan print

The Out-of-Band management system can be set to obtain an IP address from DHCP with:

    ipmitool -H 127.0.0.1 -U admin -P admin lan set 1 ipsrc dhcp

The Out-of-Band management system can be set to use a static IP address and netmask. This example shows setting the IP address to 192.168.100.100 with a netmask of 255.255.255.0, and a default gateway of 192.168.100.1:

    ipmitool -H 127.0.0.1 -U admin -P admin lan set 1 ipsrc static
    ipmitool -H 127.0.0.1 -U admin -P admin lan set 1 ipaddr 192.168.100.10
    ipmitool -H 127.0.0.1 -U admin -P admin lan set 1 netmask 255.255.255.0
    ipmitool -H 127.0.0.1 -U admin -P admin lan set 1 defgw ipaddr 192.168.100.1

Log out of the Out-of-Band management system by typing `exit` and pressing `Enter`. After use, always disconnect the black USB serial cable from the X-Series system.

### 16.3.9. Connect to the X-Series Console

#### 16.3.9.1. With IPMI

Note

The IPMItool remote management utility must be installed on the laptop or desktop computer used to manage the X-Series remotely, and that computer must have access to the same network as the X-Series. FreeBSD, macOS, and Linux have package systems which can be used to install IPMItool. For Windows, a simple option is to install IPMItool through Cygwin.

Warning

Only use IPMItool for remote IPMI management on the X-Series. Other IPMI utilities may not work correctly or even damage the X-Series system.

When the Out-of-Band management IP address has been determined, the X-Series console is accessible through IPMI. In this example, 192.168.100.100 is the IP address assigned to the Out-of-Band management interface:

    ipmitool -I lanplus -H 192.168.100.100 -U admin -a sol activate

Enter admin for the password, and the X-Series console is connected.

Tip

When a Serial Over LAN connection is already in use, `SOL on another session` is displayed when a laptop or desktop computer attempts to connect. The Serial Over LAN system can be reset from the remote laptop or desktop computer with:

    ipmitool -H 192.168.100.100 -U admin bmc reset cold

Enter admin for the password, and the Serial Over LAN system is reset. Repeat the sol activate command above to connect.

The Serial Over LAN system can also be reset with the Out-of-Band serial port by attaching the black USB serial cable, connecting with a serial terminal program, and logging in as shown in Serial Cable. Then use

    ifconfig eth0

to view the IP address of the eth0 network interface. Use the IP address, shown as eth0ipaddress in this example, in the reset command:

    ipmitool -H eth0ipaddress -U admin bmc reset cold

Enter admin for the password, and the Serial Over LAN system is reset. Log out of the system with exit and disconnect the black USB serial cable from the X-Series system.

Tip

The Out-of-Band console password can be changed by attaching the black USB serial cable, connecting with a serial terminal program, and logging in as shown in Serial Cable. Then give this command to set the new password, shown as newpassword in this example:

    ipmitool -H 127.0.0.1 -U admin -P admin user set password 2 newpassword

Log out of the system with exit and disconnect the black USB serial cable from the X-Series system.

Proceed to Using the X-Series Console.

#### 16.3.9.2. With the Serial Cable

The X-Series console can be directly connected to a serial terminal program by temporarily disconnecting the gray serial cable from the system console serial port, #10 on Figure 16.3.2, and temporarily connecting the black USB serial cable to that port.

Connect the USB end of the black USB serial cable to a laptop or desktop computer running serial terminal software. See Out-of-Band Serial Terminal Communication Settings for the serial device name. Set the terminal software to:

115200 baud, 8 data bits, 1 stop bit, no parity, no flow control

Wait two minutes after the X-Series has been connected to power, then press `Enter` to display the console menu. Find the message starting with `The web user interface is at:` and write down the IP address shown. After viewing the X-Series console, disconnect the black USB serial cable and reconnect the gray System Management cable to the system serial console port, #10 on Figure 16.3.2.

### 16.3.10. Using the X-Series Console

The X-Series console has two modes: SES (SCSI Enclosure Services) mode, and the standard x86 console mode.

If `ESM A =>` is displayed, the X-Series is in SES mode. Switch to the X86 console mode by typing these characters:

    $%^0

Press `Enter` twice after typing the characters. The normal x86 console is displayed.

To switch back to the SES console, type these characters:

    $%^2

### 16.3.11. Perform TrueNAS® Initial Software Configuration

The console displays the IP address of the TrueNAS® X-Series graphical web interface, 192.168.100.231 in this example:

    The web user interface is at:

    http://192.168.100.231

Enter the IP address into a browser on a computer on the same network to access the web user interface.

Copyright © 2018 iXsystems, Inc. All rights reserved.

All trademarks are the property of their respective owners.

## 16.4. ES12 Expansion Shelf

The TrueNAS® ES12 is 2U, 12-bay, SAS3 (12 Gb/s) expansion shelf with dual expansion modules and redundant power supplies.

Note

TrueNAS® units are carefully packed and shipped with trusted carriers to arrive in perfect condition. If there is any shipping damage or any parts are missing, please take photos and contact iXsystems support immediately at `support@iXsystems.com` or 1-855-GREP4-iX (1-855-473-7449) or 1-408-943-4100.

Please locate and record the hardware serial numbers on the back or side of each chassis for easy reference.

Carefully unpack the shipping boxes and locate these components:

ES12 Expansion Shelf | ES12 Bezel
Set of rackmount rails. The rails have a specific front end, identified by a label visible on the left above. The front ends of the rails must be installed facing the front of the rack. | A total of 12 populated or empty “air baffle” drive trays. Trays must be installed in all bays to maintain proper airflow for cooling. Up to ten drive trays are packed in a cardboard tray. Additional drive trays are packed with the accessory kit.
Accessory kit with 2 IEC C13 to NEMA 5-15P power cords, 2 IEC C14 to C14 cords, and a set of velcro cable ties | Two 3-meter Mini SAS HD to Mini SAS HD cables

### 16.4.1. Become Familiar With the ES12 System

The ES12 has front panel indicators for power, locate ID, and fault. The fault indicator is on during the initial power-on self-test (POST) and turns off during normal operation. It turns on if the TrueNAS® software issues an alert.

The ES12 contains two expansion modules in a side-by-side configuration. The connectors and features on each module are:

1-3: HD Mini SAS3 connectors (T1-T3)
4: Debug port (TrueNAS® internal use only)
5: Redundant power supplies

### 16.4.2. Rail Kit Assembly

On racks that are 30 inches deep or less, proceed to rail spring installation below.

Racks from 31 to 36 inches deep require installation of the included rail extenders. For these deeper racks, install cage nuts on the outside rear of the rack. The tabs on the cage nuts must be horizontal as shown. Using the included bolts, install the rail extender inside the rear of the rack. Repeat the process for the second extender, which is a mirror image of the first.

Install a spring on the silver posts in the side of each rail.

Open the clamp latches on the ends of each rail. Place the rail in the rack with the front end toward the front of the rack, aligning the pins on both ends of the rail with the mounting holes in the rack. Swing the clamp latch closed to hold the rail in place. Use two of the supplied screws to secure the back end of the rail in place. Repeat the process for the second rail.

Caution: Two people are required to safely lift the chassis for rack installation or removal. Do not install drives until after the chassis has been installed in the rack, and remove all drives before removing the chassis from the rack.

Carefully place the chassis onto the rails mounted in the rack. Push the chassis in until the ears are flush with the front of the rack. Use two of the supplied screws to secure each ear to the rack.

### 16.4.3. Install Drive Trays

Drive trays are used to mount drives in the chassis. Each drive tray has a status LED which is blue when active or amber if a fault has occurred.

A tray must be placed in each drive bay to maintain proper airflow for cooling. If fewer than twelve drives are connected, empty “air baffle” trays must be placed in the empty bays.

A standard drive tray installation order simplifies support and is strongly recommended:

- SSD drives for SLOG, if present
- SSD drives for L2ARC, if present
- Hard drives or SSD drives for data storage
- Air baffle filler trays to fill any remaining empty bays

Install the first drive tray in the top left drive bay. Install the next drive tray to the right of the first. Install remaining drive trays to the right across the row. After a row is filled with drives, move down to the next row and start again with the left bay.

This example shows the proper order for a SLOG SSD, an L2ARC SSD, eight hard drives, and two empty air baffle trays.

To load an individual drive tray into a bay, press the blue button to open the latch. Carefully slide the tray into a drive bay until the left side of the latch touches the metal front edge of the chassis, then gently swing the latch closed until it clicks into place.

### 16.4.4. Connect Power Cords

Do not plug the power cords into a power outlet yet. Connect a power cord to the back of one power supply. Place the cord in the plastic clamp and press the tab into the latch to lock it in place. Repeat the process for the second power supply and cord.

### 16.4.5. Connect SAS Cables

Shut down and power off the TrueNAS® X-Series. Remove the X-Series power cables from the power outlets.

Plug the ES12 power cords into power outlets. Wait two minutes for the drives to start.

Connect an SAS cable from the ES12 expander module 1 T1 connector to the X-Series node 1 SAS 1 connector (cable #1 in photo).

If the X-Series has a second node for HA (High Availability), connect a second SAS cable from the ES12 expander module 2 to the X-Series node 2 SAS 1 connector (cable #2 in photo).

A second ES12 can also be connected to the X-Series. Connect the first ES12 as shown above. Then connect the second ES12, running SAS cables from the ES12 T1 connectors to the SAS 2 connectors on the X-Series.

### 16.4.6. Use with the ES60 Expansion Shelf (X20 Only)

The X20 supports using an ES60 Expansion Shelf in combination with the ES12. Connect the ES60 to the X20 SAS 1 ports, and connect the ES12 to the X20 SAS 2 ports.

After all SAS cables have been connected, plug the X-Series power cords into power outlets.

### 16.4.7. Install Bezel (Optional)

The included bezel is not required for operation. If desired, install the bezel by aligning it with the pins on the bezel ears and pressing it into place.

Copyright © 2018 iXsystems, Inc. All rights reserved.

All trademarks are the property of their respective owners.

## 16.5. ES24 Expansion Shelf

The TrueNAS® ES24 is a 4U, 24-bay, SAS3 (12 Gb/s) expansion shelf with dual expansion modules and redundant power supplies.

Note

TrueNAS® units are carefully packed and shipped with trusted carriers to arrive in perfect condition. If there is any shipping damage or any parts are missing, please take photos and contact iXsystems support immediately at `support@iXsystems.com` or 1-855-GREP4-iX (1-855-473-7449) or 1-408-943-4100.

Please locate and record the hardware serial numbers on the back or side of each chassis for easy reference.

Carefully unpack the shipping boxes and locate these components:

ES24 Expansion Shelf |
Set of rackmount rails | Up to 24 drive trays populated with drives
Two 3-meter Mini SAS HD to Mini SAS HD cables and one serial cable | Two 2 IEC C13 to NEMA 5-15P power cords

### 16.5.1. Become Familiar With the ES24

The ES24 has front panel buttons for power and alarm mute, and indicators for power, locate ID, and fault. The fault indicator is on during the initial power-on self-test (POST) or when the TrueNAS® software has issued an alert.

Fig. 16.5.2 Back Panel

The ES24 contains two expansion modules in an over/under configuration. The connectors and features on each module are:

1-2: Redundant power supplies
3-4: Fans
5-7: HD Mini SAS3 connectors
8: Serial port

### 16.5.2. ES24 and M-Series Rail Kit Assembly

#### 16.5.2.1. Remove Cabinet Rails from Rack Rails

Extend the cabinet rail until it stops. To remove the cabinet rail, press the white release tab to the right while pulling the cabinet rail.

#### 16.5.2.2. Mount Cabinet Rails

The cabinet rails are mounted on both sides of the system cabinet. Align the cabinet rail keyholes with the three posts (ES24) or four posts (M-Series) on the side of the chassis and slide the rail until the post is wedged in the keyhole slot of the rail.

Align the rail hole with the screw hole and secure the rail with one M4x4L screw from the rail kit. Repeat this process to mount and secure the second cabinet rail on the other side.

#### 16.5.2.3. Mount the Rack Rails

Place the rail in the rack with the front end toward the front of the rack, aligning the pins with the mounting holes in the front of the rack. Push the pins into the holes until the latch clicks.

For the rear end of the rail, align the pins with the mounting holes on the rear rack. Pull the white latch toward the rear until the pins click in place. Repeat this process for the second rear rail.

#### 16.5.2.4. Mount the Unit in the Rack

Caution: Two people are required to safely lift the chassis for rack installation or removal. Do not install drives until after the chassis has been installed in the rack, and remove all drives before removing the chassis from the rack.

Pull the front rack rail forward until it stops. Align the cabinet rail with the inside of the front rack rail and slide the cabinet rail forward until it is fully seated inside the rack rail. Repeat the process for the second rail.

When both cabinet rails are secured inside of the rack rails, gently push the chassis until it stops halfway in. Slide the blue release tabs on both cabinet rails toward the front of the system while pushing the unit in until it is flush with the front of the rack.

Anchor the unit in the rack on both sides with the M5x18 screws included in the rail kit.

### 16.5.3. Install Drive Trays

Drive trays are used to mount drives in the array. Drive trays are installed in drive bays in the chassis. Each drive bay in the chassis has two indicator LEDs to the right of the tray. The status LED is blue when the drive is active, and the fault LED is red if a fault has occurred.

Press the silver button on the drive tray to open the latch. Carefully slide the tray into a drive bay until the right side of the latch touches the metal front edge of the chassis, then gently swing the latch closed until it clicks into place.

### 16.5.4. Connect Power Cords

Do not plug the power cords into a power outlet yet. Connect a power cord to the back of one power supply. Place the cord into the plastic clamp and press the tab into the latch to lock it in place. Repeat the process for the second power supply and cord.

### 16.5.5. Connect SAS Cables

Plug the ES24 power cords into power outlets. Wait two minutes for the drives to start.

Note

The TrueNAS® Unified Array can remain on while the expansion shelf is connected.

Connect an SAS cable from ES24 expansion module 1 SAS 0 connector to the farthest left Z-Series node 1 SAS connector (cable #1 in photo).

If the Z-Series has a second node for HA (High Availability), connect a second SAS cable from ES24 expansion module 2 SAS 0 connector to the farthest left Z-Series node 2 SAS connector (cable #2 in photo).

Fig. 16.5.10 SAS Cable Connection for One ES24

A second ES24 can also be connected to the Z-Series. Connect the first ES24 as shown above. Then connect the second ES24 SAS 0 ports to the next unused SAS ports on the Z-Series as shown:

Fig. 16.5.11 SAS Cable Connection for Two ES24s

After all SAS cables have been connected, plug the Z-Series power cords into power outlets.

Copyright © 2018 iXsystems, Inc. All rights reserved.

All trademarks are the property of their respective owners.

## 16.6. ES60 Expansion Shelf

The TrueNAS® ES60 Expansion Shelf is a 4U, 60-bay storage expansion unit designed specifically for use with the TrueNAS® Unified Storage Array.

Note

TrueNAS® units are carefully packed and shipped with trusted carriers to arrive in perfect condition. If there is any shipping damage or any parts are missing, please take photos and contact iXsystems support immediately at `support@iXsystems.com` or 1-855-GREP4-iX (1-855-473-7449) or 1-408-943-4100.

Please locate and record the hardware serial numbers on the back or side of each chassis for easy reference.

Carefully unpack the shipping boxes and locate these components:

ES60 Expansion Shelf | ES60 Bezel
Rail kit with mounting hardware | Up to 60 drive trays with installed hard drives (shipped separately from the ES60)
Two IEC C13 to NEMA 5-15P power cords, two IEC C14 to C14 power cords | Two 3-meter Mini SAS HD to Mini SAS HD cables

### 16.6.1. Become Familiar With the ES60

The ES60 has indicators on the front panel for power, fault, and locate ID. The fault indicator is on during the initial power-on self-test (POST) or when the TrueNAS® software has issued an alert.

Front view of the ES60 Expansion Shelf:

Front panel indicators:

Rear view of the ES60 Expansion Shelf:

The ES60 contains two expansion modules in a side-by-side configuration. The connectors and features on each module are:

1: Power supply | 4: Locate ID
2: Power indicator | 5: Management port (not used)
3: Alarm indicator | 6,7: HD Mini SAS3 connectors

### 16.6.2. Rail Kit Assembly

#### 16.6.2.1. Separate Cabinet Rails from Rack Rails

Each rack rail includes an inner cabinet rail that must be removed. Extend the cabinet rail until the white release tab is exposed.

Press the white release tab to the right while pulling the cabinet rail to remove it. Repeat this process for the second rail.

#### 16.6.2.2. Mount Cabinet Rails

The cabinet rails are mounted on each side of the system. Align the cabinet rail keyholes with the posts on the side of the chassis. Slide the rail toward the rear of the system until the metal tab clicks and secures the rail in place. Repeat this process on the other side.

#### 16.6.2.3. Mount Rack Rails

Install four cage nuts in the rack, one for each bracket. The lock screw for the bracket is already installed in the cage nut. Place the rail in the rack with the front end toward the front of the rack and rear toward the back of the rack, aligning the pins on both ends of the rail with the mounting holes in the rack. Push the pins into the rack holes until they lock in place.

### 16.6.3. Mount Unit in the Rack

Caution: Two people are required to safely lift the chassis for rack installation or removal. Do not install drives until after the chassis has been installed in the rack, and remove all drives before removing the chassis from the rack.

Slide the front rack rail forward to meet the rear of the cabinet rails. Align the cabinet rail with the inside of the front rack rail and slide the cabinet rail forward until it is fully seated inside the rack rail. Repeat the process for the second rail.

When both cabinet rails are secured inside the rack rails, carefully slide the chassis until the ears are flush with the front of the rack. Turn both blue screws on the ears of the chassis to the right to secure the unit in the rack.

### 16.6.4. Drive Tray Installation

Note

Do not install the drives until the chassis has been installed in the rack.

#### 16.6.4.1. Remove Top Cover

Slide the unit out on the rails. Turn the blue screws counterclockwise to unlock the top cover. Slide the top cover toward the front of the system, then lift to remove it.

#### 16.6.4.2. Install Drive Trays

Drive trays are used to mount drives in the array.

A standard drive tray installation order simplifies support and is strongly recommended:

- SSD drives for SLOG, if present
- SSD drives for L2ARC, if present
- Hard drives or SSD drives for data storage

Install the first drive tray in the front left drive bay. Install the next drive tray to the right of the first. Install remaining drive trays to the right across the row. After a row is filled with drives, move back to the next row and start again with the left bay. A label on the front left of the lid identifies the preferred order of drive connection.

Press the blue button to open the latch. Lower the drive tray into a drive bay until the latch begins to move into place. Push the latch the rest of the way until it locks into place.

### 16.6.5. ES60 Cable Management Arm

The included cable management arm (CMA) is not required for operation. If desired, the CMA can be used to help organize the ES60 power and data cables.

The tabs along the side of the flex housing can be unclipped from the top, the bottom, or removed entirely.

#### 16.6.5.1. Install the Cable Management Arm

Locate the two posts on the left rear side of the ES60. Align the holes on the CMA chassis bracket with the posts on the chassis. Slide the cable management arm forward and pull the lever on the latch upward to lock the bracket into place.

Locate the end of the flex housing with exposed pins. Unclip and open the two tabs closest to the end, allowing the flex housing to compress enough to fit into the bracket holes. Press the flex housing firmly into the bracket until the pins seat in the holes.

Remove the two screws already attached to the side of the CMA rail bracket. Align the screw holes with the holes in the rear of the left cabinet rail and attach the bracket to the rail with the screws.

Locate the end of the flex housing with exposed holes. Unclip and open the two tabs closest to the end, allowing the flex housing to expand enough to fit over the bracket pins. Press the flex housing firmly into the bracket until the holes seat on the pins.

Completed Cable Management Arm assembly:

Power and data cables are routed through the flex housing. The tabs can be opened or removed to allow access or space for cable ends. Remember to leave some slack in the cables at both ends to allow for movement of the arm and chassis.

### 16.6.6. Connect Power Cords

Do not plug the power cords into a power outlet yet. Connect a power cord to the back of one power supply, pressing it into the plastic clamp and pressing on the tab to lock it in place. Repeat the process for the second power supply and cord. This turns on the ES60.

Note

Service and management ports are not used during normal operation and should not be connected.

When setting up an ES60 for the first time, wait two minutes after turning on the ES60 before powering on the TrueNAS® Unified Array. If the TrueNAS® Unified Array is already in operation, the Expansion Shelf can be powered on at any time.

### 16.6.7. Connect SAS Cables

Plug the ES60 power cords into power outlets. Wait two minutes for the drives to start.

Note

The TrueNAS® Unified Array can remain on while the expansion shelf is connected.

#### 16.6.7.1. Connecting the ES60 to a TrueNAS® X20

Connect an SAS cable from the ES60 expander module 1 connector 1 to the X20 1 SAS 1 connector (cable #1 in photo). If the X20 has a second node for HA (High Availability), connect a second SAS cable from the ES60 expander module 2 connector 1 to the X20 node 2 SAS 1 connector (cable #2 in photo).

#### 16.6.7.2. Connecting the ES60 to a TrueNAS® Z35

Connect an SAS cable from the ES60 expander module 1 connector 1 to the Z35 Controller 1 SAS 1 connector (cable #1 in photo). If the Z35 has a second node for HA (High Availability), connect a second SAS cable from the ES60 expander module 2 connector 1 to the Z35 Controller 2 SAS 1 connector (cable #2 in photo).

A second ES60 can also be connected to the Z35. Connect the first ES60 as shown above. Then connect the second ES60 1 ports to the next unused SAS ports on the Z35 as shown:

Up to eight ES60 expansion shelves are supported on the TrueNAS® Z35.

### 16.6.8. Install Bezel (Optional)

The included bezel is not required for operation.

Line up the screw holes on the back of the bezel with the screw holes on the ears of the ES60. Install one upper screw from the back side of the left ES60 ear, then install a lower screw from the back of the right ES60 ear. Install the remaining two screws following the same diagonal pattern.