Remote server management: turnkey IPMI/BMC setup

Remote server management: turnkey IPMI/BMC setup

We’ve seen it many times: a server in a data center freezes, SSH access is lost. The only way to regain control is to press the Reset button or enter the BIOS. Without IPMI, you have to go to the data center, wasting time and money. Mean Time to Recovery (MTTR) with IPMI drops tenfold compared to physical access. In one project, we reduced MTTR from 4 hours to 20 minutes after configuring IPMI on a fleet of 20 servers. IPMI (Intelligent Platform Management Interface) is an independent channel to the server, working even when the OS is unresponsive, the server hangs, or the OS disk fails. Through IPMI you can view the console, reboot, check temperatures and disk status. Our setup experience covers over 150 servers for clients in the financial sector and hosting. With over 5 years of experience in server infrastructure management, we deliver reliable solutions. IPMI is 5 times faster than traditional KVM switch management. Our clients report an average MTTR reduction of 85% after implementation.

More about IPMI can be found on IPMI.

Why IPMI is essential for every server

IPMI is not an option—it’s a requirement for critical systems. Without it, any unavailability leads to MTTR measured in hours, not minutes. With BMC, an administrator can perform a hard reset, check the System Event Log (SEL), and analyze the cause of failure. For example, in one project we detected CPU overheating via IPMI, allowing us to replace the cooler before disk failure. With IPMI, MTTR reduces by up to 90% compared to physical access.

Setting up secure BMC access

Initial BMC configuration

BMC (Baseboard Management Controller) is the chip on the motherboard implementing IPMI. To access it, assign an IP address. This is done either in BIOS during initial setup or via ipmitool from the running OS:

# Install ipmitool
apt install -y ipmitool  # Debian/Ubuntu
dnf install -y ipmitool  # RHEL/Rocky

# Load kernel modules
modprobe ipmi_devintf
modprobe ipmi_si

# View current BMC network config
ipmitool lan print 1

# Set static IP for BMC
ipmitool lan set 1 ipsrc static
ipmitool lan set 1 ipaddr 10.0.1.100
ipmitool lan set 1 netmask 255.255.255.0
ipmitool lan set 1 defgw ipaddr 10.0.1.1
ipmitool lan set 1 access on

Channel 1 is the BMC LAN channel. Numbering may differ on different boards.

BMC user management

Many servers come with default users like admin/admin or ADMIN/ADMIN. Change immediately:

# List users
ipmitool user list 1
# Change password for user ID 2
ipmitool user set password 2 "NewStrongPassword123!"
# Create new user (ID 3)
ipmitool user set name 3 monitoring
ipmitool user set password 3 "MonitoringPass456!"
ipmitool user priv 3 2 1 # privilege level: 2=user, 4=admin
ipmitool user enable 3
# Disable unused users
ipmitool user disable 1

Remote management via ipmitool

Once IP is set, manage the server from any machine on the same network:

# Power status
ipmitool -I lanplus -H 10.0.1.100 -U admin -P password chassis power status
# Reboot
ipmitool -I lanplus -H 10.0.1.100 -U admin -P password chassis power cycle
# Hard reset (like pressing the reset button on the case)
ipmitool -I lanplus -H 10.0.1.100 -U admin -P password chassis power reset
# Power on/off
ipmitool -I lanplus -H 10.0.1.100 -U admin -P password chassis power on
ipmitool -I lanplus -H 10.0.1.100 -U admin -P password chassis power off
# Temperatures and hardware status
ipmitool -I lanplus -H 10.0.1.100 -U admin -P password sdr type Temperature
ipmitool -I lanplus -H 10.0.1.100 -U admin -P password sdr type Fan
# System Event Log
ipmitool -I lanplus -H 10.0.1.100 -U admin -P password sel list

Console via SOL

SOL (Serial Over LAN) redirects the server’s serial console through IPMI. It allows working with GRUB, rescue mode, or debugging kernel panic without physical presence:

ipmitool -I lanplus -H 10.0.1.100 -U admin -P password sol activate 

GRUB_CMDLINE_LINUX="console=tty0 console=ttyS1,115200n8"
GRUB_TERMINAL="console serial"
GRUB_SERIAL_COMMAND="serial --speed=115200 --unit=1 --word=8 --parity=no --stop=1"