Ubuntu Linux 100G DDM Interface Diagnostic Information

This guide contains practical Linux commands for checking a 100G Ethernet interface, QSFP28 transceiver information and DDM (Digital Diagnostic Monitoring) values on Ubuntu Linux.

The examples show how to verify link state, speed, FEC, optical RX/TX power, module temperature, voltage, laser bias and interface errors using ethtool and standard Linux tools.

For an Intel network adapter using the ice driver, check recent link events with:

root@pc-lab:~# dmesg | grep ice
[35455340.465074] ice 0000:01:00.0 enp1s0f0: NIC Link is up 100 Gbps Full Duplex, Requested FEC: RS-FEC, Negotiated FEC: NONE, Autoneg Advertised: Off, Autoneg Negotiated: False, Flow Control: None

This confirms that the physical link is up at 100 Gbps Full Duplex and also shows the requested and negotiated FEC state.

Check Linux Interface State

Verify the administrative and operational state of the interface:

root@pc-lab:~# ip link show enp1s0f0
3: enp1s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
link/ether 64:9d:99:ff:f0:2e brd ff:ff:ff:ff:ff:ff
root@pc-lab:~# cat /sys/class/net/enp1s0f0/operstate
up

LOWER_UP and an operstate of up confirm that Linux detects the physical carrier.

Quick Check of Transceiver and RX Optical Power

For a quick DDM check, display the transceiver vendor information and received optical power on all four optical lanes:

root@pc-lab:~# ethtool --module-info enp1s0f0|egrep 'Vendor|Rcvr'
Vendor name : PRECISION
Vendor OUI : a8:29:4c
Vendor PN : PRE-QSFP28-LR4
Vendor rev : 01
Vendor SN : BH240916014
Rcvr signal avg optical power(Channel 1) : 1.3839 mW / 1.41 dBm
Rcvr signal avg optical power(Channel 2) : 1.5010 mW / 1.76 dBm
Rcvr signal avg optical power(Channel 3) : 1.3751 mW / 1.38 dBm
Rcvr signal avg optical power(Channel 4) : 1.4726 mW / 1.68 dBm

A 100GBASE-LR4 module uses four optical channels, so checking all four RX values is useful when troubleshooting wavelength-specific optical problems.

Check Interface Speed and Capabilities

Use ethtool to verify the negotiated speed, duplex, supported link modes and current link state:

root@pc-lab:~# ethtool enp1s0f0
Settings for enp1s0f0:
Supported ports: [ FIBRE ]
Supported link modes: 25000baseCR/Full
25000baseSR/Full
50000baseCR2/Full
100000baseSR4/Full
100000baseCR4/Full
100000baseLR4_ER4/Full
50000baseSR2/Full
Supported pause frame use: Symmetric
Supports auto-negotiation: No
Supported FEC modes: None
Advertised link modes: 25000baseSR/Full
50000baseCR2/Full
100000baseLR4_ER4/Full
Advertised pause frame use: No
Advertised auto-negotiation: No
Advertised FEC modes: None
Speed: 100000Mb/s
Duplex: Full
Auto-negotiation: off
Port: FIBRE
PHYAD: 0
Transceiver: internal
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000007 (7)
drv probe link
Link detected: yes

Check Full QSFP28 DDM Information

The complete module information provides transceiver type, wavelength, distance, vendor information, temperature, voltage, TX bias, TX/RX optical power and alarm status:

root@pc-lab:~# ethtool --module-info enp1s0f0
Identifier : 0x11 (QSFP28)
Extended identifier : 0xdc
Extended identifier description : 3.5W max. Power consumption
Extended identifier description : CDR present in TX, CDR present in RX
Extended identifier description : High Power Class (> 3.5 W) enabled
Power set : Off
Power override : On
Connector : 0x07 (LC)
Transceiver codes : 0x80 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Transceiver type : 100G Ethernet: 100G Base-LR4
Encoding : 0x03 (NRZ)
BR, Nominal : 25500Mbps
Rate identifier : 0x02
Length (SMF,km) : 10km
Length (OM3 50um) : 0m
Length (OM2 50um) : 0m
Length (OM1 62.5um) : 0m
Length (Copper or Active cable) : 0m
Transmitter technology : 0x60 (1310 nm EML)
Laser wavelength : 1310.000nm
Laser wavelength tolerance : 2.245nm
Vendor name : PRECISION
Vendor OUI : a8:29:4c
Vendor PN : PRE-QSFP28-LR4
Vendor rev : 01
Vendor SN : BH240916014
Date code : 240916
Revision Compliance : Unallocated
Module temperature : 57.18 degrees C / 134.92 degrees F
Module voltage : 3.3151 V
Alarm/warning flags implemented : Yes
Laser tx bias current (Channel 1) : 68.540 mA
Laser tx bias current (Channel 2) : 69.040 mA
Laser tx bias current (Channel 3) : 67.230 mA
Laser tx bias current (Channel 4) : 68.804 mA
Transmit avg optical power (Channel 1) : 0.8440 mW / -0.74 dBm
Transmit avg optical power (Channel 2) : 0.9971 mW / -0.01 dBm
Transmit avg optical power (Channel 3) : 1.2585 mW / 1.00 dBm
Transmit avg optical power (Channel 4) : 1.3107 mW / 1.18 dBm
Rcvr signal avg optical power(Channel 1) : 1.3875 mW / 1.42 dBm
Rcvr signal avg optical power(Channel 2) : 1.5033 mW / 1.77 dBm
Rcvr signal avg optical power(Channel 3) : 1.3724 mW / 1.37 dBm
Rcvr signal avg optical power(Channel 4) : 1.4766 mW / 1.69 dBm
Laser bias current high alarm (Chan 1) : Off
Laser bias current low alarm (Chan 1) : Off
Laser bias current high warning (Chan 1) : Off
Laser bias current low warning (Chan 1) : Off
Laser bias current high alarm (Chan 2) : Off
Laser bias current low alarm (Chan 2) : Off
Laser bias current high warning (Chan 2) : Off
Laser bias current low warning (Chan 2) : Off
Laser bias current high alarm (Chan 3) : Off
Laser bias current low alarm (Chan 3) : Off
Laser bias current high warning (Chan 3) : Off
Laser bias current low warning (Chan 3) : Off
Laser bias current high alarm (Chan 4) : Off
Laser bias current low alarm (Chan 4) : Off
Laser bias current high warning (Chan 4) : Off
Laser bias current low warning (Chan 4) : Off
Module temperature high alarm : Off
Module temperature low alarm : Off
Module temperature high warning : Off
Module temperature low warning : Off
Module voltage high alarm : Off
Module voltage low alarm : Off
Module voltage high warning : Off
Module voltage low warning : Off
Laser tx power high alarm (Channel 1) : Off
Laser tx power low alarm (Channel 1) : Off
Laser tx power high warning (Channel 1) : Off
Laser tx power low warning (Channel 1) : Off
Laser tx power high alarm (Channel 2) : Off
Laser tx power low alarm (Channel 2) : Off
Laser tx power high warning (Channel 2) : Off
Laser tx power low warning (Channel 2) : Off
Laser tx power high alarm (Channel 3) : Off
Laser tx power low alarm (Channel 3) : Off
Laser tx power high warning (Channel 3) : Off
Laser tx power low warning (Channel 3) : Off
Laser tx power high alarm (Channel 4) : Off
Laser tx power low alarm (Channel 4) : Off
Laser tx power high warning (Channel 4) : Off
Laser tx power low warning (Channel 4) : Off
Laser rx power high alarm (Channel 1) : Off
Laser rx power low alarm (Channel 1) : Off
Laser rx power high warning (Channel 1) : Off
Laser rx power low warning (Channel 1) : Off
Laser rx power high alarm (Channel 2) : Off
Laser rx power low alarm (Channel 2) : Off
Laser rx power high warning (Channel 2) : Off
Laser rx power low warning (Channel 2) : Off
Laser rx power high alarm (Channel 3) : Off
Laser rx power low alarm (Channel 3) : Off
Laser rx power high warning (Channel 3) : Off
Laser rx power low warning (Channel 3) : Off
Laser rx power high alarm (Channel 4) : Off
Laser rx power low alarm (Channel 4) : Off
Laser rx power high warning (Channel 4) : Off
Laser rx power low warning (Channel 4) : Off
Laser bias current high alarm threshold : 0.000 mA
Laser bias current low alarm threshold : 0.000 mA
Laser bias current high warning threshold : 0.000 mA
Laser bias current low warning threshold : 0.000 mA
Laser output power high alarm threshold : 0.0000 mW / -inf dBm
Laser output power low alarm threshold : 0.0000 mW / -inf dBm
Laser output power high warning threshold : 0.0000 mW / -inf dBm
Laser output power low warning threshold : 0.0000 mW / -inf dBm
Module temperature high alarm threshold : 80.00 degrees C / 176.00 degrees F
Module temperature low alarm threshold : -10.00 degrees C / 14.00 degrees F
Module temperature high warning threshold : 75.00 degrees C / 167.00 degrees F
Module temperature low warning threshold : -5.00 degrees C / 23.00 degrees F
Module voltage high alarm threshold : 0.0000 V
Module voltage low alarm threshold : 0.0000 V
Module voltage high warning threshold : 0.0000 V
Module voltage low warning threshold : 0.0000 V
Laser rx power high alarm threshold : 0.0000 mW / -inf dBm
Laser rx power low alarm threshold : 0.0000 mW / -inf dBm
Laser rx power high warning threshold : 0.0000 mW / -inf dBm
Laser rx power low warning threshold : 0.0000 mW / -inf dBm

Check Only the Most Important DDM Values

For daily troubleshooting, filter the module output to temperature, voltage, TX bias and optical power:

ethtool --module-info enp1s0f0 | egrep 'temperature|voltage|Laser tx bias|Transmit avg optical|Rcvr signal avg optical'

This provides a compact view of the most important QSFP28 health parameters without displaying the complete EEPROM information.

Monitor Optical Power in Real Time

Use watch to monitor RX and TX optical power while troubleshooting an unstable optical link:

watch -n 2 "ethtool --module-info enp1s0f0 | egrep 'Transmit avg optical|Rcvr signal avg optical|temperature'"

This refreshes the DDM values every two seconds and is useful when moving fibers, cleaning connectors or checking intermittent optical problems.

Check Network Driver and Firmware

Display the NIC driver, firmware and PCI bus information:

ethtool -i enp1s0f0

For Intel E810 adapters this is useful for confirming the ice driver version and NIC firmware before troubleshooting link or transceiver compatibility issues.

Check FEC Status

Check the Forward Error Correction configuration reported by the NIC driver:

ethtool --show-fec enp1s0f0

FEC is especially important on high-speed Ethernet links. Compare this information with the kernel link message when troubleshooting a FEC mismatch between two devices.

Check Interface Packet Counters

Display standard Linux packet, byte, error and drop counters:

ip -s link show enp1s0f0

For continuous monitoring:

watch -n 2 "ip -s link show enp1s0f0"

Check NIC Hardware Statistics

ethtool can also display driver-specific hardware counters:

ethtool -S enp1s0f0

When troubleshooting a bad 100G link, filter for errors, drops, CRC, FEC and fault counters:

ethtool -S enp1s0f0 | egrep -i 'err|drop|crc|fec|fault'

Increasing error or FEC-related counters can indicate a physical layer problem even when the Ethernet link remains operational.

Useful 100G Interface Diagnostic Commands

dmesg | grep ice
ip link show enp1s0f0
ip -s link show enp1s0f0
ethtool enp1s0f0
ethtool -i enp1s0f0
ethtool --show-fec enp1s0f0
ethtool --module-info enp1s0f0
ethtool -S enp1s0f0

What to Check During 100G Optical Troubleshooting

Start with the physical link state and verify that the interface is running at 100 Gbps. Then check the QSFP28 module type, all four RX and TX optical channels, module temperature, laser bias and alarm flags. Finally, check FEC state and NIC hardware error counters for errors that may not cause the interface to go down.

In this example the QSFP28 module is a 100GBASE-LR4 optic, the interface is up at 100 Gbps Full Duplex, all four optical channels report RX signal, the module temperature is 57.18°C, and all reported optical and temperature alarm flags are Off.