usrp-users@lists.ettus.com

Discussion and technical support related to USRP, UHD, RFNoC

View all threads

X410 device no longer found when using use_dpdk=1

VL
Victor Levin
Mon, Aug 7, 2023 7:40 PM

Hi all,

I am trying to enable DPDK with X410 and found an issue when using “use_dpdk=1”. I am on Ubuntu 22.04, the latest UHD 4.4.0 (commit: 4a77791cf5f7cedc842762be8b2b6775073d8c95) and DPDK 21.11.4.

When the X410 is connect to the interface without DPDK, I can find it via uhd_usrp_probe and run benchmark_rate without issue. After binding the NIC to DPDK, the X410 can no longer be found when using DPDK. Anyone know why it’s disappearing?

Output of find devices before DPDK is enabled:

uhd_find_devices

[INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; UHD_4.4.0.HEAD-33-g4a77791c

-- UHD Device 0

Device Address:
serial: 3257310
addr: 192.168.15.2
claimed: False
fpga: X4_200
mgmt_addr: 192.168.15.2
name: ni-x4xx-3257310
product: x410
type: x4xx

After DPDK is enabled, the X410 is no longer found:

/usr/local/lib/uhd/examples# ./benchmark_rate --args="master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx" --duration 3 --rx_rate 245.76e6  --tx_rate 245.76e6

[INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; UHD_4.4.0.HEAD-33-g4a77791c
[WARNING] [PREFS] Loaded config from /root/.uhd. This location is considered deprecated, consider moving your config file to /root/.config instead.
EAL: Detected CPU lcores: 96
EAL: Detected NUMA nodes: 2
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:98:00.1 (socket 1)
ice_load_pkg_type(): Active package is: 1.3.28.0, ICE OS Default Package (double VLAN mode)
TELEMETRY: No legacy callbacks, legacy socket not created
ice_set_rx_function(): Using AVX2 OFFLOAD Vector Scattered Rx (port 0).
ice_set_tx_function(): Using AVX2 OFFLOAD Vector Tx (port 0).
[00:00:00.000229] Creating the usrp device with: master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx...
Error: LookupError: KeyError: No devices found for ----->
Device Address:
master_clock_rate: 245.76e6
mgmt_addr: 192.168.15.2
addr: 192.168.15.2
use_dpdk: 1
serial: 3257310
name: ni-x4xx-3257310
product: x410
type: x4xx

Hi all, I am trying to enable DPDK with X410 and found an issue when using “use_dpdk=1”. I am on Ubuntu 22.04, the latest UHD 4.4.0 (commit: 4a77791cf5f7cedc842762be8b2b6775073d8c95) and DPDK 21.11.4. When the X410 is connect to the interface without DPDK, I can find it via uhd_usrp_probe and run benchmark_rate without issue. After binding the NIC to DPDK, the X410 can no longer be found when using DPDK. Anyone know why it’s disappearing? Output of find devices before DPDK is enabled: # uhd_find_devices [INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; UHD_4.4.0.HEAD-33-g4a77791c -------------------------------------------------- -- UHD Device 0 -------------------------------------------------- Device Address: serial: 3257310 addr: 192.168.15.2 claimed: False fpga: X4_200 mgmt_addr: 192.168.15.2 name: ni-x4xx-3257310 product: x410 type: x4xx After DPDK is enabled, the X410 is no longer found: /usr/local/lib/uhd/examples# ./benchmark_rate --args="master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx" --duration 3 --rx_rate 245.76e6 --tx_rate 245.76e6 [INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; UHD_4.4.0.HEAD-33-g4a77791c [WARNING] [PREFS] Loaded config from /root/.uhd. This location is considered deprecated, consider moving your config file to /root/.config instead. EAL: Detected CPU lcores: 96 EAL: Detected NUMA nodes: 2 EAL: Detected shared linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'VA' EAL: VFIO support initialized EAL: Using IOMMU type 1 (Type 1) EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:98:00.1 (socket 1) ice_load_pkg_type(): Active package is: 1.3.28.0, ICE OS Default Package (double VLAN mode) TELEMETRY: No legacy callbacks, legacy socket not created ice_set_rx_function(): Using AVX2 OFFLOAD Vector Scattered Rx (port 0). ice_set_tx_function(): Using AVX2 OFFLOAD Vector Tx (port 0). [00:00:00.000229] Creating the usrp device with: master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx... Error: LookupError: KeyError: No devices found for -----> Device Address: master_clock_rate: 245.76e6 mgmt_addr: 192.168.15.2 addr: 192.168.15.2 use_dpdk: 1 serial: 3257310 name: ni-x4xx-3257310 product: x410 type: x4xx
PK
Piotr Krysik
Mon, Aug 7, 2023 11:57 PM

Hello,

For X410 the network adapter which works under DPDK driver control can't
be used to control the device (it can't carry RPC calls to MPM daemon
working on the device). You need a separate Ethernet connection for
mgmt_addr. You can use 1Gbit Ethernet link for that.

Best Regards,
Piotr Krysik

W dniu 7.08.2023 o 21:40, Victor Levin via USRP-users pisze:

Hi all,

I am trying to enable DPDK with X410 and found an issue when using
“use_dpdk=1”. I am on Ubuntu 22.04, the latest UHD 4.4.0 (commit:
4a77791cf5f7cedc842762be8b2b6775073d8c95) and DPDK 21.11.4.

When the X410 is connect to the interface without DPDK, I can find it
via uhd_usrp_probe and run benchmark_rate without issue. After binding
the NIC to DPDK, the X410 can no longer be found when using DPDK.
Anyone know why it’s disappearing?

Output of find devices before DPDK is enabled:

uhd_find_devices

[INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11;
UHD_4.4.0.HEAD-33-g4a77791c

-- UHD Device 0

Device Address:
    serial: 3257310
    addr: 192.168.15.2
    claimed: False
    fpga: X4_200
    mgmt_addr: 192.168.15.2
    name: ni-x4xx-3257310
    product: x410
    type: x4xx

After DPDK is enabled, the X410 is no longer found:

/usr/local/lib/uhd/examples# ./benchmark_rate
--args="master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx"
--duration 3 --rx_rate 245.76e6  --tx_rate 245.76e6

[INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11;
UHD_4.4.0.HEAD-33-g4a77791c
[WARNING] [PREFS] Loaded config from /root/.uhd. This location is
considered deprecated, consider moving your config file to
/root/.config instead.
EAL: Detected CPU lcores: 96
EAL: Detected NUMA nodes: 2
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:98:00.1 (socket 1)
ice_load_pkg_type(): Active package is: 1.3.28.0, ICE OS Default
Package (double VLAN mode)
TELEMETRY: No legacy callbacks, legacy socket not created
ice_set_rx_function(): Using AVX2 OFFLOAD Vector Scattered Rx (port 0).
ice_set_tx_function(): Using AVX2 OFFLOAD Vector Tx (port 0).
[00:00:00.000229] Creating the usrp device with:
master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx...
Error: LookupError: KeyError: No devices found for ----->
Device Address:
    master_clock_rate: 245.76e6
    mgmt_addr: 192.168.15.2
    addr: 192.168.15.2
    use_dpdk: 1
    serial: 3257310
    name: ni-x4xx-3257310
    product: x410
    type: x4xx


USRP-users mailing list -- usrp-users@lists.ettus.com
To unsubscribe send an email to usrp-users-leave@lists.ettus.com

Hello, For X410 the network adapter which works under DPDK driver control can't be used to control the device (it can't carry RPC calls to MPM daemon working on the device). You need a separate Ethernet connection for mgmt_addr. You can use 1Gbit Ethernet link for that. Best Regards, Piotr Krysik W dniu 7.08.2023 o 21:40, Victor Levin via USRP-users pisze: > Hi all, > > I am trying to enable DPDK with X410 and found an issue when using > “use_dpdk=1”. I am on Ubuntu 22.04, the latest UHD 4.4.0 (commit: > 4a77791cf5f7cedc842762be8b2b6775073d8c95) and DPDK 21.11.4. > > When the X410 is connect to the interface without DPDK, I can find it > via uhd_usrp_probe and run benchmark_rate without issue. After binding > the NIC to DPDK, the X410 can no longer be found when using DPDK. > Anyone know why it’s disappearing? > > > Output of find devices before DPDK is enabled: > > # uhd_find_devices > [INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; > UHD_4.4.0.HEAD-33-g4a77791c > -------------------------------------------------- > -- UHD Device 0 > -------------------------------------------------- > Device Address: >     serial: 3257310 >     addr: 192.168.15.2 >     claimed: False >     fpga: X4_200 >     mgmt_addr: 192.168.15.2 >     name: ni-x4xx-3257310 >     product: x410 >     type: x4xx > > > After DPDK is enabled, the X410 is no longer found: > > /usr/local/lib/uhd/examples# ./benchmark_rate > --args="master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx" > --duration 3 --rx_rate 245.76e6  --tx_rate 245.76e6 > > [INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; > UHD_4.4.0.HEAD-33-g4a77791c > [WARNING] [PREFS] Loaded config from /root/.uhd. This location is > considered deprecated, consider moving your config file to > /root/.config instead. > EAL: Detected CPU lcores: 96 > EAL: Detected NUMA nodes: 2 > EAL: Detected shared linkage of DPDK > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket > EAL: Selected IOVA mode 'VA' > EAL: VFIO support initialized > EAL: Using IOMMU type 1 (Type 1) > EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:98:00.1 (socket 1) > ice_load_pkg_type(): Active package is: 1.3.28.0, ICE OS Default > Package (double VLAN mode) > TELEMETRY: No legacy callbacks, legacy socket not created > ice_set_rx_function(): Using AVX2 OFFLOAD Vector Scattered Rx (port 0). > ice_set_tx_function(): Using AVX2 OFFLOAD Vector Tx (port 0). > [00:00:00.000229] Creating the usrp device with: > master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx... > Error: LookupError: KeyError: No devices found for -----> > Device Address: >     master_clock_rate: 245.76e6 >     mgmt_addr: 192.168.15.2 >     addr: 192.168.15.2 >     use_dpdk: 1 >     serial: 3257310 >     name: ni-x4xx-3257310 >     product: x410 >     type: x4xx > > _______________________________________________ > USRP-users mailing list -- usrp-users@lists.ettus.com > To unsubscribe send an email to usrp-users-leave@lists.ettus.com
VL
Victor Levin
Wed, Aug 9, 2023 12:00 AM

Thanks Piotr, that was indeed the issue. Works now.

On Aug 7, 2023, at 4:57 PM, Piotr Krysik perper@o2.pl wrote:

Hello,

For X410 the network adapter which works under DPDK driver control can't be used to control the device (it can't carry RPC calls to MPM daemon working on the device). You need a separate Ethernet connection for mgmt_addr. You can use 1Gbit Ethernet link for that.

Best Regards,
Piotr Krysik

W dniu 7.08.2023 o 21:40, Victor Levin via USRP-users pisze:

Hi all,

I am trying to enable DPDK with X410 and found an issue when using “use_dpdk=1”. I am on Ubuntu 22.04, the latest UHD 4.4.0 (commit: 4a77791cf5f7cedc842762be8b2b6775073d8c95) and DPDK 21.11.4.

When the X410 is connect to the interface without DPDK, I can find it via uhd_usrp_probe and run benchmark_rate without issue. After binding the NIC to DPDK, the X410 can no longer be found when using DPDK. Anyone know why it’s disappearing?

Output of find devices before DPDK is enabled:

uhd_find_devices

[INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; UHD_4.4.0.HEAD-33-g4a77791c

-- UHD Device 0

Device Address:
serial: 3257310
addr: 192.168.15.2
claimed: False
fpga: X4_200
mgmt_addr: 192.168.15.2
name: ni-x4xx-3257310
product: x410
type: x4xx

After DPDK is enabled, the X410 is no longer found:

/usr/local/lib/uhd/examples# ./benchmark_rate --args="master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx" --duration 3 --rx_rate 245.76e6  --tx_rate 245.76e6

[INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; UHD_4.4.0.HEAD-33-g4a77791c
[WARNING] [PREFS] Loaded config from /root/.uhd. This location is considered deprecated, consider moving your config file to /root/.config instead.
EAL: Detected CPU lcores: 96
EAL: Detected NUMA nodes: 2
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:98:00.1 (socket 1)
ice_load_pkg_type(): Active package is: 1.3.28.0, ICE OS Default Package (double VLAN mode)
TELEMETRY: No legacy callbacks, legacy socket not created
ice_set_rx_function(): Using AVX2 OFFLOAD Vector Scattered Rx (port 0).
ice_set_tx_function(): Using AVX2 OFFLOAD Vector Tx (port 0).
[00:00:00.000229] Creating the usrp device with: master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx...
Error: LookupError: KeyError: No devices found for ----->
Device Address:
master_clock_rate: 245.76e6
mgmt_addr: 192.168.15.2
addr: 192.168.15.2
use_dpdk: 1
serial: 3257310
name: ni-x4xx-3257310
product: x410
type: x4xx


USRP-users mailing list -- usrp-users@lists.ettus.com
To unsubscribe send an email to usrp-users-leave@lists.ettus.com


USRP-users mailing list -- usrp-users@lists.ettus.com
To unsubscribe send an email to usrp-users-leave@lists.ettus.com

Thanks Piotr, that was indeed the issue. Works now. > On Aug 7, 2023, at 4:57 PM, Piotr Krysik <perper@o2.pl> wrote: > > Hello, > > For X410 the network adapter which works under DPDK driver control can't be used to control the device (it can't carry RPC calls to MPM daemon working on the device). You need a separate Ethernet connection for mgmt_addr. You can use 1Gbit Ethernet link for that. > > Best Regards, > Piotr Krysik > > W dniu 7.08.2023 o 21:40, Victor Levin via USRP-users pisze: >> Hi all, >> >> I am trying to enable DPDK with X410 and found an issue when using “use_dpdk=1”. I am on Ubuntu 22.04, the latest UHD 4.4.0 (commit: 4a77791cf5f7cedc842762be8b2b6775073d8c95) and DPDK 21.11.4. >> >> When the X410 is connect to the interface without DPDK, I can find it via uhd_usrp_probe and run benchmark_rate without issue. After binding the NIC to DPDK, the X410 can no longer be found when using DPDK. Anyone know why it’s disappearing? >> >> >> Output of find devices before DPDK is enabled: >> >> # uhd_find_devices >> [INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; UHD_4.4.0.HEAD-33-g4a77791c >> -------------------------------------------------- >> -- UHD Device 0 >> -------------------------------------------------- >> Device Address: >> serial: 3257310 >> addr: 192.168.15.2 >> claimed: False >> fpga: X4_200 >> mgmt_addr: 192.168.15.2 >> name: ni-x4xx-3257310 >> product: x410 >> type: x4xx >> >> >> After DPDK is enabled, the X410 is no longer found: >> >> /usr/local/lib/uhd/examples# ./benchmark_rate --args="master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx" --duration 3 --rx_rate 245.76e6 --tx_rate 245.76e6 >> >> [INFO] [UHD] linux; GNU C++ version 11.3.0; Boost_107400; DPDK_21.11; UHD_4.4.0.HEAD-33-g4a77791c >> [WARNING] [PREFS] Loaded config from /root/.uhd. This location is considered deprecated, consider moving your config file to /root/.config instead. >> EAL: Detected CPU lcores: 96 >> EAL: Detected NUMA nodes: 2 >> EAL: Detected shared linkage of DPDK >> EAL: Multi-process socket /var/run/dpdk/rte/mp_socket >> EAL: Selected IOVA mode 'VA' >> EAL: VFIO support initialized >> EAL: Using IOMMU type 1 (Type 1) >> EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:98:00.1 (socket 1) >> ice_load_pkg_type(): Active package is: 1.3.28.0, ICE OS Default Package (double VLAN mode) >> TELEMETRY: No legacy callbacks, legacy socket not created >> ice_set_rx_function(): Using AVX2 OFFLOAD Vector Scattered Rx (port 0). >> ice_set_tx_function(): Using AVX2 OFFLOAD Vector Tx (port 0). >> [00:00:00.000229] Creating the usrp device with: master_clock_rate=245.76e6,mgmt_addr=192.168.15.2,addr=192.168.15.2,use_dpdk=1,serial=3257310,name=ni-x4xx-3257310,product=x410,type=x4xx... >> Error: LookupError: KeyError: No devices found for -----> >> Device Address: >> master_clock_rate: 245.76e6 >> mgmt_addr: 192.168.15.2 >> addr: 192.168.15.2 >> use_dpdk: 1 >> serial: 3257310 >> name: ni-x4xx-3257310 >> product: x410 >> type: x4xx >> >> _______________________________________________ >> USRP-users mailing list -- usrp-users@lists.ettus.com >> To unsubscribe send an email to usrp-users-leave@lists.ettus.com > > _______________________________________________ > USRP-users mailing list -- usrp-users@lists.ettus.com > To unsubscribe send an email to usrp-users-leave@lists.ettus.com