{"id":4849,"date":"2019-12-14T03:19:43","date_gmt":"2019-12-14T08:19:43","guid":{"rendered":"http:\/\/cdnhost.net\/content\/?p=4849"},"modified":"2019-12-14T04:23:25","modified_gmt":"2019-12-14T09:23:25","slug":"using-mellanox-40gb-infiniband-with-proxmox-v5-x","status":"publish","type":"post","link":"https:\/\/cdnhost.net\/content\/using-mellanox-40gb-infiniband-with-proxmox-v5-x\/","title":{"rendered":"Using Mellanox 40gb Infiniband with Proxmox v5.x"},"content":{"rendered":"\n\n\n

Using Mellanox Infiniband 40gb adapters with Proxmox v5.x<\/p>\n\n\n\n

dependencies<\/h1>\n\n\n\n

apt-get -y install debhelper autotools-dev dkms zlib1g-dev python wget quilt python-libxml2 swig dpatch graphviz chrpath<\/p>\n\n\n\n

download and install<\/h1>\n\n\n\n

wget http:\/\/www.mellanox.com\/downloads\/ofed\/MLNX_EN-4.2-1.0.1.0\/mlnx-en-4.2-1.0.1.0-debian9.0-x86_64.tgz
tar xzvf mlnx-en-4.2-1.0.1.0-debian9.0-x86_64.tgz
cd mlnx-en-4.2-1.0.1.0-debian9.0-x86_64
.\/install –skip-distro-check<\/p>\n\n\n\n

then run this:<\/p>\n\n\n\n

wget http:\/\/download.proxmox.com\/debian\/pve\/dists\/stretch\/pvetest\/binary-amd64\/pve-headers-4.13.4-1-pve_4.13.4-25_amd64.deb
\ndpkg -i pve-headers-4.13.4-1-pve_4.13.4-25_amd64.deb<\/p>\n\n\n\n

and reboot!<\/p>\n\n\n\n

<\/p>\n\n\n\n

THEN… do this:<\/p>\n\n\n\n

<\/p>\n\n\n\n

From the software side<\/p>\n\n\n\n

sudo apt-get install opensm infiniband-diags librdmacm-dev libibverbs-dev libmlx4-dev\n<\/code><\/pre>\n\n\n\n
Then add these to \/etc\/modules via nano \/etc\/modules and pasting these lines in.<\/p>\n\n\n\n
mlx4_ib\nip_ipoib\nrdma_ucm\n\nThen reboot.\n<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"
Using Mellanox Infiniband 40gb adapters with Proxmox v5.x dependencies apt-get -y install debhelper autotools-dev dkms zlib1g-dev python wget quilt python-libxml2 swig dpatch graphviz chrpath download and install wget http:\/\/www.mellanox.com\/downloads\/ofed\/MLNX_EN-4.2-1.0.1.0\/mlnx-en-4.2-1.0.1.0-debian9.0-x86_64.tgz tar xzvf mlnx-en-4.2-1.0.1.0-debian9.0-x86_64.tgz cd mlnx-en-4.2-1.0.1.0-debian9.0-x86_64 .\/install –skip-distro-check then run this: wget http:\/\/download.proxmox.com\/debian\/pve\/dists\/stretch\/pvetest\/binary-amd64\/pve-headers-4.13.4-1-pve_4.13.4-25_amd64.deb dpkg -i pve-headers-4.13.4-1-pve_4.13.4-25_amd64.deb and reboot! THEN… do this: From the software side Then add […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-4849","post","type-post","status-publish","format-standard","hentry","category-uncategorized","has-post-title","has-post-date","has-post-category","has-post-tag","has-post-comment","has-post-author",""],"builder_content":"","_links":{"self":[{"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/posts\/4849","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/comments?post=4849"}],"version-history":[{"count":8,"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/posts\/4849\/revisions"}],"predecessor-version":[{"id":4857,"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/posts\/4849\/revisions\/4857"}],"wp:attachment":[{"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/media?parent=4849"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/categories?post=4849"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cdnhost.net\/content\/wp-json\/wp\/v2\/tags?post=4849"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}