View source for Debian 7 Infiniband

__NOTOC__

<div class="thumbnail img-thumbnail">http://wiki.sc3.uis.edu.co/images/a/a8/Logo_sc33.png</div> 
<p><div class="btn btn-primary"><i class="fa  fa-long-arrow-left"></i> [[Administración del SC3]]</div></p>

<div class="col-md-14">
    <div class="panel panel-darker-white-border"> 
        <div class="panel-heading">
            <h3 class="panel-title">Infiniband configuration in Debian 7</h3>
        </div>
        <div class="panel-body">
            <p><b>Install the required software</b></p>
            <p>{{Command|<nowiki>apt-get -y install infiniband-diags ibutils libmthca ibverbs-utils libibumad libibmad libibverbs1 
libmthca1 libmthca1-dbg libmthca-dev libopensm2 opensm </nowiki>}}
            </p>
            <p><b>Load the kernel Modules</b></p>
            <p>Load the proper linux modules. Edit the file '''/etc/modules''' and add the following lines</p>
            <p>{{File|/etc/modules|<pre><nowiki>
            #tarjeta Mellanox MT26438
            mlx4_ib

            #IP over IB
            ib_ipoib

            # Protocol modules
            # Common modules
            rdma_ucm
            ib_umad
            ib_uverbs
            </nowiki></pre>}}</p>
            <p>Then, execute the following commands</p>
            <p>{{Command|<nowiki>modprobe mlx4_ib
            modprobe ib_ipoib
            modprobe rdma_ucm
            modprobe ib_umad
            modprobe ib_uverbs </nowiki>}}</p>
            <p><b>Subnetting Daemon Configuration</b></p>
            <p>find the available ports in the card.</p>
            <p>{{Command|<nowiki> ibstat -p </nowiki>}}</p>
            <p>The output are the identifiers of the ports. Example: </p>
            <p>0x78e7d10300244e95</p>
            <p>Then, edit the file '''/etc/default/opensm'''</p>
            <p>And change the following line</p>
            <p>        PORTS=ALL</p>
            <p>Like this</p>
            <p>PORTS="0x78e7d10300244e95"</p>
            <p><b>Start The Subnetting Service</b></p>
            <p>Start the opensm service</p>
            <p>{{Command|<nowiki> /etc/init.d/opensm start </nowiki>}}</p>
            <p><b>Configure the Infiniband Interface</b></p>
            <p>Edit the file '''/etc/network/interfaces''' and add the following lines</p>
            <p>{{File|/etc/network/interfaces|<pre><nowiki>
            auto ib0
            iface ib0 inet static
            address 192.168.38.71
            netmask 255.255.255.0
            broadcast 192.168.38.255
            </nowiki></pre>}}</p>
            <p>Then, start the interface</p>
            <p>{{Command|<nowiki> ifup ib0 </nowiki>}}</p>
            <p>Test the interface using the following commands</p>
            <p>{{Command|<nowiki> ibstat
            ibhosts </nowiki>}}</p>
        </div>
    </div>
</div>