Difference between revisions of "Slurm-web Installation"

From Supercomputación y Cálculo Científico UIS
Line 1: Line 1:
<div class="thumbnail img-thumbnail"><img src="/images/a/a8/Logo_sc33.png" alt="Logo_sc33.png" /></div>
+
<div class="thumbnail img-thumbnail">http://wiki.sc3.uis.edu.co/images/a/a8/Logo_sc33.png</div>
<p><code><span class="fck_mw_magic">_</span></code></p>
+
<p><code>__NOTOC__</code></p>
<p>Back to <a href="/Job%20Scheduler%20Slurm">Job Scheduler Slurm</a></p>
+
<p>Back to [[Job Scheduler Slurm]]</p>
 
<p>&nbsp;</p>
 
<p>&nbsp;</p>
<div class="btn btn-primary"><em class="fa fa-long-arrow-left">&nbsp;</em> <a href="/Cursos">Cursos</a></div>
+
<div class="btn btn-primary"><em class="fa fa-long-arrow-left">&nbsp;</em> [[Cursos]]</div>
 
<p>&nbsp;</p>
 
<p>&nbsp;</p>
 
<div class="column clearfix">
 
<div class="column clearfix">
Line 27: Line 27:
 
<p>all python modules and javascript libraries ought to be installed via apt packages for the slurm-web installation to work</p>
 
<p>all python modules and javascript libraries ought to be installed via apt packages for the slurm-web installation to work</p>
 
<h5><strong>Installing pre-requisites</strong></h5>
 
<h5><strong>Installing pre-requisites</strong></h5>
<p>Some previous packages:  <span class="fck_mw_template">{{Command|aptitude install apache2-dev}}</span> <span class="fck_mw_template">{{Command|aptitude install libapache2-mod-wsgi}}</span> <span class="fck_mw_template">{{Command|apt-get install debuild}}</span></p>
+
<p>Some previous packages:  {{Command|aptitude install apache2-dev}} {{Command|aptitude install libapache2-mod-wsgi}} {{Command|apt-get install debuild}}</p>
 
<h6><strong>Flask:</strong></h6>
 
<h6><strong>Flask:</strong></h6>
<p><span class="fck_mw_template">{{Command|aptitude install python-flask}}</span> Test it by the procedure detailed in <a title="http://flask.pocoo.org/" href="http://flask.pocoo.org/">http://flask.pocoo.org/</a></p>
+
<p>{{Command|aptitude install python-flask}}   Test it by the procedure detailed in http://flask.pocoo.org/</p>
 
<h6><strong>ClusterShell:</strong></h6>
 
<h6><strong>ClusterShell:</strong></h6>
<p><span class="fck_mw_template">{{Command|aptitude install clustershell}}</span> Check the project page for more info <a title="http://cea-hpc.github.io/clustershell/" href="http://cea-hpc.github.io/clustershell/">http://cea-hpc.github.io/clustershell/</a></p>
+
<p>{{Command|aptitude install clustershell}} Check the project page for more info http://cea-hpc.github.io/clustershell/</p>
 
<h6><strong>PySlurm:</strong></h6>
 
<h6><strong>PySlurm:</strong></h6>
 
<p>The slurm-web package require pyslurm to be provided by a package called python-pyslurm.  In the debian release where this procedure was tested that package didn't exist, so it had to be provided by a dummy package.</p>
 
<p>The slurm-web package require pyslurm to be provided by a package called python-pyslurm.  In the debian release where this procedure was tested that package didn't exist, so it had to be provided by a dummy package.</p>
<p>First, install the real pyslurm using pip <span class="fck_mw_template">{{Command|pip install pyslurm}}</span></p>
+
<p>First, install the real pyslurm using pip {{Command|pip install pyslurm}}</p>
<p>Test it using the examples shown in <a title="http://www.gingergeeks.co.uk/pyslurm/" href="http://www.gingergeeks.co.uk/pyslurm/">http://www.gingergeeks.co.uk/pyslurm/</a></p>
+
<p>Test it using the examples shown in http://www.gingergeeks.co.uk/pyslurm/</p>
<p>Then create a dummy package using equivs.  First, install equivs if your system doesn't have it: <span class="fck_mw_template">{{Command|aptitude install equivs}}</span> then create a configuration file for our new package <span class="fck_mw_template">{{Command|equivs-control python-pyslurm}}</span>.&nbsp; Now, we should edit the configuration file for the package to provide python-pyslurm <a title="http://www.brain-dump.org/blog/entry/40/Creating_dummy_packages_to_fullfill_dependencies_in_Debian" href="http://www.brain-dump.org/blog/entry/40/Creating_dummy_packages_to_fullfill_dependencies_in_Debian">[1]</a>.&nbsp; The package will provide nothing in reality, but the package management system will be fooled into thinking that the package is present. The actual functionality is going to be provided by the pyslurm pip package. The important options are presented below:</p>
+
<p>Then create a dummy package using equivs.  First, install equivs if your system doesn't have it: {{Command|aptitude install equivs}} then create a configuration file for our new package {{Command|equivs-control python-pyslurm}}.&nbsp; Now, we should edit the configuration file for the package to provide python-pyslurm [http://www.brain-dump.org/blog/entry/40/Creating_dummy_packages_to_fullfill_dependencies_in_Debian].&nbsp; The package will provide nothing in reality, but the package management system will be fooled into thinking that the package is present. The actual functionality is going to be provided by the pyslurm pip package. The important options are presented below:</p>
<p><span class="fck_mw_template">{{File|nano python-pyslurm|&lt;br /&gt;Section: misc&lt;br /&gt;Priority: optional&lt;br /&gt;Standards-Version: 3.5.10&lt;br /&gt;&lt;br /&gt;Package: python-pyslurm&lt;br /&gt;Provides: python-pyslurm&lt;br /&gt;Architecture: all&lt;br /&gt;&lt;br /&gt;Description: Dummy package whichs only purpose is to provide pyslurm}}</span></p>
+
<p>{{File|nano python-pyslurm|<br />Section: misc<br />Priority: optional<br />Standards-Version: 3.5.10<br /><br />Package: python-pyslurm<br />Provides: python-pyslurm<br />Architecture: all<br /><br />Description: Dummy package whichs only purpose is to provide pyslurm}}</p>
<p>Now, build the package: <span class="fck_mw_template">{{Command|equivs-build python-pyslurm}}</span></p>
+
<p>Now, build the package: {{Command|equivs-build python-pyslurm}}</p>
<p>And, install it: <span class="fck_mw_template">{{Command|dpkg -i python-pyslurm_1.0_all.deb}}</span></p>
+
<p>And, install it: {{Command|dpkg -i python-pyslurm_1.0_all.deb}}</p>
 
<h6><strong>Bootstrap, jQuery y Float:</strong></h6>
 
<h6><strong>Bootstrap, jQuery y Float:</strong></h6>
<p><span class="fck_mw_template">{{Command|aptitude install libjs-bootstrap libjs-jquery-flot libjs-jquery-tablesorter}}</span></p>
+
<p>{{Command|aptitude install libjs-bootstrap libjs-jquery-flot libjs-jquery-tablesorter}}</p>
<p>Now, bootstrap must be activated using: <span class="fck_mw_template">{{Command|a2enconf javascript-common}}</span></p>
+
<p>Now, bootstrap must be activated using: {{Command|a2enconf javascript-common}}</p>
 
<p>&nbsp;</p>
 
<p>&nbsp;</p>
 
<h5><strong>Installation of the main package</strong></h5>
 
<h5><strong>Installation of the main package</strong></h5>
<p>First, it is required to get the latest snapshot of slurm-web from github: <span class="fck_mw_template">{{Command|git clone https://github.com/edf-hpc/slurm-web.git}}</span>. Then, build the package from the project directory: <span class="fck_mw_template">{{Command|debuild -us -uc}}</span></p>
+
<p>First, it is required to get the latest snapshot of slurm-web from github: {{Command|git clone https://github.com/edf-hpc/slurm-web.git}}. Then, build the package from the project directory: {{Command|debuild -us -uc}}</p>
<p>Finally, install using dpkg, first the REST api package then the dashboard: <span class="fck_mw_template">{{Command|dpkg -i slurm-web-restapi_1.1.3_amd64.deb}}</span> <span class="fck_mw_template">{{Command|dpkg -i slurm-web-dashboard_1.1.3_amd64.deb}}</span></p>
+
<p>Finally, install using dpkg, first the REST api package then the dashboard: {{Command|dpkg -i slurm-web-restapi_1.1.3_amd64.deb}} {{Command|dpkg -i slurm-web-dashboard_1.1.3_amd64.deb}}</p>
 
<p>&nbsp;</p>
 
<p>&nbsp;</p>
 
<h5><strong>Configuration and customisation</strong></h5>
 
<h5><strong>Configuration and customisation</strong></h5>
<p>In /usr/share/slurm-web/ there is a folder called static.&nbsp; Put a custon logo there.&nbsp; In /etc/slurm-web/ there is a file called racks.xml.&nbsp; That file must be edited. The example for GUANE is presented below, but a more general version is shown in the oficial documentation of slurm-web <a title="http://edf-hpc.github.io/slurm-web/installation.html" href="http://edf-hpc.github.io/slurm-web/installation.html">[2]</a></p>
+
<p>In /usr/share/slurm-web/ there is a folder called static.&nbsp; Put a custon logo there.&nbsp; In /etc/slurm-web/ there is a file called racks.xml.&nbsp; That file must be edited. The example for GUANE is presented below, but a more general version is shown in the oficial documentation of slurm-web [http://edf-hpc.github.io/slurm-web/installation.html]</p>
<p><span class="fck_mw_template">{{File|nano python-pyslurm|fckLR</span></p>
+
{{File|nano python-pyslurm|
 
<pre>&lt;?xml version="1.0" encoding="UTF-8"?&gt;
 
<pre>&lt;?xml version="1.0" encoding="UTF-8"?&gt;
 
&lt;!DOCTYPE rackmap SYSTEM "/usr/share/slurm-web/restapi/schema/dtd/racks.dtd"&gt;
 
&lt;!DOCTYPE rackmap SYSTEM "/usr/share/slurm-web/restapi/schema/dtd/racks.dtd"&gt;
Line 80: Line 80:
 
&lt;/rackmap&gt;
 
&lt;/rackmap&gt;
 
</pre>
 
</pre>
fckLR}}
+
}}
<p>&nbsp;</p>
 
 
<p>&nbsp;</p>
 
<p>&nbsp;</p>
 
<p>&nbsp;</p>
 
<p>&nbsp;</p>

Revision as of 16:53, 16 October 2015

Logo_sc33.png

Back to Job Scheduler Slurm

 

 

Slurm-web installation

First, let's review the pre-requisites:

  • python
  • pyslurm (python module)
  • Flask (python module)
  • clusterShell (python module)
  • bootstrap (javascript library)
  • jQuery
  • Flot (jQuery extension for graph drawing)

all python modules and javascript libraries ought to be installed via apt packages for the slurm-web installation to work

Installing pre-requisites

Some previous packages:

aptitude install apache2-dev
aptitude install libapache2-mod-wsgi
apt-get install debuild

Flask:

aptitude install python-flask
Test it by the procedure detailed in http://flask.pocoo.org/

ClusterShell:

aptitude install clustershell
Check the project page for more info http://cea-hpc.github.io/clustershell/

PySlurm:

The slurm-web package require pyslurm to be provided by a package called python-pyslurm. In the debian release where this procedure was tested that package didn't exist, so it had to be provided by a dummy package.

First, install the real pyslurm using pip

pip install pyslurm

Test it using the examples shown in http://www.gingergeeks.co.uk/pyslurm/

Then create a dummy package using equivs. First, install equivs if your system doesn't have it:

aptitude install equivs
then create a configuration file for our new package
equivs-control python-pyslurm
.  Now, we should edit the configuration file for the package to provide python-pyslurm [1].  The package will provide nothing in reality, but the package management system will be fooled into thinking that the package is present. The actual functionality is going to be provided by the pyslurm pip package. The important options are presented below:

File: nano python-pyslurm

Section: misc
Priority: optional
Standards-Version: 3.5.10

Package: python-pyslurm
Provides: python-pyslurm
Architecture: all

Description: Dummy package whichs only purpose is to provide pyslurm

Now, build the package:

equivs-build python-pyslurm

And, install it:

dpkg -i python-pyslurm_1.0_all.deb

Bootstrap, jQuery y Float:

aptitude install libjs-bootstrap libjs-jquery-flot libjs-jquery-tablesorter

Now, bootstrap must be activated using:

a2enconf javascript-common

 

Installation of the main package

First, it is required to get the latest snapshot of slurm-web from github:

. Then, build the package from the project directory:
debuild -us -uc

Finally, install using dpkg, first the REST api package then the dashboard:

dpkg -i slurm-web-restapi_1.1.3_amd64.deb
dpkg -i slurm-web-dashboard_1.1.3_amd64.deb

 

Configuration and customisation

In /usr/share/slurm-web/ there is a folder called static.  Put a custon logo there.  In /etc/slurm-web/ there is a file called racks.xml.  That file must be edited. The example for GUANE is presented below, but a more general version is shown in the oficial documentation of slurm-web [2]

File: nano python-pyslurm
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE rackmap SYSTEM "/usr/share/slurm-web/restapi/schema/dtd/racks.dtd">
<rackmap>
  <nodetypes>
    <nodetype id="psl390s-1"
              model="HP Proliant SL390s"
              height="4"
              width="0.5"
              />
    <nodetype id="psl390s-2"
              model="HP Proliant SL390s"
              height="4"
              width="0.5"
              />
  </nodetypes>
  <racks>
    <!-- Rack A1 -->
    <rack id="guane" posx="0">
      <nodes>
        <nodeset id="guane[01-16]"
                 type="psl390s-1"
                 posx="0"
                 posy="31"
		 draw="down"	 />
      </nodes>
    </rack>
 </racks>
</rackmap>

 

 

To do:

Figure out a distribution independent way of installation.  Since it only uses javascript and python, it should be possible to install via "sources" and paths.