SEQanswers

Go Back   SEQanswers > Bioinformatics > Bioinformatics



Similar Threads
Thread Thread Starter Forum Replies Last Post
batch job manager? Richard Finney Bioinformatics 2 04-26-2011 01:10 PM
Software Test Manager - Job Code: SW07_SeqAnswers IonTorrent Industry Jobs! 0 02-03-2010 07:51 AM

Reply
 
Thread Tools
Old 04-17-2013, 07:09 PM   #1
jaysantos
Junior Member
 
Location: Philippines

Join Date: Apr 2013
Posts: 3
Default Resource Manager/Job scheduler

Hi all,

We have a here a standalone machine running CentOS 6.2 minimal install. 48 core CPU and 512GB of RAM. I'm looking for a resource manager/job scheduler for our server. I've search upon the web and found Torque + Maui. Though it has a guide on how to install. But I'm not quite confident to install it in the server. Is there anyone of you installed this resource manager? Can someone give me a step by step guide on how to install this resource manager? How it works? and how to administer it?

I'm sorry for being newbie here. Any help from you is highly Appreciated.

Thank you.
jaysantos is offline   Reply With Quote
Old 04-17-2013, 07:51 PM   #2
Wallysb01
Senior Member
 
Location: San Francisco, CA

Join Date: Feb 2011
Posts: 286
Default

I put Torque on my 12 core workstation running Ubuntu 12.04 (note the host name is miniopterus). It was really quite easy thanks to aptitude.

Here's my install notes and good luck adapting them to CentOS:


Code:
## This is the readme for the setup procedure for Torque on Miniopterus ##

## To install the programs needed:
sudo aptitude install torque-server torque-scheduler torque-client


## To configure torque for miniopterus:

qterm

sudo qmgr -c 'set server mom_job_sync = true'
sudo qmgr -c 'create queue batch'
sudo qmgr -c 'set queue batch queue_type = execution'
sudo qmgr -c 'set queue batch started = true'
sudo qmgr -c 'set queue batch enabled = true'
sudo qmgr -c 'set queue batch resources_default.walltime = 240:00:00'
sudo qmgr -c 'set queue batch resources_default.nodes = 1'
sudo qmgr -c 'set server default_queue = batch'
sudo qmgr -c 'set server managers = walter@miniopterus'
sudo qmgr -c 'set server managers = walter@miniopterus.ucsf.edu'
sudo qmgr -c 'set server operators = walter@miniopterus.ucsf.edu'

sudo aptitude install torque-client torque-mom
sudo pbs_mom
sudo pbs_server
sudo pbs_sched


## Torque looks for /etc/profile to add directories to your path for use with qsub
## However Ubuntu now likes /etc/enviornment so I added the following lines at the bottom of /etc/profile (this doesn't seem to have solved the path issues completely however):

PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/RepeatMasker:/home/walter/tools/augustus.2.5.5/bin"
export ZOE=/usr/local/bin/Zoe/
export AUGUSTUS_CONFIG_PATH=/home/walter/tools/augustus.2.5.5/config/

## make sure /var/spool/torque/mom_priv/config has the following line:

$pbs_server = 127.0.0.1

## make sure /var/spool/torque/server_priv/nodes has the following line:

miniopterus np=12

## make sure /var/spool/torque/server_name has the following line:

miniopterus


## That should do it.  But the torque manual is a great reference: http://www.clusterresources.com/torquedocs21/
## Good luck!
Wallysb01 is offline   Reply With Quote
Old 04-18-2013, 04:16 AM   #3
GenoMax
Senior Member
 
Location: East Coast USA

Join Date: Feb 2008
Posts: 7,049
Default

This is a link to build open grid scheduler for CentOS: http://bioteam.net/2012/01/building-...ntos-rhel-6-2/

An older version of SGE (Sun/Oracle Grid Engine) would be another option. If you google for "SGE install Cent OS" there are several links with instructions.
GenoMax is offline   Reply With Quote
Old 09-01-2013, 10:20 PM   #4
jaysantos
Junior Member
 
Location: Philippines

Join Date: Apr 2013
Posts: 3
Default

Sorry for late reply. Been busy for another project. and this resource manager/job scheduler are still pending for me.

Torque and Maui are the one I started with, but I'm not confident to try it. (lack of training). Are there any other Resource manager/Job Scheduler you can suggest. Even if it's has a license?

Any inputs are highly appreciated.

Thank you very much.

Cheers,
jaysantos is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off




All times are GMT -8. The time now is 08:32 AM.


Powered by vBulletin® Version 3.8.9
Copyright ©2000 - 2020, vBulletin Solutions, Inc.
Single Sign On provided by vBSSO