Difference: ClusterJobs (17 vs. 18)

Revision 182006-08-08 - MattPost

Line: 1 to 1
 

How to Use the Cluster Manager

Torque is a system for reserving nodes and running jobs

Line: 17 to 17
 You can launch a job from any of these machines (but not directly from other machines in the dept).
Changed:
<
<

Problems

You may find that your cluster jobs quit unexpectedly and result in an email like the following:

Job Name:   train.pl
An error has occurred processing your job, see below.
Post job file processing error; job 5785.node64.cs.rochester.edu on host node37/1+node36/0+node35/0+node34/0+node33/1

Unable to copy file /usr/var/lib/torque/spool/5785.node64.OU to post@node64.cs.rochester.edu:/scratch/post/run/train.pl.o5785
>>> error from copy
>>> end error output
Output retained on that host in: /usr/var/lib/torque/undelivered/5785.node64.OU
>
>

Node Usage Policy

 
Changed:
<
<
This happens because torque uses ssh to start jobs on multiple machines, which requires that the hostkey is in your ~/.ssh/known_hosts file. To do this, you need to ssh to every host using the fully-qualified domain name (e.g., node64.cs.rochester.edu instead of just node64).
>
>
Torque is installed on nodes 33 through 66, and any jobs run on those machines should be scheduled through torque.
 
Changed:
<
<
-- MattPost - 05 Jul 2006
>
>
All the node machines (0 through 66) are dual-processor machines. Please limit your cluster usage at any given time to 32 processors, which is roughly a quarter of the total computing power of the cluster.
 

To Use a Node Interactively

Line: 100 to 87
 % qsub -l nodes=4:ppn=2

-- DanGildea - 14 Dec 2005

Added:
>
>

Problems

You may find that your cluster jobs quit unexpectedly and result in an email like the following:

Job Name:   train.pl
An error has occurred processing your job, see below.
Post job file processing error; job 5785.node64.cs.rochester.edu on host node37/1+node36/0+node35/0+node34/0+node33/1

Unable to copy file /usr/var/lib/torque/spool/5785.node64.OU to post@node64.cs.rochester.edu:/scratch/post/run/train.pl.o5785
>>> error from copy
>>> end error output
Output retained on that host in: /usr/var/lib/torque/undelivered/5785.node64.OU

This happens because torque uses ssh to start jobs on multiple machines, which requires that the hostkey is in your ~/.ssh/known_hosts file. To do this, you need to ssh to every host using the fully-qualified domain name (e.g., node64.cs.rochester.edu instead of just node64).

-- MattPost - 05 Jul 2006

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding URCS? Send feedback