Databases
StackOverflow2013
Postsdbo
PO
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>To run an Rmpi-based program on a cluster, you need to request multiple nodes using your batch queueing system, and then execute your R script from the job script via a utility such as mpirun/mpiexec. Ideally, the mpirun utility has been built to automatically detect what nodes have been allocated by the batch queueing system, otherwise you will need to use an mpirun argument such as <code>--hostfile</code> to tell it what nodes to use.</p> <p>In your case, it sounds like you requested multiple nodes, so the problem is probably with the way that the R script is executed. Some people don't realize that they need to use mpirun/mpiexec, and the result is that your script runs on a single node. If you are using mpirun, it may be that your installation of Open MPI wasn't built with support for your batch queueing system. In that case, you would have to create an appropriate hostfile from information supplied by your batch queueing system which is usually supplied via an environment variable and/or a file.</p> <p>Here is a typical mpirun command that I use to execute my parallel R scripts from the job script:</p> <pre><code>mpirun -np 1 R --slave -f par.R </code></pre> <p>Since we build Open MPI with support for Torque, I don't use the <code>--hostfile</code> option: mpirun figures out what nodes to use from the <code>PBS_NODEFILE</code> environment variable automatically. The use of <code>-np 1</code> may seem strange, but is needed if your program is going to spawn workers, which is typically done when using the <code>snow</code> package. I've never used <code>snowfall</code>, but after looking over the source code, it appears to me that <code>sfInit</code> always calls <code>makeMPIcluster</code> with a "count" argument which will cause <code>snow</code> to spawn workers, so I think that <code>-np 1</code> is required for MPI clusters with <code>snowfall</code>. Otherwise, mpirun will start your R script on multiple nodes, and each one will spawn 10 workers on their own node which is not what you want. The trick is to set the <code>sfInit</code> "cpus" argument to a value that is consistent with the number of nodes allocated to your job by the batch queueing system. You may find the <code>Rmpi</code> <code>mpi.universe.size</code> function useful for that.</p> <p>If you think that all of this is done correctly, the problem may be with the way that the MPI cluster object is being created in your R script, but I suspect that it has to do with the use (or lack of use) of mpirun.</p>
    singulars
    1. This table or related slice is empty.
    1. POInitializing MPI cluster with snowfall R
      singulars
      1. PTQuestion
    1. PTAnswer
    1. USSteve Weston
    1. USSteve Weston
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. POInitializing MPI cluster with snowfall R
      singulars
      1. PTQuestion
    1. This table or related slice is empty.
    1. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTAcceptedByOriginator
    1. COThanks, I think the problem is most likely that I did not use mpirun (was not aware of this). So the documentation for using mpirun is as follows from the instructions for the cluster: # Invoke mpirun. # Note: $NSLOTS is set by OGS to N, the number of processors # requested by the "-pe mpi_M_tasks_per_node N" option. # If M=4, possible N are: 4, 8, 12, 16, . . . # (see Table 2 in Runningjobs page) mpirun -np $NSLOTS mpi_program arg1 arg2 .. If I want to have snowfall do all the work for me I should just do -np 1?
      singulars
      1. PO
      1. USuser1480248
    2. CO@user1480248 As mentioned in my updated answer, I think you do need to use '-np 1' with snowfall. Rmpi-based packages are rather unusual in using MPI spawning, so the usual advice on how to set `-np` is wrong.
      singulars
      1. PO
      1. USSteve Weston
    3. COSo if I'm allocated 16 compute nodes and I want to utilize all 16 cores on each of these nodes (which the system gives me access to) if I let cpus <- mpi.universe.size() it'll run it on all those compute nodes and also fully utilize them?
      singulars
      1. PO
      1. USuser1480248
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload