Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>If by cluster computing you mean distributed memory systems (multiple nodes rather that SMP) then Python's multiprocessing may not be a suitable choice. It can spawn multiple processes but they will still be bound within a single node.</p> <p>What you will need is a framework that handles spawing of processes across multiple nodes and provides a mechanism for communication between the processors. (pretty much what MPI does).</p> <p>See the page on <a href="http://wiki.python.org/moin/ParallelProcessing" rel="noreferrer">Parallel Processing on the Python wiki</a> for a list of frameworks which will help with cluster computing. </p> <p>From the list, <a href="http://www.parallelpython.com/" rel="noreferrer">pp</a>, <a href="http://luispedro.org/software/jug" rel="noreferrer">jug</a>, <a href="http://pythonhosted.org/Pyro4/" rel="noreferrer">pyro</a> and <a href="http://celeryproject.org/" rel="noreferrer">celery</a> look like sensible options although I can't personally vouch for any since I have no experience with any of them (I use mainly MPI).</p> <p>If ease of installation/use is important, I would start by exploring <code>jug</code>. It's <a href="https://jug.readthedocs.org/en/latest/#how-do-i-get-jug" rel="noreferrer">easy to install</a>, <a href="http://jug.readthedocs.org/en/latest/faq.html#will-jug-work-on-batch-cluster-systems-like-sge-or-pbs" rel="noreferrer">supports common batch cluster systems</a>, and looks <a href="http://jug.readthedocs.org/" rel="noreferrer">well documented</a>.</p>
    singulars
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. VO
      singulars
      1. This table or related slice is empty.
    2. VO
      singulars
      1. This table or related slice is empty.
    3. VO
      singulars
      1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload