Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>If it's that you have lot of students and staff accessing the Hadoop cluster for job submission, you can probably look at Job Scheduling in Hadoop.</p> <p>Here is the gist of some types you may be interested in - </p> <p><strong>Fair scheduler:</strong> The core idea behind the fair share scheduler was to assign resources to jobs such that on average over time, each job gets an equal share of the available resources. To ensure fairness, each user is assigned to a pool. In this way, if one user submits many jobs, he or she can receive the same share of cluster resources as all other users (independent of the work they have submitted). </p> <p><strong>Capacity scheduler:</strong> In capacity scheduling, instead of pools, several queues are created, each with a configurable number of map and reduce slots. Each queue is also assigned a guaranteed capacity (where the overall capacity of the cluster is the sum of each queue's capacity). Capacity scheduling was defined for large clusters, which may have multiple, independent consumers and target applications.</p> <p>Here's the link from where I shamelessly copied the above mentioned things, due to lack of time. <a href="http://www.ibm.com/developerworks/library/os-hadoop-scheduling/index.html" rel="nofollow">http://www.ibm.com/developerworks/library/os-hadoop-scheduling/index.html</a></p> <p>To configure Hadoop use this link: <a href="http://hadoop.apache.org/docs/r1.1.1/fair_scheduler.html#Installation" rel="nofollow">http://hadoop.apache.org/docs/r1.1.1/fair_scheduler.html#Installation</a></p>
    singulars
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload