Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    text
    copied!<p>You could also use <a href="http://whirr.apache.org/" rel="nofollow">Apache Whirr</a> for this workflow like this:</p> <ol> <li><p>Start by downloading the latest release (0.7.0 at this time) from <a href="http://www.apache.org/dyn/closer.cgi/whirr/" rel="nofollow">http://www.apache.org/dyn/closer.cgi/whirr/</a></p></li> <li><p>Extract the archive and try to run <code>./bin/whirr version</code>. You need to have Java installed for this to work.</p></li> <li><p>Make your Amazon AWS credentials available as environment variables:<pre> export AWS_ACCESS_KEY_ID=... export AWS_SECRET_ACCESS_KEY=...</pre></p></li> <li><p>Update the Hadoop EC2 config to match your needs by editing <code>recipes/hadoop-ec2.properties</code>. Check the <a href="http://whirr.apache.org/docs/latest/configuration-guide.html" rel="nofollow">Configuration Guide</a> for more info.</p></li> <li><p>Start a cluster Hadoop by running: <pre> ./bin/whirr launch-cluster --config recipes/hadoop-ec2.properties</pre></p></li> <li><p>You can see verbose logging output by doing <code>tail -f whirr.log</code></p></li> <li><p>Now you can login to your cluster and do your work.<pre> ./bin/whirr list-cluster --config recipes/hadoop-ec2.properties ssh namenode-ip start jobs as needed or copy data from / to S3 using distcp </pre></p></li> </ol> <p>For more explanations you should read the <a href="http://whirr.apache.org/docs/latest/quick-start-guide.html" rel="nofollow">Quick Start Guide</a> and the <a href="http://whirr.apache.org/docs/latest/whirr-in-5-minutes.html" rel="nofollow">5 minutes guide</a>. </p> <p>Disclaimer: I'm one of the committers. </p>
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload