Databases
StackOverflow2013
Postsdbo
PO
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>As you are probably already suspecting, this is going to be inherently difficult to do because of the runtime requirement for MATLAB. I had a similar experience (having to distribute the runtime libraries) when attempting to run MATLAB code over Condor.</p> <p>As far as the options you are listing are concerned, option #1 will work best. Also, you will probably not be available to avoid working with Linux.</p> <p>However, if you don't want to lose the convenience provided by higher level software (such as MATLAB, Octave, Scilab and others) you could try Hadoop streaming in combination with Octave executable scripts.</p> <p>Hadoop streaming does not care about the nature of the executable (whether it is an executable script or an executable file, according to this (http://hadoop.apache.org/common/docs/r0.15.2/streaming.html)). </p> <p>All it requires, is that it is given an "executable" that in addition can a) read from stdin, b) send output to stdout.</p> <p>GNU Octave programs can be turned into executable scripts (in Linux) with the ability to read from stdin and send the output to stdout (http://www.gnu.org/software/octave/doc/interpreter/Executable-Octave-Programs.html).</p> <p>As a simple example consider this:</p> <p>Create a file (for example "al.oct") with the following contents:</p> <pre><code>#!/bin/octave -qf (Please note, in my installation i had to use "#!/etc/alternatives/octave -qf") Q = fread(stdin); #Standard Octave / MATLAB code from here on disp(Q); </code></pre> <p>Now from the command prompt issue the following command:</p> <blockquote> <blockquote> <p>chmod +x al.oct</p> </blockquote> </blockquote> <p>al.oct is now an executable...You can execute it with "./al.oct". To see where the stdin,stdout fits in (so that you can use it with Hadoop) you can try this:</p> <pre><code>&gt;&gt;cat al.oct|./al.oct|sort </code></pre> <p>Or in other words..."cat" the file al.oct, pipe its output to the executable script al.oct and then pipe the output of al.oct to the sort utility (this is just an example,we could have "cat" any file, but since we know that al.oct is a simple text file we just use this).</p> <p>It could be of course that Octave does not support everything your MATLAB code is trying to call, but this could be an alternative way to using Hadoop Streaming without losing the convenience / power of higher level code.</p>
    singulars
    1. This table or related slice is empty.
    1. POHow to use MATLAB code in mapper (Hadoop)?
      singulars
      1. PTQuestion
    1. PTAnswer
    1. This table or related slice is empty.
    1. USA_A
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. POHow to use MATLAB code in mapper (Hadoop)?
      singulars
      1. PTQuestion
    1. This table or related slice is empty.
    1. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTAcceptedByOriginator
    3. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    1. COGreat suggestion! I will try this..
      singulars
      1. PO
      1. USHarsh
    2. COBut I think I need to install octave in every worker node of the hadoop cluster for doing this, am I right ? Isn't there a way to create a .out file from an octave code? That would be very helpful..
      singulars
      1. PO
      1. USHarsh
    3. COYes, that would be the case :-/ At the moment it is impossible to compile Octave or even transliterate octave code to something executable. Please see [this](http://stackoverflow.com/questions/5101219/how-do-i-convert-octave-code-to-c-or-c) and [this](http://octave.1599824.n4.nabble.com/octave-to-independent-C-code-td1630298.html) (i haven't followed up the second for a long time). You need some kind of control over your workers...Maybe your service's admins can help with getting the most viable of the above options to work (?).
      singulars
      1. PO
      1. USA_A
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload