Databases
StackOverflow2013
Postsdbo
POMultivar linear regression should be mathematically undetermined (Octave)
Body
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POMultivar linear regression should be mathematically undetermined (Octave)
    text
    copied!<p>I apologize in advance for the rather abstract nature of my question, but it is indirectly a question about programming algorithms, and I don't think I'll be the only programmer to wonder about this.</p> <p>This is about the implementation of the multi-variable ordinary least squares (OLS) regression algorithm in Octave (and, I assume, in MatLab as well). As far as I can tell, if one inputs two variables into a linear regression with just one single measurement, the result (i.e. the coefficients) should be mathematically undetermined: unless you accept black magic as a valid premise, how could one possibly tell in which way each of the variables affects the final result? In the more general case, the number of measurements must (I think) be at least equal to the number of variables for the resulting coefficients to make any sense (let alone statistical errors and all that).</p> <p>Octave, however, is all too happy to compute a result, with no warnings whatsoever:</p> <pre><code>octave:1&gt; ols([1], [1, 1]) ans = 0.50000 0.50000 </code></pre> <p>In other words -- if I got this right -- given the equation 1 = x + y, Octave joyfully concludes that x = y = 0.5.</p> <p>As such, assuming (as I am) that Octave has no direct connection to Satan, here are my questions:</p> <ol> <li>Am I misunderstanding the mathematical foundation? In other words, is this possibly a legitimate result?</li> <li>If I'm right, why isn't Octave spitting an error -- or, at the very least, quite a stern warning regarding the totally moronic data I'm asking it to analyze?</li> </ol>
 

Querying!

 
Guidance
An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload