Databases
StackOverflow2013
Postsdbo
PO
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>The answer is to use Welford's algorithm, which is very clearly defined after the "naive methods" in:</p> <ul> <li>Wikipedia: <a href="http://en.wikipedia.org/wiki/Algorithms_for_calculating_variance" rel="noreferrer">Algorithms for calculating variance</a> </ul> <p>It's more numerically stable than either the two-pass or online simple sum of squares collectors suggested in other responses. The stability only really matters when you have lots of values that are close to each other as they lead to what is known as "<a href="http://www.cs.princeton.edu/introcs/lectures/9scientific.pdf" rel="noreferrer">catastrophic cancellation</a>" in the floating point literature.</p> <p>You might also want to brush up on the difference between dividing by the number of samples (N) and N-1 in the variance calculation (squared deviation). Dividing by N-1 leads to an unbiased estimate of variance from the sample, whereas dividing by N on average underestimates variance (because it doesn't take into account the variance between the sample mean and the true mean).</p> <p>I wrote two blog entries on the topic which go into more details, including how to delete previous values online:</p> <ul> <li><a href="http://lingpipe-blog.com/2009/03/19/computing-sample-mean-variance-online-one-pass/" rel="noreferrer">Computing Sample Mean and Variance Online in One Pass</a> <li><a href="http://lingpipe-blog.com/2009/07/07/welford-s-algorithm-delete-online-mean-variance-deviation/" rel="noreferrer">Deleting Values in Welford’s Algorithm for Online Mean and Variance</a> </ul> <p>You can also take a look at my Java implement; the javadoc, source, and unit tests are all online:</p> <ul> <li><a href="http://alias-i.com/lingpipe/docs/api/com/aliasi/stats/OnlineNormalEstimator.html" rel="noreferrer">Javadoc: <code>stats.OnlineNormalEstimator</code></a> <li><a href="http://alias-i.com/lingpipe/src/com/aliasi/stats/OnlineNormalEstimator.java" rel="noreferrer">Source: <code>stats.OnlineNormalEstimator.java</code></a> <li><a href="http://alias-i.com/lingpipe/src/com/aliasi/test/unit/stats/OnlineNormalEstimatorTest.java" rel="noreferrer">JUnit Source: <code>test.unit.stats.OnlineNormalEstimatorTest.java</code></a> <li><a href="http://alias-i.com/lingpipe" rel="noreferrer">LingPipe Home Page</a> </ul>
    singulars
    1. This table or related slice is empty.
    1. POHow to efficiently calculate a running standard deviation?
      singulars
      1. PTQuestion
    1. PTAnswer
    1. This table or related slice is empty.
    1. USBob Carpenter
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. POHow to efficiently calculate a running standard deviation?
      singulars
      1. PTQuestion
    1. This table or related slice is empty.
    1. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    1. CO+1, for taking care about deleting values from Welford's algorithm
      singulars
      1. PO
      1. USSvisstack
    2. CONice answer, +1 for reminding the reader of the difference between a population stddev and a sample stddev.
      singulars
      1. PO
      1. USAssad Ebrahim
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload