Databases
StackOverflow2013
Postsdbo
POWhen is it beneficial to convert from float to double via decimal
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POWhen is it beneficial to convert from float to double via decimal
    primarykey
    data
    text
    <p>Our existing application reads some floating point numbers from a file. The numbers are written there by some other application (let's call it <em>Application B</em>). The format of this file was fixed long time ago (and we cannot change it). In this file all the floating point numbers are saved as floats in binary representation (4 bytes in the file). </p> <p>In our program as soon as we read the data we convert the floats to doubles and use doubles for all calculations because the calculations are quite extensive and we are concerned with the spread of rounding errors.</p> <p>We noticed that when we convert floats via decimal (see the code below) we are getting more precise results than when we convert directly. Note: Application B also uses doubles internally and only writes them into the file as floats. Let's say Application B had the number 0.012 written to file as float. If we convert it after reading to decimal and then to double we get exactly 0.012, if we convert it directly, we get 0.0120000001043081. </p> <p>This can be reproduced without reading from a file - with just an assignment: </p> <pre><code> float readFromFile = 0.012f; Console.WriteLine("Read from file: " + readFromFile); //prints 0.012 double forUse = readFromFile; Console.WriteLine("Converted to double directly: " + forUse); //prints 0.0120000001043081 double forUse1 = (double)Convert.ToDecimal(readFromFile); Console.WriteLine("Converted to double via decimal: " + forUse1); //prints 0.012 </code></pre> <p>Is it always beneficial to convert from float to double via decimal, and if not, under what conditions is it beneficial?</p> <p>EDIT: Application B can obtain the values which it saves in two ways:</p> <ol> <li>Value can be a result of calculations</li> <li>Value can be typed in by user as a decimal fraction (so in the example above the user had typed 0.012 into an edit box and it got converted to double, then saved to float)</li> </ol>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USfarfareast
    1. USfarfareast
    plurals
    1. PL
      singulars
      1. LTLinked
    2. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    3. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POWhen is it beneficial to convert from float to double via decimal
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POWhen is it beneficial to convert from float to double via decimal
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POWhen is it beneficial to convert from float to double via decimal
      1. This table or related slice is empty.
      1. VTUpMod
    1. COwhat happens when you don't convert at all and just write the float as is?
      singulars
      1. POWhen is it beneficial to convert from float to double via decimal
      1. USSam I am
    2. CO@SamIam: Upon *writing* them? Wouldn't change much. The problem comes with you do lots of math with them. Every operation adds a little bit of rounding error, til your numbers are too far from the real thing to be useful. (Some cases take longer than others to exhibit such behavior.) Just so it's clear, this happens with doubles too; it just takes a little bit longer for the errors to get big enough to throw off calculations. It's quite easy to notice with comparisons, though.
      singulars
      1. POWhen is it beneficial to convert from float to double via decimal
      1. UScHao
    3. COWhy not just work with `decimal`s?
      singulars
      1. POWhen is it beneficial to convert from float to double via decimal
      1. USBobson
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload