Miles are rounded in the database?
Jason,
I noticed that the calculated metrical data is different from my spreadsheet, so i checked it out.
I convert 654.3 kilometer into 406.65 miles and enter that in the database. When i edit the data it only shows 406 miles! Does this mean that al my miles are rounded down? This would have a negative impact on my total milage.
I noticed that the calculated metrical data is different from my spreadsheet, so i checked it out.
I convert 654.3 kilometer into 406.65 miles and enter that in the database. When i edit the data it only shows 406 miles! Does this mean that al my miles are rounded down? This would have a negative impact on my total milage.
Last edited by LarsBoelen; Sep 21, 2005 at 01:28 AM.
That is just one number after the decimal being displayed. The internal calcs use more precision. There is, however, rounding going on somewhere. The GH hybrid has my lifetime MPG close to 0.2 MPG higher than actual, based on my calculations -- even though I provide the same data of miles driven with 0.1 mile accuracy (that increases with miles driven), and gallons used with 0.xxx accuracy. In my specific case, the total miles driven now has an accuracy of 0.1 * 20,000; and each tank's gasoline is recorded at the pump to 3 significat digits, so overall accuracy should be three significant digits.
This has come up before, btw, when Jason was trying to get a handle of the DB's accuracy. I cannot remember details, but Jason found an error in the code that he fixed.
This has come up before, btw, when Jason was trying to get a handle of the DB's accuracy. I cannot remember details, but Jason found an error in the code that he fixed.
Right now, nothing should really be rounded until it's stored to 12 digits or so. There's a possibility that things aren't 100% exact because of conversions that have to be made, but I'm not sure what the issue would be in this case.
Thread
Topic Starter
Forum
Replies
Last Post
GatorJ
Ford Escape Hybrid
5
Jun 6, 2014 12:03 PM




