Article ID: 158071 - Last Review: June 12, 2007 - Revision: 2.5 Problems vith Statistical Functions and Large Numbers in ExcelThis article was previously published under Q158071 SYMPTOMS
In Microsoft Excel, when you use any of the following statistical
functions in a formula:
STDEV
The formula may return an incorrect result.
STDEVP LINEST LOGEST KURT NEGBINOMDIST BINOMDIST CAUSE
This behavior may occur when the formula refers to very large numbers
that, when summed, multiplied, or squared, exceed 15 digits in length.
MORE INFORMATION
Microsoft Excel supports a maximum of 15 significant digits at all times.
This limit applies to a value that is calculated by a formula. Because of
this limitation, if at any time a formula calculates a value that exceeds
15 digits in length, digits beyond the fifteenth significant digit are
changed to zeroes. This may cause the formula to return an incorrect
result.
For example, when you use the STDEV function to calculate the standard deviation of a set of numbers, part of the function sums the numbers and then squares the result. If this number exceeds 15 digits in length, digits beyond the fifteenth digit are changed to zeroes. This affects the final result delivered by the formula. To see an example of this behavior, enter the following data in a worksheet: A1: 999999 B1: 99999999 A2: 1000000 B2: 100000000 A3: 1000001 B3: 100000001 A4: =STDEV(A1:A3) B4: =STDEV(B1:B3) This behavior may occur when you use any of the statistical functions listed in this article and you work with very large values. This is true because these functions all use squared values, which makes it probable that the limit of 15 significant digits is exceeded. The exact formulas used by functions in Microsoft Excel are listed in the Help topic for each function in Microsoft Excel Help. REFERENCES
For additional information about the number of significant digits that Excel retains, click the following article number to view the article in the Microsoft Knowledge Base:
65903
(http://support.microsoft.com/kb/65903/
)
Number of significant digits MS Excel retains
APPLIES TO
| Article Translations
|
Back to the top
