Re: Excel Multiplication

Tech-Archive recommends: Repair Windows Errors & Optimize Windows Performance

From: Ken Wright (ken.wright_at_NOSPAMntlworld.com)
Date: 02/28/04 

Date: Sat, 28 Feb 2004 14:44:42 -0000

As Ron said :-)

Take a close look at what the numbers in column E *really* are, as opposed to
the rounded number being displayed as a result of the formatting you have on the
data, and then compare that to the data you have typed into Column F. They are
not the same.

Example, D9 your formula appears to result in 22.960, and to 3 dps that is
correct, BUT, if you take a look at the value in E9 where you have copied and
pasted values, you will see in fact that that number is really 22.95998. You
have then manually entered 22.960 in column F, which is *not* the same, and
should therefore not be surprised that multiplying 2 different numbers by the
same factor results in different amounts. 

-- 
Regards
           Ken.......................    Microsoft MVP - Excel
                  Sys Spec - Win XP Pro /  XL 00/02/03
----------------------------------------------------------------------------
It's easier to beg forgiveness than ask permission :-)
----------------------------------------------------------------------------
"Gerald Kraft" <gerald.kraft@comcast.net> wrote in message
news:ha10c.424049$xy6.2452833@attbi_s02...
> I attach a portion of the worksheet demonstrating the errors.
>
> --
> Gerald Kraft <gkraft@gskgroup.com>
> "Ron Rosenfeld" <ronrosenfeld@nospam.org> wrote in message
> news:975140dn78s349a5cv90acobnhr02nackl@4ax.com...
> > On Sat, 28 Feb 2004 04:36:51 GMT, "Gerald Kraft"
> <gerald.kraft@comcast.net>
> > wrote:
> >
> > >I just checked a simple worksheet where a number from one column
> multiplies
> > >a number in a second column and the product is incorrect by a small
> amount.
> > >Some of the products are correct, but many of them are in error.  I don't
> > >know how I can rely on the program at this time. Any ideas would be
> welcome
> > >or a suggestion for another spreadsheet program that I could trust.  I am
> > >using Excel 2000 SP-3.
> >
> > Perhaps you could give some examples.  Other than small rounding errors in
> the
> > 15th decimal place (which will be present in any spreadsheet that conforms
> to
> > IEEE standards), significant multiplication errors have not been reported.
> >
> > Where the errors appear to be significant, the problem has usually been
> due to
> > a misunderstanding regarding rounding, display, and what's actually in the
> > cell.
> >
> >
> > --ron
>
>
>
---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.598 / Virus Database: 380 - Release Date: 28/02/2004

Relevant Pages

  • Re: Joins on number (double, fixed, 2) fields produce inconstant results
    ... probably that they are not exactly the same, i.e. there are rounding errors ... using a Currency field instead, and formatting to display as Fixed, 2 ... The Currency type is a fixed point number, so it does not have the ... Allen Browne - Microsoft MVP. ...
    (microsoft.public.access.queries)
  • Re: HELP--- adding duration of times
    ... If you are trying to display hours and minutes beyond 24 hours, ... will sum to 37:50. ... In multiplying by 24 you get 37.833333, which is the value in number of ... Format, Cell, Number, Time and select the most appropriate. ...
    (microsoft.public.excel.worksheet.functions)
  • Re: Scope attenuators 1,2,5, why bother?
    ... Multiplying in your head is easy with the numbers 1, ... 2.56 or 5.12 would tax my patience and make me question ... but the idea is also to read voltages from the digital display ... In such a case one could even use continuous variable gain to set ...
    (sci.electronics.design)
  • Re: Boolean expressions
    ... You may use a custom format to display 1/0 ... but in all other cases simply convert the boolean expression by ...
    (microsoft.public.excel.misc)
  • Multiplying two 16 bit integers
    ... I am a newbie to assembly, and am trying to multiply two 16 bit ... numbers (using 16 bit registers) and then display the output (which is ... algorithms pertaining to multiplying 16 bit registers, ...
    (comp.lang.asm.x86)