Re: This one's a challenge: 1.9 not equaling 1.9..... What's going on???
- From: "Conan Kelly" <CTBarbarin@xxxxxxx>
- Date: Wed, 28 Jun 2006 20:22:39 GMT
Pat,
Yeah, that is my guess too. I come across this problem in Excel all the time. When I have my number formats set to 2 decimal
places, sometimes I will get a negative zero! (HUH?!?! WTF?!?! HOW CAN YOU HAVE A -0.00) Well when you run the decimal places out
to 5,6, or 7 places, then the problem is apparent. In your case, 1.9 does not eaqual 1.900004558.
Using your formula, in Excel-ese I would write "=If(ROUND([System_Case_Height],2)-ROUND([Audit_Case_Height],2)=0),"Yes","No")".
I don't know for sure if the ROUND() function is available in Access (you would think it would be--the syntax may be
different--there probably is another function that should be able to accomplish the same thing).
I hope this helps,
Conan Kelly
<pwizzle@xxxxxxxxx> wrote in message news:1151523209.879323.268820@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
Hi all,
I've got a real challenge this time with an access database that I'm
writing. I'm at my witts end trying to figure out a feasible solution,
but to no avail. I'm writing this database for work, and failing to
come up with a fix for this problem is going to be a major problem.
Long story short:
1) I work for a grocery store, and I have imported a listing of about
12,000 items that we sell into this database. This list includes
dimensional data about every product (height, width, and depth)
2) We have several people out in our stores measuring product in an
effort to audit this data. They input their measurements into a form
that I put together and the form dumps the audit measurements into
separate columns in the same table via a recordset.
3) I have conditional formatting set up that compares the data in the
table to the data they enter into the text boxes. This conditional
formatting works fine and correctly identifies when the two numbers do
not equal by coloring the text box red.
My problem is that I have a query put together that spits out all of
the data in the table. For example, column #1 in the query is titled
"System Case Height" and column #2 is titled "Audited Case Height".
Column #3 is set up to spit out "Yes" or "No" depending on if these
numbers are equal or not.
Here is the code for column 3:
CaseHeight_In_Tollerance?:
IIf([System_Case_Height]-[Audit_Case_Height]=0),"Yes","No")
Most of the time, Yes and no are returned correctly. However once every
few records, the query returns "No" when the numbers are the same.
Looking directly at the query, 1.9 is in column #1 and 1.9 is in column
#2, yet the query still returns "No".
In the table, both columns are set to type "Number" and Decimal places
to "Auto".
The key here (I presume) has something to do with the precision of the
numbers. I'm betting that access is somehow storing an extra decimal
place or something that I cannot see... however I am stumped as to how
to test for this.
This question is very long and very detailed, and I will understand if
I get no responses, but I'm keeping my fingers crossed that maybe
someone knows a way of going about testing this problem out that I
haven't thought of... I will be eternally grateful for any help that
you guys can provide.
--Pat
.
- References:
- Prev by Date: Re: Row Total for each month? Crosstab Query
- Next by Date: Re: This one's a challenge: 1.9 not equaling 1.9..... What's going on???
- Previous by thread: This one's a challenge: 1.9 not equaling 1.9..... What's going on???
- Next by thread: Re: This one's a challenge: 1.9 not equaling 1.9..... What's going on???
- Index(es):
Relevant Pages
|