Re: vlookup problem, possibly due to "noise"

From: "vezerid" <vezerid@xxxxxxx>
Date: 15 Nov 2005 11:21:28 -0800

JPANDRE,
Excel has a precision limit of 15 digits. I wonder what numbers you
have in your lookup table that, after displaying 20+ decimal digits,
you still do not see any difference. Are they all from 0 to 1? Then
this would explain what you say. I have seen "noise" be produced by
rounding functions: you thought you had 2.01 and in reality it was
2.010000000000046.

Are the values in your table array expected to be in the key column of
the lookup table? Are they derived through a rounding function? Are you
using the "exact" version of vlookup? (i.e. VLOOKUP( , , , FALSE). If
not are the numbers in the key column of the lookup table ordered
ascending?

HTH
Kostis Vezerides

.

Follow-Ups:
- Re: vlookup problem, possibly due to "noise"
  - From: JPANDRE

Prev by Date: Value in cell refers to value in another cell
Next by Date: Re: Averaging a Value Between Two Serial Dates
Previous by thread: Value in cell refers to value in another cell
Next by thread: Re: vlookup problem, possibly due to "noise"
Index(es):
- Date
- Thread

Relevant Pages

Re: Hex to ascii
... converts a full 32-bit unsigned integer to 10 decimal digits in less ... time than the cpu needs for a single DIV opcode! ... Lookup tables are indeed good here, in fact they should be the obvious ... straight inline SIMD code tends to beat lookup tables due to the load ...
(comp.lang.asm.x86)
Re: Hex to ascii
... converts a full 32-bit unsigned integer to 10 decimal digits in less ... time than the cpu needs for a single DIV opcode! ... Lookup tables are indeed good here, in fact they should be the obvious choice. ...
(comp.lang.asm.x86)
Re: VLOOKUP - Need Reverse?
... A common approach to return data from any position in relation to the lookup ... Your key column is right in the middle, ... This version on Index and Match is almost exactly the same as Vlookup, ... spreadsheet with the Primary Lookup reference key in the ...
(microsoft.public.excel.worksheet.functions)
Re: Help needed with cell category, ie Number/Text etc
... Format the lookup table key column and the data entries to General. ... (remove nothere from the email address if mailing direct) ... >>> HTH ...
(microsoft.public.excel.misc)
Re: link excel database?
... =vlookuprelies on that key column being the first column of the lookup ... If you ever want to bring back something to the left of that key column, ... I have tried to search for v lookup but it does not explain how i set it up ... "DDLawrie" wrote: ...
(microsoft.public.excel.misc)