Max number of documents / performance



I have a large database that support 1,500+ concurrent users running an intense DB aplication. It currently supports scanning on documents(Using OCR) and images as LOB in the DB. These table are configured for their own filegroup so they can be on a different array then the relational data. There are over a million scanned documents and about 3,000 - 5,000 are added daily.

I now need to add the ability to perform fulltext searchs on these documents and perforamce is a major requirement. (most of the servers are high end 8 way 20-30 gigs of memory, fiber SANS, etc)

Some of my servers are running SQL2000, and a few new ones are running SQL2005. Now I am aware that SQL2005 allows for adding the new documents to the index without a complete index rebuild, but I must support both. One of my issues is that the servers are used almost 24x7.

My question is:
1) Should the documents and fultext index service be moved to their own server?
2) What is a realistic number of documents that can be indexed per server?
3) What are my performance options? Thrid party tools?
4) How can index the new documents on a SQL2000 server without doing a complete rebuild of the index?

Thank you,
Bill

.



Relevant Pages

  • Re: Linux on Capio II (Geode) ?
    ... >> doesn't support text modes natively. ... >> to see if the color or character memory has changed, ... case of 3.x servers, there are at /least/ three different forks of the ... modelines need to be overridden. ...
    (comp.arch.embedded)
  • Re: terminal servers, X-terminals in upgrade to Integrity
    ... I wonder if these will work if I upgrade to Integrity Servers? ... So there is a chance that the only thing that you need to do to use your Xyplex on an Integrity VMS system is to make sure that the LAT protocol is started. ... It may also allow TCP/IP to be used to manage it, once a TCPIP address is assigned. ... Current TCP/IP and DECW-Motif both support TCP/IP including font servers. ...
    (comp.os.vms)
  • Re: Intel ICH7 SMBus support, ichsmb(4)
    ... Supermicro not providing me some necessary details (such as how ... Some users requesting additional features too soon, such as: support ... me to spend my time getting ICHx SMBus support working under that, ... on actual production servers and are trusting my "play it safe" ...
    (freebsd-stable)
  • RE: Replication Topology Redesign
    ... Microsoft Global Technical Support Center ... | Subject: RE: Replication Topology Redesign ... | | design my Site Links. ... | | one of the core servers in that site link? ...
    (microsoft.public.win2000.active_directory)
  • Re: Opinions Wanted: Dell PowerEdge Servers ... ?
    ... They're not as good as in the past, but we have had hardware assistance on a FreeBSD-driven server on the condition of proving hardware fault using Dell's own bootable diagnostics. ... our support experience may be artificially "enhanced" compared to others because we buy off a large govt. ... our overall experience with Dell support has actually been as good or better than with many other vendors. ... One thing I do know is Dell's first tier support for servers is worthless, but as Greg says, you just need to establish that you know what you're doing, and you can bypass them. ...
    (freebsd-questions)