AdWords-like Implementation with Index Server



We're implementing a "Google Adwords"-like service for an affiliate
program for one of our ASP.NET sites. (Google Adwords is the
advertising program where affiliates place iFrames on their site and
pass keywords to Google via the SRC attribute of the iFrame. Google
then uses those keywords to generate applicable results for the
contents of the iFrame.)

Our catalog will contain between 7,000 and 15,000 files that each
corrispond to a piece of content we offer. With the results we get back
from Index Server we can piece together the URLs/content for the
iFrame.

>>From my preliminary performance testing, it appears that we can
probably do around 750 RPS on each of our dual Zeon (3.2 Ghz) / 1.5 GB
of RAM Win2k3 web servers. This, however, pegs the CPU. So,
realistically, we're looking at more like 350 to 450 RPS.

This isn't horrible, but I was hoping for more. The first thought I had
was to implement an output caching solution, but because we don't
control the input of keywords we would be creating a scenario where we
might be caching far too many combinations of keywords and essentially
opening ourselves up to a DoS attack. (Somebody could easily craft a
script that submitted millions of random keywords to our application,
thereby quickly filling up the memory cache.)

Does anybody have any suggestions for improving performance of a Index
Server based searching scenario like ours?

.



Relevant Pages

  • Google Adwords-like app with ASP.NET / Index Server
    ... We're implementing a "Google Adwords"-like service for an affiliate ... pass keywords to Google via the SRC attribute of the iFrame. ... Server, along with a simple ExecuteReader command. ...
    (microsoft.public.dotnet.framework.aspnet)
  • Re: Check keyword density for URL with https
    ... > with low keyword density beating out a site, in the rankings, that has ... > their site ranking better thataway. ... I had top positions at Google about 1-2 years ago. ... > those keywords when all they are doing is putting up essentially blank ...
    (alt.internet.search-engines)
  • Re: SEO technology for Copyright Patrol?
    ... I submit my top 250 keywords to your web interface. ... which it does not go to google, ... infringement, and are logged at your web-based interface so i can view them. ... Such a tool would need to hammer a search engine quite heavily. ...
    (alt.internet.search-engines)
  • Re: SEO technology for Copyright Patrol?
    ... I submit my top 250 keywords to your web interface. ... which it does not go to google, ... The bot obtains, from a cache, three copies of a customizable ... Such a tool would need to hammer a search engine quite heavily. ...
    (alt.internet.search-engines)
  • Re: Simple question about singular and plural keywords
    ... my list of keywords will be a compilation of all. ... Also, I already consider Overture inaccurate, especially since they use ... Google user. ... I am a Perl programmer, but, for example ...
    (alt.internet.search-engines)

Quantcast