Is it possible to use windows file system as a database system?

Is it possible to use windows file system as a database system?

I am working on an image crawler now.
One the most challenging problems I am facing is to judge whether a
certain URL has already been crawled.
I cannot keep all the visited URL strings in memory, and currently I
am using MySQL to manage them.
But as the number of URL increases, access to the db become slow.
Very likely I am not getting the most out of MySQL.
Does anyone know how to tune it?

An alternative method I have thought of is to use the file system as a
database system.
After crawling URL _current_url, I create a file _current_url.txt and
write some information in it.
So when _new_url comes, I only need to check the existence of file
_new_url.txt to decide whether it is already visited.
Is this method sound enough?
How does the system decide whether a file exist?

Any help will be appreciated.
Thanks in advance.

.

Relevant Pages

  • Is it possible to use windows file system as a database system?
    ... Is it possible to use windows file system as a database system? ... I am working on an image crawler now. ... An alternative method I have thought of is to use the file system as a ...
    (microsoft.public.windows.server.general)
  • Re: Filesystem with Sharepoint
    ... In addition the likelihood is that if anyone ever writes code to use this API it will be to extend storage possibilities to a different *database system* not to the file system ... external storage API. ... I have a question regarding sharepoint and file systems. ...
    (microsoft.public.sharepoint.portalserver)
Loading