|| Have you got any statistics about disk usage per thousand of web sites indexed.
|| Below is an average figure taken from live directories/search-engines. This is a ballpark figure and it might vary according to the length of your link listings.
The disk space taken up is about 700k per thousand links. If you use Mysql it should be about 1 MB per thousand links.
The .cgi scripts with their data files can take up to 10MB without calculating in link listings.