Friday, October 31, 2008

Yah, spider

Ok, I've got my spider spidering around the internet, grabbing text, the title, and links from web pages. These get stored as database records which are searchable by my search engine. Right now I'm getting exceptions when the spider grabs too much text for the DB to handle(and I know how to fix this:truncation) and when the spider runs out of pages to look at(I know how to fix this--secret).

And if you want to taste something good...put canned salmon on a cracker that has havarti spread on it. This is heavenly.

No comments: