The Kintera Spider tool is a simple desktop application built off the open source HTML TIDY standards.
The purpose of the application is intended for the migration of client’s web sites to Kintera content management system. The spider tool allows a start & end tag to be crawled for to assure that only content is being grabbed from the HTML.
I have owned the architecture sinse late 2005 and have made significant improvements to the application. Some of which include URL mapping, complete .NET 2.0 GUI, image path redirecting and live update.