Spider - PHP Website Crawler

Last Update

30 August 2013

Regular License

$14

Extended License

$70

This PHP script allows you to search for files in ANY website. All you have to do is specify what website you want to search, the kind of files you are looking for then click Crawl to watch spider handle the rest. It comes packed with more than 150 file types pre-installed and multiple ways to view results, Spider is the tool at heart for people building crawlers and web scrappers.

Features

Over 150 file tpyes included Accepts custom file types Crawler Depth Managemment Preview and export HTML Saves results on server Crawling Time Limits Exports to SQL File Bootstrap 3.0 Ready Responsive Design Excel CSV Ready Eports to JSON Much more…

Updates 29/08/2013 v1.0 – Updated Documentaion. Improved code comments. Fixed php errors and warnings.30/08/2013 v1.0 – Updated to support PHP 5.3.