spider crawler
Spider - PHP Website Crawler
This PHP script allows you to search for files in ANY website. All you have to do is specify what website you want to search, the kind of files you are looking for then click Crawl to watch spider handle the rest. It comes packed with more than 150 file types pre-installed and multiple ways to view results, Spider is the tool at heart for people building crawlers and web scrappers. Features Over 150 file tpyes included Accepts custom file t...