Matthew Radcliffe mradcliffe

💭

I may be slow to respond.

Full stack developer, Linux and PostgreSQL hobbyist.

mradcliffe / webcrawler.js

Last active August 29, 2015 13:56 — forked from amoilanen/webcrawler.js

	//PhantomJS http://phantomjs.org/ based web crawler Anton Ivanov anton.al.ivanov@gmail.com 2012

	var fs = require('fs');
	var system = require('system');
	var arg_url = system.args[1] \|\| '';
	var snapshot = system.args[2] \|\| '';

	fs.exists('sitemap.xml', function(exists) {
	if (exists) {
	fs.unlink('sitemap.xml');