Skip to content

Instantly share code, notes, and snippets.

View michaelcolenso's full-sized avatar

michael colenso michaelcolenso

View GitHub Profile
@michaelcolenso
michaelcolenso / grab-commons-images-sh
Created January 19, 2023 05:21 — forked from loleg/grab-commons-images-sh
Download images and metadata from a Wikimedia Commons category or results page
#!/bin/bash
#
# Download images from a Wikimedia Commons category
#
# Highest preview resolution and metadata in XML format will be saved in subfolders.
# Usage: execute this script on a Linux command line, providing the full URL to the category page.
#
# Shell tools required for this script: wget sed grep
#
@michaelcolenso
michaelcolenso / wget.sh
Created June 11, 2020 22:49 — forked from Dammmien/wget.sh
wget cheat sheet
# POST a JSON file and redirect output to stdout
wget -q -O - --header="Content-Type:application/json" --post-file=foo.json http://127.0.0.1
# Download a complete website
wget -m -r -linf -k -p -q -E -e robots=off http://127.0.0.1
# But it may be sufficient
wget -mpk http://127.0.0.1
# Download all images of a website
#PeriscopeProfileJson.sh
#Returns User Profile Json from Web Profile
#Version 1.0: Initial Release
#Version 1.1: Fixed quoting characters, optimize perl statements
#Version 1.2: Update parsing for changes in profile page
#replace myuser with the user you want to query
#line breaks added for readability
USR=myuser; curl -sq https://www.periscope.tv/$USR \
<!DOCTYPE html>
<meta charset="utf-8">
<head>
<style>
.node {
stroke: #000;
stroke-width: 1.5px;
}
.link {
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@michaelcolenso
michaelcolenso / gist:10fa8bd7fb0f453d2981
Created June 4, 2015 21:12
king county recent sales
This file has been truncated, but you can view the full file.
This file has been truncated, but you can view the full file.
@michaelcolenso
michaelcolenso / zclipped.json
Created June 1, 2015 06:59
seattle geoJSON
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@michaelcolenso
michaelcolenso / untitled
Created May 31, 2015 05:10
ogr2ogr seattle parcel data
ogr2ogr -f GeoJSON -t_srs EPSG:3857 seattlegeoparcels.json "./seattle_parcels.json" OGRGeoJSON