Tools

I've developed a few open source tools in the course of working on the projects on this site.

Web dev and front-end

• lightestbox: the simplest, lightest lightbox
• populateform: update an HTML form with data from a query string
• Replace text with font size: bookmarklet that replaces the text on a web page with the font size. Useful for debugging CSS.
• Taft: A static site generator

File and data munging

• git-ics: convert a git log into standard calendar format
• glob-concat: Merge file globs and lists of files
• sheetstack: Create a single CSV from several sheets of an XLS
• sqlite-json: Produce JSON from SQLite database queries
• yaml-cat: Join YAML front matter from many documents

Open data downloaders

Many of these projects are Makefiles that automate downloading open geodata and putting it into a database. Others are wrappers for open data APIs.

• avroll-download: Download NYC property assessment data
• acris-download: Download NYC property transfer data
• censusgeocode: API wrapper for the US Census geocoder
• get-pluto: Download current and recent NYC property geodata
• get-tiger: Download US Census Tiger/LINE geodata and join them to data from the Census API
• getfars: Download FARS (Fatality Analysis Reporting System) data and load it into a PostgreSQL database
• nycre: Download NYC real estate sales date
• nycboe-scrape: scrape preliminary election results from the NYC Board of Elections
• get-oa: Load OpenAddresses data into a PostgreSQL+PostGIS database
• rentregulated: Download the New York state database of rent-regulated buildings
• tidetable: Download NOAA tide tables

Map-adjacent

• fionautil: Helpers for the best Python GIS library
• fleetmonger: API wrapper for a sea-vessel-tracking website
• osm tiny maps: Example Makefile for generating small-multiple maps from OpenStreetMap data
• polyencoder: modern Python implementation of the Google Maps polyline encoding
• portolan: Convert angles to cardinal directions
• stateplane: Identify the local state plane projection for coordinates
• svgis: Draw SVG maps
• guessrs: Determine the spatial reference system based on known and desired coordinates.

Twitter-adjacent

• everylotbot: Create every lot-style Twitter bots
• tweetcal: Convert tweets to a calendar file
• twittergeo: Convert geotagged tweets to GeoJSON
• twitter markov: Create Markov chain ("_ebooks") twitter bots
• twitter bot utils: Utilities for making Twitter bots in Python

Conversion and such

• addfips: Add FIPS codes to lists of U.S. counties and states
• censusname: Generate random but likely names
• convertdate: Convert between calendar systems