The Initiatives page, visible in the menu, will list and track the progress of upcoming initiatives concerning this site. Presently, there are three main initiatives: 1) render GUID keys to INT keys thereby reducing the upload/download size of files; 2) finalize the BAT or Python 3.4 scripts to download, extract, and transform the FracFocusRegistry ZIP file automatically into CSV, SQLITE, and PostgreSQL files; 3) Automate the push of the INT key CSV files to open-data Google Fusion tables so that analysts can access the data via Tableau, R, or SAS.
Monthly Archives: January 2016
Status Update 2016-01-27: FrackingData_FracFocusRegistry 2015-12 Files Uploaded
As of 27 January 2016, various files (e.g. SQlite, CSV, and PgSQL) derived from FracFocus.org’s December 2015 FracFocusRegistry download have been uploaded to frackingdata.info/downloads site and their respective links posted to FrackingData’s FracFocus Data Page .
Once again, of significance this time was that the download from the FracFocus Data Download website and subsequent extract, transform, load, and exporting to CSV, SQLite, and PostgreSQL files was performed by a Windows batch script without human intervention. This automated method shaved hours from the extract, transform, load, and export process.
When this Windows batch file is sufficiently stable, I’ll post a link to it in the Source Code section of this blog.
Khepry Quixote 2016-01-27
Fracking Data 