Category Archives: fracking

WARNING: ANSS Earthquake Catalog no longer has Oklahoma after 2017-02-28

I just noticed that Oklahoma quakes after 2017-02-28 are no longer present in the ANSS Earthquake Catalog.  I’ll have to find an alternative source of earthquake data, likely ComCat, from which to pull.

Khepry Quixote
2017-08-09

Advertisements

Update: FracFocusCSV data blending with chemical toxicities

The new FracFocusCSV files, found within FracFocus.org’s FracFocusCSV.zip archive, lend themselves to blending with chemical toxicities using the CASNumber column of each row.   I’ve modified the PyZip2Src2Tgt project, on the “toxicities” branch, to blend the appropriate chemical toxicity based upon the CASNumber of the row in question.  The data blending with chemical toxicities has not yet been checked for validity, so if you use the program, you’ll need to verify its results.

Khepry Quixote
2017-08-04

Initiative: FracFocusCSV data blending with chemical toxicities

The new FracFocusCSV files, found within FracFocus.org’s FracFocusCSV.zip archive, lend themselves to blending with chemical toxicities using the CASNumber column of each row with relative ease.  In the near future, I’ll be releasing the combined FracFocusCSV.tsv file with chemical toxicities blended within.  As I already possess the chemical toxicity data, it’ll come down to modifying the PyZip2Src2Tgt program to accommodate blending the FracFocusCSV chemical declaration data with the chemical toxicity data based upon the “CASNumber” key column.

Khepry Quixote
2017-07-28

Status Update 2017-07-27: FracFocusCSV 2017-07 Files Combined and Uploaded

Using the PyZip2Src2Tgt Python 3 program, the 12 FracFocus CSV files contained within FracFocus.org’s FracFocusCSV.zip archive were combined into one CSV file and then compressed into one tab-delimited value file (.tsv) file, to wit:

https://s3.amazonaws.com/frackinganalysis-s3-01/downloads/FracFocusCSV_Combined_201707.7z

Please note that this compressed archive does not contain any chemical toxicities at the present time.  I’ll push a new compressed archive with those in it as well at a date in the near future.

Presently, I’m working on an SQLite database with the new FracFocusCSV file as its source of fracking chemical disclosure information.  It, too, will be available for download in the near future.

Khepry Quixote
2017-07-27

FracFocusCSV_Combined_201707.7z file pushed to S3 bucket

Using the PyZip2Src2Tgt Python 3 program, the 12 FracFocus CSV files contained within the FracFocusCSV.zip archive were combined into one CSV file and then compressed into one tab-delimited value file, i.e. a TSV file, to wit:

https://s3.amazonaws.com/frackinganalysis-s3-01/downloads/FracFocusCSV_Combined_201707.7z

Please note that this compressed archive does not contain any chemical toxicities at the present time.  I’ll push a new compressed archive with those in it as well at a date in the near future.

Presently, I’m working on an SQLite database with the new FracFocusCSV file as its source of fracking chemical disclosure information.  It, too, will be available for download in the near future.

Khepry Quixote
2017-07-26

FracFocus.org’s New CSV Files: Tweaked program that combines multiple CSVs into one CSV

Tweaked the PyZip2Src2Tgt project to handle common character transformations, for example:

# character transformation tuples list used for
# transforming characters from one character to another
# as some analytical tools are unable to handle mixed
# characters, e.g. Unicode and ASCII, during importation

char_xform_tuples_list = []

char_xform_tuples_list.append((‘\r\n’, ‘ ‘)) # carriage-return, line-feed to single space
char_xform_tuples_list.append((‘\n’, ‘ ‘)) # line-feed to single space
char_xform_tuples_list.append((‘\t’, ‘ ‘)) # tab to single space
char_xform_tuples_list.append((u’\x91’, “‘”‘)) # diacritic left single quote to single quote
char_xform_tuples_list.append((u’\x92’, “‘” )) # diacritic right single quote to single quote
char_xform_tuples_list.append((u’\x93’, ‘”‘)) # diacritic left double quote to double quote
char_xform_tuples_list.append((u’\x94’, ‘”‘)) # diacritic right double quote to double quote
char_xform_tuples_list.append((u’\xa0’, ‘ ‘)) # non-breaking space to single space

# make sure this character transformation is always the last one added!
char_xform_tuples_list.append((‘ ‘, ‘ ‘)) # double-space to single space

FracFocus.org’s New CSV Files: Authored program to combine the various CSVs into one CSV

I have authored a Python 3.6 program that extracts the various CSV files from within FracFocus.org’s new CSV compressed archive and then combines them into one CSV file in the order, based on date-time, that they were generated by FracFocus.

The GitHub project for this can be found at: https://github.com/Frackalyzer/PyZip2Src2Tgt.

I will be pushing the resulting combined CSV file up to the FrackingData.org site shortly, but it’ll likely be tomorrow before that happens.

Khepry Quixote
2017-07-24