danh
/
waternsw-grabber
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
Download bore records from the WaterNSW data portal.
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
52 Commits
1 Branch
0 Tags
1.1 MiB
Python 100%
 
master
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '9ad2fdea33'
${ noResults }
Go to file
Dan Howe 9ad2fdea33 Skip empty dataframes when processing multiple basins 6 years ago
doc Add doc folder 6 years ago
waternsw_grabber Skip empty dataframes when processing multiple basins 6 years ago
README.md Update installation instructions 6 years ago
setup.py Install data files with package 6 years ago

README.md

waternsw-grabber

waternsw_grabber downloads bore records from the WaterNSW data portal.
https://realtimedata.waternsw.com.au

Installation

  1. Install waternsw-grabber
pip install git+http://git.wrl.unsw.edu.au:3000/danh/waternsw-grabber.git

  1. Install Firefox
    https://www.mozilla.org/en-GB/firefox/

  2. Download the Mozilla geckodriver
    https://github.com/mozilla/geckodriver/releases

  3. Ensure geckodriver is in your system search path
    (the easiest way is to keep the executable in your working directory)

Usage

from waternsw_grabber import telemetered_bore_downloader, extract_records

download_dir = 'downloads'
output_dir = 'csv'
start_date = '1900-01-01'
end_date = '2019-02-14'
bore_ids = [
    'GW039102.1.1',
    'GW039114.1.1',
    'GW039117.1.1',
]

# Download bore records
telemetered_bore_downloader(bore_ids, start_date, end_date, download_dir)

# Extract zip archives
extract_records(download_dir, output_dir, clean_up=False)