You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
|
|
|
|
# waternsw-grabber #
|
|
|
|
|
|
|
|
|
|
**waternsw_grabber** downloads bore records from the WaterNSW data portal.
|
|
|
|
|
https://realtimedata.waternsw.com.au
|
|
|
|
|
|
|
|
|
|
## Installation ##
|
|
|
|
|
|
|
|
|
|
1. Install `waternsw-grabber`
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
pip install git+http://git.wrl.unsw.edu.au:3000/danh/waternsw-grabber.git
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
2. Install `Firefox`
|
|
|
|
|
https://www.mozilla.org/en-GB/firefox/
|
|
|
|
|
|
|
|
|
|
3. Download the Mozilla `geckodriver`
|
|
|
|
|
https://github.com/mozilla/geckodriver/releases
|
|
|
|
|
|
|
|
|
|
4. Ensure `geckodriver` is in your system search path
|
|
|
|
|
(the easiest way is to keep the executable in your working directory)
|
|
|
|
|
|
|
|
|
|
## Usage ##
|
|
|
|
|
|
|
|
|
|
```python
|
|
|
|
|
from waternsw_grabber import telemetered_bore_downloader, extract_records
|
|
|
|
|
|
|
|
|
|
download_dir = 'downloads'
|
|
|
|
|
output_dir = 'csv'
|
|
|
|
|
start_date = '1900-01-01'
|
|
|
|
|
end_date = '2019-02-14'
|
|
|
|
|
bore_ids = [
|
|
|
|
|
'GW039102.1.1',
|
|
|
|
|
'GW039114.1.1',
|
|
|
|
|
'GW039117.1.1',
|
|
|
|
|
]
|
|
|
|
|
|
|
|
|
|
# Download bore records
|
|
|
|
|
telemetered_bore_downloader(bore_ids, start_date, end_date, download_dir)
|
|
|
|
|
|
|
|
|
|
# Extract zip archives
|
|
|
|
|
extract_records(download_dir, output_dir, clean_up=False)
|
|
|
|
|
```
|
