You can maintain your own local copy of SILO datasets using the methods described below.
If you wish to mirror SILO datasets, please read the usage information about data mirroring on our Frequently asked questions page.
To mirror SILO's patched point datasets (point datasets at station locations):
Contact SILO to obtain access
SILO provides daily incremental updates which enable an exact copy of the patched datasets to be reconstructed. The system consists of:
The various datasets are stored on the LongPaddock FTP server. Please contact us to arrange access.
Download the SILO software
The patched datasets can be reconstructed from the incremental updates in any way the user chooses. For example, you may wish to reconstruct datasets containing only maximum temperature for stations in Victoria and discard all other stations and variables.
SILO provides a software package which demonstrates one method for reconstructing the patched datasets. The package contains instructions on how to install and operate the software. Please note SILO provides this software in good faith and is not responsible for its use or misuse.
To mirror SILO's gridded datasets you can either:
Use the Amazon Web Services Command Line Interface (CLI):
synccommand to mirror the data.
aws s3 sync s3://silo-open-data/annual/monthly_rain target --exact-timestamps
synccommand it will download the entire dataset
synccommand every time you wish to update your local copy (
syncwill only download files that have changed)
syncwill not download files which have been updated but still have the same file size.
Manually download new and/or updated rasters:
Download the entire set of rasters for the variable(s) that you wish to mirror.
A list of files available for download can be obtained via URL:gridded data page. For example, the monthly rainfall rasters for 1989 can be downloaded using curl as follows:
Note: this step only needs to be done once.
Each time you wish to update your local copy:
Use the file listing:
Please note SILO data are constantly evolving so you will need to determine how often you wish to update your local copy of the data. SILO data typically change due to:
You may also wish to consider your network bandwidth and transfer costs when determining how often you update your local copy. The rasters are packed into annual files, each being around 410 MB in size for daily variables and around 14 MB for monthly rainfall.