Data repo renderer ready for V1.0?
Hi @all,
I've written a renderer which turns a relatively simple™ YAML file into a full Git repository for external data. To go forward from here, revisions / opinions of v1.0rc are very welcome.
The idea of all this is to have a very similar structure of all the data repos which in the end allows for running a cron job (or similar) against all our data repositories.
To get a grip on what this all is about, have a look at the README.
Things to look for:
- Typos.
- Cases not covered. Currently, we can have arbitrary pre- and post-processing and, in an easily readable way, a way to
curl
files or crawl whole data directories withwget
. I've tried to make sure that all the cases currently in https://git.geomar.de/data are covered.
Cheers! Willi
Edited by Willi Rath