Commit 2bfca7e1 authored by Willi Rath's avatar Willi Rath
Browse files

Rewrite using local mirrors and templates

parent f41b1e77

.gitlab-ci.yml

+2 −2
Original line number Diff line number Diff line
@@ -5,5 +5,5 @@ test: 
    - env

    - source activate root

    - target_dir=${CONDA_PREFIX}

    - ./update_anaconda.sh ${target_dir}

 
    - shopt -s extglob

    - ./update_anaconda.sh ${target_dir} envs/!(monitoring_gallery).yml

README.md

+31 −30
Original line number Diff line number Diff line
@@ -9,7 +9,8 @@ Collection of conda environments and info on where and how to use them. 
**Recommended:** [File an issue here][issues] and describe what you need.



**Or:** [Fork this repository here][forks], add an evrionment, and create a

merge request.

merge request.  (Adding / editing the respective `_env_templates/*yml` and

running `python create_env_files.py` would be ideal.)



[issues]: https://git.geomar.de/python/conda_environments/issues

[forks]: https://git.geomar.de/python/conda_environments/forks
@@ -17,26 +18,11 @@ merge request. 
## See available environments



Have a look at

[env_files/](https://git.geomar.de/python/conda_environments/tree/master/env_files).

Currently, there are



- [`ffmpeg`](https://git.geomar.de/python/conda_environments/tree/master/env_files/ffmpeg.yml)

  : Provides nothing but `ffmpeg`.

- [`matlab_kernel`](https://git.geomar.de/python/conda_environments/tree/master/env_files/matlab_kernel.yml)

  : Provides Jupyter with a Matlab kernel.  See <https://git.geomar.de/python/nb_kernels/issues/4> for details.

- [`monitoring`](https://git.geomar.de/python/conda_environments/tree/master/env_files/monitoring.yml)

  : Provides an environment used by 

  [TM/Monitoring](https://git.geomar.de/TM/Monitoring).

- [`py2_std`](https://git.geomar.de/python/conda_environments/tree/master/env_files/py2_std.yml)

  : Provides a comprehensive (still growing) Python2 stack.

- [`py3_std`](https://git.geomar.de/python/conda_environments/tree/master/env_files/py3_std.yml)

  : Provides a comprehensive (still growing) Python3 stack.

- [`pyferret`](https://git.geomar.de/python/conda_environments/tree/master/env_files/pyferret.yml)

  : Provides nothing but `pyferret`.



There are also a few non-standard environments in

[opt_env_files/](https://git.geomar.de/python/conda_environments/tree/master/opt_env_files).

[envs/](https://git.geomar.de/python/conda_environments/tree/master/_envs/).



There, e.g., is an environment `py3_std` described in the file `py2_std.yml`.

As with this example, all other env names also match the file name before the

`.yml`.



## Using the environments
@@ -71,14 +57,17 @@ There is a setup script doing a full setup: 
Run it without arguments to get a help message.



To install all environments defined in

[env_files/](https://git.geomar.de/python/conda_environments/tree/master/env_files)

[envs/](https://git.geomar.de/python/conda_environments/tree/master/envs/)

to a path `<target_dir>`, run:

```bash

git clone git@git.geomar.de:python/conda_environments.git

cd conda_environments

./setup_anaconda.sh <target dir>

./setup_anaconda.sh <target dir> envs/*

```



> **Note** that you might not want to install all environments.  If you're

> unsure, use only `envs/py3_std.yml` (and maybe `py2_std.yml`).



Then, follow the steps above to activate the respective enviroment.



### Complete setup on MacOSX
@@ -89,14 +78,17 @@ There is a setup script doing a full setup: 
Run it without arguments to get a help message.



To install all environments defined in

[env_files/](https://git.geomar.de/python/conda_environments/tree/master/env_files)

[envs/](https://git.geomar.de/python/conda_environments/tree/master/envs/)

to a path `<target_dir>`, run:

```bash

git clone git@git.geomar.de:python/conda_environments.git

cd conda_environments

./setup_anaconda_MacOSX.sh <target dir>

./setup_anaconda_MacOSX.sh <target dir> envs/*

```



> **Note** that you might not want to install all environments.  If you're

> unsure, use only `envs/py3_std.yml` (and maybe `py2_std.yml`).



Then, follow the steps above to activate the respective enviroment.



### Adding an environment to an existing setup
@@ -108,7 +100,7 @@ source <path-to-miniconda-bin>/activate root 
```

and then use

```bash

conda env create -f env_files/<envname>.yml

conda env create -f envs/<envname>.yml

```



### Updating an environment
@@ -118,7 +110,7 @@ There is an update script: 


In principle, you can run:

```bash

conda env update -f env_files/<envname>.yml

conda env update -f envs/<envname>.yml

```

There may, however, be envs using `pip` to download source code directly.

These may fail to really update.
@@ -129,6 +121,15 @@ conda env remove -n <envname> 
```

and then

```bash

conda env create -f env_files/<envname>.yml

conda env create -f envs/<envname>.yml

```





## Advanced topics



### Install from an offline mirror



In `_envs_*`, there are env files matching those in the main directory which

point to local mirrors instead of the channels.  Use these if you're behind a

firewall.  (But note that on the machines where local mirrors are available,

there should be a working installation providing these envs anyway.)

_env_templates/atom_env.yml

0 → 100644
+19 −0
Original line number Diff line number Diff line 


name: atom_env

channels:

  - {anaconda}

  - {conda-forge}

dependencies:

  - python=3

  - anaconda-client

  - autopep8

  - flake8

  - flake8-docstrings

  - flake8-polyfill

  - pep8

  - pip

  - pycodestyle

  - pydocstyle

  - pyflakes

  - pylama

  - pytest

env_files/ffmpeg.yml→_env_templates/ffmpeg.yml

+2 −2
Original line number Diff line number Diff line 
# Python 3 standard environment

name: ffmpeg

channels:

  - conda-forge

  - {anaconda}

  - {conda-forge}

dependencies:

  - python=3

  - anaconda-client

env_files/matlab_kernel.yml→_env_templates/matlab_kernel.yml

+2 −1
Original line number Diff line number Diff line 
name: matlab_kernel

channels:

  - conda-forge

  - {anaconda}

  - {conda-forge}

dependencies:

  - python=3.4

  - jupyter