dalphinloser/mlflow-docker-minio
1
0
Fork 0
mirror of https://github.com/Toumash/mlflow-docker synced 2025-11-04 07:09:22 +01:00
Code Issues Packages Projects Releases Wiki Activity

feat(bash): adds bash script generators

Browse Source
This commit is contained in:
Tomasz Dłuski
2020-08-24 16:38:20 +02:00
parent f523307f56
commit 8a2da7aba9
3 changed files with 28 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
README.md
View File

@@ -65,18 +65,12 @@ s3Client.make_bucket('mlflow')
5. Configure your client-side
For running mlflow files you AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables present on the client-side.
For running mlflow files you need various environment variables set on the client side. To generate them user the convienience script `./bashrc_install.sh`, which installs it on your system or `./bashrc_generate.sh`, which just displays the config to copy & paste.
Also, you will need to specify the address of your S3 server (minio) and mlflow tracking server. For that, run following script
> $ ./bashrc_install.sh
> [ OK ] Successfully installed environment variables into your .bashrc!
```shell
export AWS_ACCESS_KEY_ID=AKIAIOSFODNN7EXAMPLE
export AWS_SECRET_ACCESS_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
export MLFLOW_S3_ENDPOINT_URL=http://localhost:9000
export MLFLOW_TRACKING_URI=http://localhost:5000
```
or paste it into your .bashrc file and then run `source ~/.bashrc`
The script installs this variables: AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, MLFLOW_S3_ENDPOINT_URL, MLFLOW_TRACKING_URI. All of them are needed to use mlflow from the client-side.
6. Test the pipeline with below command with conda. If you dont have conda installed run with `--no-conda`

12
bashrc_generate.sh Normal file
View File

@@ -0,0 +1,12 @@
#!/bin/bash
source .env
echo "Copy and paste below configuration into your ~/.bashrc file!"
echo ""
echo "# MLFLOW CONFIG"
echo "export AWS_ACCESS_KEY_ID=$AWS_ACCESS_KEY_ID"
echo "export AWS_SECRET_ACCESS_KEY=$AWS_SECRET_ACCESS_KEY"
echo "export MLFLOW_S3_ENDPOINT_URL=$MLFLOW_S3_ENDPOINT_URL"
echo "export MLFLOW_TRACKING_URI=$MLFLOW_TRACKING_URI"
echo "# END MLFLOW CONFIG"

12
bashrc_install.sh Normal file
View File

@@ -0,0 +1,12 @@
#!/bin/bash
source .env
echo "# MLFLOW CONFIG" >> ~/.bashrc
echo "export AWS_ACCESS_KEY_ID=$AWS_ACCESS_KEY_ID" >> ~/.bashrc
echo "export AWS_SECRET_ACCESS_KEY=$AWS_SECRET_ACCESS_KEY" >> ~/.bashrc
echo "export MLFLOW_S3_ENDPOINT_URL=$MLFLOW_S3_ENDPOINT_URL" >> ~/.bashrc
echo "export MLFLOW_TRACKING_URI=$MLFLOW_TRACKING_URI" >> ~/.bashrc
echo "# END MLFLOW CONFIG" >> ~/.bashrc
echo "[ OK ] Successfully installed environment variables into your .bashrc!"