7 Commits
1.0 ... #6

Author SHA1 Message Date
Tomasz Dłuski
fcd3393fa5 use fixed minio stable version (minio team separated console and api in the july feature release)
https://github.com/minio/minio/releases/tag/RELEASE.2021-07-08T01-15-01Z
2021-07-19 12:04:05 +02:00
Tomasz Dłuski
14df7c707e Merge pull request #3 from kingkastle/kingkastle-minio-methodname
minio method name is now: InvalidResponseError
2021-03-05 18:37:27 +01:00
Rafael Castillo
7506d3e43d minio method name is now: InvalidResponseError 2020-12-21 16:33:53 +01:00
Tomasz Dłuski
8f3d6ba7e2 Update README.md 2020-09-06 22:08:23 +02:00
Tomasz Dłuski
81e373d6fb Update run_create_bucket.sh 2020-09-05 16:14:53 +02:00
Tomasz Dłuski
eebc9d0c46 bugfix: adds bucket name configuration into the .env file 2020-09-05 13:58:45 +02:00
Tomasz Dłuski
bddbec77f1 adds minio autoconfigure script 2020-09-05 13:54:40 +02:00
4 changed files with 55 additions and 2 deletions

View File

@@ -4,6 +4,8 @@ If you want to boot up mlflow project with one-liner - this repo is for you.
The only requirement is docker installed on your system and we are going to use Bash on linux/windows.
[![Youtube tutorial](https://img.youtube.com/vi/ma5lA19IJRA/0.jpg)](https://www.youtube.com/watch?v=ma5lA19IJRA)
# Features
- Setup by one file (.env)
- Production-ready docker volumes
@@ -24,7 +26,14 @@ Creating tracker_mlflow ... done
Creating aws-s3 ... done
```
3. Create mlflow bucket. You can do it **either using AWS CLI or Python Api**. **You dont need an AWS subscription**
3. Create mlflow bucket. You can use my bundled script.
Just run
```shell
bash ./run_create_bucket.sh
```
You can also do it **either using AWS CLI or Python Api**.
<details><summary>AWS CLI</summary>
1. [Install AWS cli](https://aws.amazon.com/cli/) **Yes, i know that you dont have an Amazon Web Services Subscription - dont worry! It wont be needed!**

38
create_bucket.py Normal file
View File

@@ -0,0 +1,38 @@
import os
from minio import Minio
from minio.error import InvalidResponseError
accessID = os.environ.get('AWS_ACCESS_KEY_ID')
accessSecret = os.environ.get('AWS_SECRET_ACCESS_KEY')
minioUrl = os.environ.get('MLFLOW_S3_ENDPOINT_URL')
bucketName = os.environ.get('AWS_BUCKET_NAME')
if accessID == None:
print('[!] AWS_ACCESS_KEY_ID environemnt variable is empty! run \'source .env\' to load it from the .env file')
exit(1)
if accessSecret == None:
print('[!] AWS_SECRET_ACCESS_KEY environemnt variable is empty! run \'source .env\' to load it from the .env file')
exit(1)
if minioUrl == None:
print('[!] MLFLOW_S3_ENDPOINT_URL environemnt variable is empty! run \'source .env\' to load it from the .env file')
exit(1)
if bucketName == None:
print('[!] AWS_BUCKET_NAME environemnt variable is empty! run \'source .env\' to load it from the .env file')
exit(1)
minioUrlHostWithPort = minioUrl.split('//')[1]
print('[*] minio url: ',minioUrlHostWithPort)
s3Client = Minio(
minioUrlHostWithPort,
access_key=accessID,
secret_key=accessSecret,
secure=False
)
s3Client.make_bucket(bucketName)

View File

@@ -1,7 +1,7 @@
version: '3.2'
services:
s3:
image: minio/minio:latest
image: minio/minio:RELEASE.2021-06-14T01-29-23Z
container_name: aws-s3
ports:
- 9000:9000

6
run_create_bucket.sh Normal file
View File

@@ -0,0 +1,6 @@
#!/bin/bash
set -o allexport; source .env; set +o allexport
pip3 install Minio
python3 ./create_bucket.py