SDS

B2命令行工具

B2提供免费的10G存储空间, 而且不需要预先设置支付信息例如信用卡认证等。 而且文件上传下载快速 安装 pip install --upgrade b2 配置 b2 authorize-account [<applicationKeyId>] [<applicationKey>] 上传 b2 upload-file cmp000 "Commander 8.1.0 Installer (x64).zip" cmp_commander_810_x86.zip Commander 8.1.0 Installer (x64).zip: 100%|███████████████████████████| 835M/835M [06:14<00:00, 2.23MB/s] URL by file name: https://f000.backblazeb2.com/file/cmp000/cmp_commander_810_x86.zip URL by fileId: https://f000.backblazeb2.com/b2api/v2/b2_download_file_by_id?fileId=4_z5fb65c33d39d419a79180f12_f20359e5b85eeada6_d20200405_m102029_c000_v0001066_t0051 { "action": "upload", "fileId": "4_z5fb65c33d39d419a79180f12_f20359e5b85eeada6_d20200405_m102029_c000_v0001066_t0051", "fileName": "cmp_commander_810_x86.zip", "size": 835119744, "uploadTimestamp": 1586082029000 }

Minio配置为B2存储网关

配置 下载B2 TLS安全证书 openssl s_client -showcerts -connect api.backblazeb2.com:443 > b2.crt mv b2.crt .minio/certs/CAs/ set MINIO_ACCESS_KEY=B2_keyID set MINIO_SECRET_KEY=B2_applicationKey minio gateway b2

AI分布式大模型

Minio Client

安装mc https://dl.min.io/client/mc/release/windows-amd64/mc.exe mc config host add b2 http://192.168.1.3:9000 B2_keyID B2_applicationKey 本地文件同步到b2 mc cp -r . b2/wubigo/ 安装S3CMD https://github.com/s3tools/s3cmd/releases/download/v2.0.2/s3cmd-2.0.2.tar.gz sudo python setup.py install ~/.s3cfg # Setup endpoint host_base = http://192.168.1.3:9000 host_bucket = http://192.168.1.3:9000 bucket_location = us-east-1 use_https = True # Setup access keys access_key = Q3AM3UQ867SPQQA43P2F secret_key = zuf+tfteSlswRu7BJ86wekitnifILbZam1KYY3TG # Enable S3 v4 signature APIs signature_v2 = False 同步本地文件到B2 s3cmd sync . s3://wubigo/ 总结 在不进行任何优化的情况下,s3cmd比mc传输速度快好几倍

Minio源代码安装

安装两种方式 从最新源代码发布版安装 git设置代理 [user] email = [email protected] name = bigo [http] proxy = http://127.0.0.1:49210 sslverify = false 系统代理 set HTTP_PROXY=http://127.0.0.1:49210/ set HTTPS_PROXY=http://127.0.0.1:49210/ 安装 go get github.com/minio/minio MAKE mkdir -p $GOPATH/src/github.com/minio cd $GOPATH/src/github.com/minio git clone https://github.com/minio/minio.git cd minio/ git checkout RELEASE.2020-01-03T19-12-21Z make -n test go install -v mkdir -p /home/bigo/go/bin which golint 1>/dev/null || (echo "Installing golint" && GO111MODULE=off go get -u golang.org/x/lint/golint) which staticcheck 1>/dev/null || (echo "Installing staticcheck" && wget --quiet https://github.

创业公司IT云服务系列之数据存储

邮枪Concept plan(免费用户并增加一张信用卡)额度介绍 每月免费发送1万封邮件,超过1万封的邮件开始收费,$0.5//1000封 接收邮件免费 支持一千个定制域名 可以向任何邮箱地址发送而不用授权 创建发送账号 接收邮件