windows下载Google Cloud Platform上的数据

Posted on

以google的HDR+数据集为例：
https://www.hdrplusdata.org/dataset.html

1. 科学上网

https://www.4spaces.org/digitalocean-shadowsocks/
https://github.com/shadowsocks/shadowsocks-gui

2.下载Google Cloud SDK

https://cloud.google.com/sdk/docs/quickstart-windows

2.1 下载安装程序，安装过程中需要关掉ss
2.2 装完了会弹出一个命令行，开始init gcloud, 在输入y之前，打开ss。

1
To continue, you must log in. Would you like to log in (Y/n)? Y

然后就会弹出网站，根据提示登录您的 Google 用户帐号，然后点击允许以授权访问 Google Cloud Platform 资源。
然后选择一个 Cloud Platform 项目

1
2
3
4
5
Pick cloud project to use:
 [1] [my-project-1]
 [2] [my-project-2]
 ...
 Please enter your numeric choice:

成功完成设置步骤后显示：

1
2
3
4
gcloud has now been configured!
You can use [gcloud config] to change more gcloud settings.

Your active configuration is: [default]

3. 配置代理

https://cloud.google.com/sdk/docs/proxy-settings

1
2
3
gcloud config set proxy/type socks5
gcloud config set proxy/address 127.0.0.1
gcloud config set proxy/port 1080

4 下载

cmd中输入

1
gsutil -m cp -r gs://hdrplusdata/20171106_subset .

会把数据下在当前目录下