Fastone-集群数据集管理+导入导出+aksk
1集群数据集管理 1.1新增数据集
POST/api/v1/linkedDatasetsrequestBody:
{
"name": "test"
}responseBody:
{
"id": 1,
"name": "test",
"type": "S3",
"region": "north-west"
"prefix": "test"
}
1.2绑定数据集
POST/api/v1/linkedDatasetsrequestBody:
{
"name": "my-dataset",
"prefix": "folder2"
}responseBody:
{
"id": 2,
"name": "my-dataset",
"type": "S3",
"region": "north-west",
"prefix": "folder2"
}
1.3查看指定数据集
GET/api/v1/linkedDatasets/{id}responseBody:
{
"id": 1,
"name": "test",
"type": "S3",
"region": "north-west",
"prefix": "test"
}
1.4查看当前用户下的所有数据集
GET/api/v1/linkedDatasetsresponse:
[
{
"id": 1,
"type": "S3",
"region": "north-west",
"name": "test",
"prefix": "test"
},
{
"id": 2,
"type": "S3",
"region": "north-west",
"name": "my-dataset",
"prefix": "folder2"
}
]
1.5删除数据集
DELETE /api/v1/linkedDatasets/{id}
2.aksk
GET/api/v1/users/{id}/akskresponse:
{
"accessKey": "accessKey",
"secretKey": "secretKey",
"region": "north-west",
"provider": "AWS"
}
3.数据集导入导出 3.1 导入或导出
POST/api/v1/linkedDatasets/{id}/transactionrequest:
{
"transactionType": "IMPORT | EXPORT",
"clusterPath": "/home",
"clusterId": 2
}
3.2 导入导出状态
GET/api/v1/linkedDatasets/{id}/transaction/status?clusterId=1&transactionType=IMPORT|EXPORT
{
"state": "NONE | PROCESSING | COMPLETE | FAILED"
"msg": "This is detail msg about dataset transaction"
}
推荐阅读
- Docker应用:容器间通信与Mariadb数据库主从复制
- 使用协程爬取网页，计算网页数据大小
- Java|Java基础——数组
- Python数据分析(一)（Matplotlib使用）
- Jsr303做前端数据校验
- Spark|Spark 数据倾斜及其解决方案
- 数据库设计与优化
- 爬虫数据处理HTML转义字符
- 数据库总结语句
- federation--kubernetes集群联邦的实现