new StatisticTask(statisticResult, spark, e)).map(e => {CompletableFuture.supplyAsync(e, threadPool)})val tasksResult =。spark|spark 并发起作业CompletableFuture。" />
- 首页 > it技术 > >
spark|spark 并发起作业CompletableFuture
val result = tasksPrd
.map(e => SparkJdbcConfig(url,
e.split("\\.")(0),
e.split("\\.")(1),
predicates,
properties))
.map(e => new StatisticTask(statisticResult, spark, e))
.map(e => {
CompletableFuture.supplyAsync(e, threadPool)
})val tasksResult = CompletableFuture.allOf(result: _*)tasksResult.join
tasksResult.get
threadPool.shutdownNow()
推荐阅读