S360消除SPN机密行动的一部分,要求我们移到SPN+证书/MSI/用户分配托管身份
使用自定义主动目录令牌而非客户端通过数据布列克密钥连接PEM证书用ava代码生成自定义AD令牌我们试图通过OASTH2法设置小火花配置
sca
/搭建Spark配置ADLSGen2访问
spark.conf.set("fs.azure.account.auth.type.
.dfs.core.windows.net", "OAuth")
spark.conf.set("fs.azure.account.oauth.provider.type.
.dfs.core.windows.net", "org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider")
spark.conf.set("fs.azure.account.oauth2.client.id.
.dfs.core.windows.net", "clientid")
spark.conf.set("fs.azure.account.oauth2.client.secret.
.dfs.core.windows.net,
spark.conf.set("fs.azure.account.oauth2.client.endpoint.
.dfs.core.windows.net",
https://login.microsoftonline.com/
/oauth2/v2.0/token
)
spark.conf.set("fs.azure.account.oauth2.access.token.provider", access_token)
连接ADLS Gen2存储和存取文件
