问题

Azure数据湖存储Gen2Azure布局文件系统路径访问databricks集群时命令挂起

启动调试日志并可以看到驱动日志中的下列栈迹

Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: https://login.microsoftonline.com/b9b831a9-6c10-40bf-86f3-489ed83c81e8/oauth2/token    at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1894)    at sun.net.www.protocol.http.HttpURLConnection.access$200(HttpURLConnection.java:91)    at sun.net.www.protocol.http.HttpURLConnection$9.run(HttpURLConnection.java:1484)    at sun.net.www.protocol.http.HttpURLConnection$9.run(HttpURLConnection.java:1482)    at java.security.AccessController.doPrivileged(Native Method)    at java.security.AccessController.doPrivilegedWithCombiner(AccessController.java:782)    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1481)    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)    at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:347)    at shaded.databricks.v20180920_b33d810.org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.getTokenSingleCall(AzureADAuthenticator.java:254)    ...31多

因果

ifABFS配置集群错误属性值fs.azure.account.oauth2.client.id或尝试访问表单清晰路径abfss://myContainer@myStorageAccount.dfs.core.windows.net/...去哪儿myStorageAccount不存在,则ABFS驱动程序归回路并变无响应命令最终失效, 但由于它重试如此多次, 似乎是一个挂起命令 。

尝试存取错误路径并存存账号时,会看到404报错消息系统不挂置此例

求解

访问ABFS数据时必须验证所有证书的精度验证ABFS路径如果其中之一不正确,问题会发生