砖运行时7.0毫升(不支持)

砖这张照片在2020年6月发布。

砖7.0运行时机器学习为机器学习和数据提供了一个准备好了环境科学的基础上砖运行时的7.0(不支持)。砖运行时毫升含有许多流行的机器学习库,包括TensorFlow PyTorch, XGBoost。它还支持使用Horovod分布深度学习培训。

更多信息,包括指令创建砖集群运行时毫升、明白了介绍砖运行时机器学习。

新功能和重大变化

砖砖的运行时7.0毫升之上7.0运行时。有什么新信息的砖7.0运行时,包括Apache火花MLlib和SparkR,看到砖运行时的7.0(不支持)发行说明。

GPU-aware调度

砖运行时从Apache火花3.0 7.0毫升支持GPU-aware调度。砖为你自动配置它。看到GPU调度。

毫升Python环境重大变化

本节描述的主要修改预装毫升Python环境相比砖运行时6.6毫升(不支持)。您还应该检查基本的Python环境的重大变化砖运行时的7.0(不支持)。安装Python包的完整列表和他们的版本,看Python库。

Python包升级

  • tensorflow 1.15.0 - > 2.2.0

  • 2.2.2 tensorboard 1.15.0 - >

  • pytorch 1.4.0 - > 1.5.0

  • xgboost 0.90 - > 1.1.1

  • sparkdl 1.6.0-db1 - > 2.1.0-db1

  • hyperopt 0.2.2。db1 - > 0.2.4.db1

Python包添加

  • lightgbm: tripwire

  • nltk: 3.4.5

  • petastorm: 0.9.2

  • 4.5.2情节:

Python包删除

  • argparse

  • 宝途(使用boto3相反)

  • 彩色光

  • 弃用

  • et-xmlfile

  • fusepy

  • html5lib

  • jdcal

  • keras(使用tensorflow.keras相反)

  • keras-applications(使用tensorflow.keras.applications相反)

  • llvmlite

  • lxml

  • 鼻子

  • nose-exclude

  • numba

  • openpyxl

  • pathlib2

  • 厚度

  • pymongo

  • singledispatch

  • tensorboardX(使用torch.utils.tensorboard相反)

  • virtualenv

  • webencodings

ML R重大变化的环境

砖运行时7.0毫升包括未经修改的版本的开源v1.2.5033 RStudio服务器源代码中可以找到bob下载地址GitHub。阅读更多关于RStudio服务器在砖上。

改变毫升火花包、Java和Scala库

以下包升级。有些是升级到快照版本兼容的Apache 3.0火花:

  • graphframes: 0.7.0-db1-spark2.4 - > 0.8.0-db2-spark3.0

  • spark-tensorflow-connector: 1.15.0 (Scala 2.11) - > 1.15.0 (Scala 2.12)

  • xgboost4j xgboost4j-spark: 0.90 - > 1.0.0

  • mleap-databricks-runtime: 0.17.0-4882dc3(快照)

以下包删除:

  • TensorFlow (Java)

  • TensorFrames

  • 深度学习管道为Apache火花(Python HorovodRunner可用)

添加conda和皮普命令支持notebook-scoped Python库(公共预览版)

从砖开始运行时7.0毫升,可以使用%皮普和% conda命令来管理Python库安装在笔记本会话。您也可以使用这些命令来创建一个定制的环境,一个笔记本和笔记本之间复制这个环境。启用此功能,在集群环境中,设置火花配置spark.databricks.conda.condaMagic.enabled真正的。有关更多信息,请参见Notebook-scoped Python库。

不支持和不支持的功能

砖运行时不支持7.0毫升访问控制表。如果你需要访问控制表,我们建议您使用砖7.0运行时。

已知的问题

  • 通过sample_input参数mlflow.spark.log_model以日志MLlib mleap格式的模型失败的AttributeError由于mleap API的变化。升级到MLflow 1.9.0作为解决方案。你可以安装MLflow 1.9.0使用Notebook-scoped Python库或工作区库

系统环境

砖的系统环境运行时7.0毫升不同于砖运行时的7.0如下:

库

下面的章节列表库包含在砖运行时的7.0毫升,不同于那些包含在砖7.0运行时。

Python库

砖运行时7.0毫升使用Conda Python包管理,包括许多流行毫升包。以下部分描述了Conda砖运行时环境7.0毫升。

Python对CPU的集群

的名字:databricks-ml渠道:- - - - - -pytorch- - - - - -违约依赖关系:- - - - - -_libgcc_mutex = 0.1 =主要- - - - - -absl-py = 0.9.0 = py37_0- - - - - -= py37_0 1.3.0 asn1crypto =版本- - - - - -阿斯特= 0.8.0 = py37_0- - - - - -backcall = 0.1.0 = py37_0- - - - - -补丁= 1.0 = py_2- - - - - -bcrypt = 3.1.7 = py37h7b6447c_1- - - - - -布拉斯特区= 1.0 = mkl- - - - - -信号灯= 1.4 = py37_0- - - - - -boto3 = 1.12.0 = py_0- - - - - -botocore = 1.15.0 = py_0- - - - - -c-ares = 1.15.0 = h7b6447c_1001- - - - - -ca证书= 2020.1.1 = 0- - - - - -cachetools = 4.1.0 = py_1- - - - - -certifi = 2020.4.5.1 = py37_0- - - - - -cffi = 1.14.0 = py37h2e261b9_0- - - - - -chardet = 3.0.4 = py37_1003- - - - - -单击= 7.0 = py37_0- - - - - -= py_0 1.3.0 cloudpickle =版本- - - - - -configparser = 3.7.4 = py37_0- - - - - -cpuonly = 1.0 = 0- - - - - -密码= 2.8 = py37h1ba5d50_0- - - - - -周期计= 0.10.0 = py37_0- - - - - -cython = 0.29.15 = py37he6710b0_0- - - - - -4.4.1装饰= = py_0- - - - - -莳萝= 0.3.1.1 = py37_1- - - - - -docutils = 0.15.2 = py37_0- - - - - -entrypoints = 0.3 = py37_0- - - - - -瓶= 1.1.1 = py_1- - - - - -freetype的= 2.9.1 = h8a8886c_1- - - - - -未来= 0.18.2 = py37_1- - - - - -恐吓= 0.3.3 = py_0- - - - - -gitdb2 = 2.0.6 = py_0- - - - - -gitpython = 3.0.5 = py_0- - - - - -google-auth = 1.11.2 = py_0- - - - - -google-auth-oauthlib = 0.4.1 = py_2- - - - - -google-pasta = 0.2.0 = py_0- - - - - -grpcio = 1.27.2 = py37hf8bcb03_0- - - - - -gunicorn = 20.0.4 = py37_0- - - - - -h5py = 2.10.0 = py37h7918eee_0- - - - - -hdf5 = 1.10.4 = hb1b8bf9_0- - - - - -icu = 58.2 = he6710b0_3- - - - - -idna = 2.8 = py37_0- - - - - -intel-openmp = 2020.0 = 166- - - - - -ipykernel = 5.1.4 = py37h39e3cac_0- - - - - -ipython = 7.12.0 = py37h5ca1d4c_0- - - - - -ipython_genutils = 0.2.0 = py37_0- - - - - -itsdangerous = 1.1.0 = py37_0- - - - - -绝地= 0.14.1 = py37_0- - - - - -jinja2 = 2.11.1 = py_0- - - - - -jmespath = 0.9.4 = py_0- - - - - -joblib = 0.14.1 = py_0- - - - - -jpeg = 9 b = h024ee3a_2- - - - - -jupyter_client = 5.3.4 = py37_0- - - - - -jupyter_core = 4.6.1 = py37_0- - - - - -kiwisolver = 1.1.0 = py37he6710b0_0- - - - - -krb5 = 1.16.4 = h173b8e3_0- - - - - -ld_impl_linux - 64 = 2.33.1 = h53a641e_7- - - - - -libedit = 3.1.20181209 = hc058e9b_0- - - - - -libffi = 3.2.1 = hd88cf55_4- - - - - -libgcc-ng = 9.1.0 = hdf63c60_0- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libpng = 1.6.37 = hbc83047_0- - - - - -libpq = 11.2 = h20c2e04_0- - - - - -libprotobuf = 3.11.4 = hd408876_0- - - - - -libsodium = 1.0.16 = h1bed415_0- - - - - -libstdcxx-ng = 9.1.0 = hdf63c60_0- - - - - -libtiff = 4.1.0 = h2733197_0- - - - - -lightgbm = tripwire = py37he6710b0_0- - - - - -lz4-c = 1.8.1.2 = h14c3975_0- - - - - -尖吻鲭鲨= 1.1.2 = py_0- - - - - -减价= 3.1.1 = py37_0- - - - - -markupsafe = 1.1.1 = py37h7b6447c_0- - - - - -matplotlib-base = 3.1.3 = py37hef1b27d_0- - - - - -mkl = 2020.0 = 166- - - - - -mkl-service = tripwire = py37he904b0f_0- - - - - -mkl_fft = 1.0.15 = py37ha843d7b_0- - - - - -mkl_random = 1.1.0 = py37hd6b4f25_0- - - - - -ncurses = 6.2 = he6710b0_1- - - - - -networkx = 2.4 = py_0- - - - - -忍者= 1.9.0 = py37hfd86e86_0- - - - - -nltk = 3.4.5 = py37_0- - - - - -numpy = 1.18.1 = py37h4f9e942_0- - - - - -numpy-base = 1.18.1 = py37hde5b4d6_1- - - - - -oauthlib = 3.1.0 = py_0- - - - - -olefile = 0.46 = py37_0- - - - - -openssl = 1.1.1g = h7b6447c_0- - - - - -包装= 20.1 = py_0- - - - - -熊猫= 1.0.1 = py37h0573a6f_0- - - - - -paramiko = 2.7.1 = py_0- - - - - -parso = 0.5.2 = py_0- - - - - -容易受骗的人= 0.5.1 = py37_0- - - - - -pexpect = 4.8.0 = py37_0- - - - - -pickleshare = 0.7.5 = py37_0- - - - - -枕头= 7.0.0 = py37hb39fc2d_0- - - - - -皮普= 20.0.2 = py37_3- - - - - -4.5.2情节= = py_0- - - - - -prompt_toolkit = 3.0.3 = py_0- - - - - -protobuf = 3.11.4 = py37he6710b0_0- - - - - -psutil = 5.6.7 = py37h7b6447c_0- - - - - -psycopg2 = 2.8.4 = py37h1ba5d50_0- - - - - -ptyprocess = 0.6.0 = py37_0- - - - - -pyasn1 = 0.4.8 = py_0- - - - - -pyasn1-modules = 0.2.7 = py_0- - - - - -pycparser = 2.19 = py37_0- - - - - -pygments = 2.5.2 = py_0- - - - - -pyjwt = 1.7.1上= py37_0- - - - - -= py37h7b6447c_0 1.3.0 pynacl =版本- - - - - -pyodbc = 4.0.30 = py37he6710b0_0- - - - - -pyopenssl = 19.1.0 = py37_0- - - - - -pyparsing = 2.4.6 = py_0- - - - - -pysocks = 1.7.1上= py37_0- - - - - -python =第3.7.6 = h0371630_2- - - - - -python-dateutil = 2.8.1发布= py_0- - - - - -python编辑器的1.0.4 = = py_0- - - - - -pytorch = 1.5.0 = py3.7_cpu_0- - - - - -pytz = 2019.3 = py_0- - - - - -pyzmq = 18.1.1 = py37he6710b0_0- - - - - -readline = 7.0 = h7b6447c_5- - - - - -= 2.22.0 = py37_1请求- - - - - -= py_0 1.3.0 requests-oauthlib =版本- - - - - -重试= 1.3.3 = py37_2- - - - - -rsa = 4.0 = py_0- - - - - -s3transfer = 0.3.3 = py37_0- - - - - -scikit-learn = 0.22.1 = py37hd81dba3_0- - - - - -scipy = 1.4.1 = py37h0b6359f_0- - - - - -setuptools = 45.2.0 = py37_0- - - - - -simplejson = 3.17.0 = py37h7b6447c_0- - - - - -6 = 1.14.0 = py37_0- - - - - -smmap2 = 2.0.5 = py37_0- - - - - -sqlite = 3.31.1 = h62c20be_1- - - - - -sqlparse = 0.3.0 = py_0- - - - - -statsmodels = 0.11.0 = py37h7b6447c_0它- - - - - -汇总= 0.8.3 = py37_0- - - - - -tk = 8.6.8 = hbc83047_0- - - - - -torchvision = 0.6.0 = py37_cpu- - - - - -龙卷风= 6.0.3 = py37h7b6447c_3- - - - - -tqdm = 4.42.1 = py_0- - - - - -traitlets = 4.3.3 = py37_0- - - - - -unixodbc = 2.3.7 = h14c3975_0- - - - - -urllib3 = 1.25.8 = py37_0- - - - - -wcwidth = 0.1.8 = py_0- - - - - -websocket-client = 0.56.0 = py37_0- - - - - -werkzeug = 1.0.0 = py_0- - - - - -轮= 0.34.2 = py37_0- - - - - -打包= 1.11.2 = py37h7b6447c_0- - - - - -xz = 5.2.4 = h14c3975_4- - - - - -zeromq = 4.3.1 = he6710b0_3- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -zstd = 1.3.7 = h0b5b093_0- - - - - -皮普:- - - - - -astunparse = = 1.6.3- - - - - -databricks-cli = = 0.11.0- - - - - -diskcache = = 4.1.0- - - - - -码头工人= = 4.2.1- - - - - -大猩猩= = 0.3.0- - - - - -horovod = = 0.19.1- - - - - -hyperopt = = 0.2.4.db1- - - - - -keras-preprocessing = = 1.1.2- - - - - -mleap = = 0.16.0- - - - - -mlflow = = 1.8.0- - - - - -opt-einsum = = 3.2.1之上- - - - - -petastorm = = 0.9.2- - - - - -pyarrow = = 0.15.1- - - - - -pyyaml = = 5.3.1- - - - - -querystring-parser = = 4- - - - - -seaborn = = 0.10.0- - - - - -sparkdl = = 2.1.0-db1- - - - - -2.2.2 tensorboard = =- - - - - -tensorboard-plugin-wit = = 1.6.0.post3- - - - - -tensorflow-cpu = = 2.2.0- - - - - -tensorflow-estimator = = 2.2.0- - - - - -termcolor = = 1.1.0- - - - - -xgboost = = 1.1.1前缀:/砖/ conda / env / databricks-ml

Python在GPU集群

的名字:databricks-ml-gpu渠道:- - - - - -pytorch- - - - - -违约依赖关系:- - - - - -_libgcc_mutex = 0.1 =主要- - - - - -absl-py = 0.9.0 = py37_0- - - - - -= py37_0 1.3.0 asn1crypto =版本- - - - - -阿斯特= 0.8.0 = py37_0- - - - - -backcall = 0.1.0 = py37_0- - - - - -补丁= 1.0 = py_2- - - - - -bcrypt = 3.1.7 = py37h7b6447c_1- - - - - -布拉斯特区= 1.0 = mkl- - - - - -信号灯= 1.4 = py37_0- - - - - -boto3 = 1.12.0 = py_0- - - - - -botocore = 1.15.0 = py_0- - - - - -c-ares = 1.15.0 = h7b6447c_1001- - - - - -ca证书= 2020.1.1 = 0- - - - - -cachetools = 4.1.0 = py_1- - - - - -certifi = 2020.4.5.2 = py37_0- - - - - -cffi = 1.14.0 = py37h2e261b9_0- - - - - -chardet = 3.0.4 = py37_1003- - - - - -单击= 7.0 = py37_0- - - - - -= py_0 1.3.0 cloudpickle =版本- - - - - -configparser = 3.7.4 = py37_0- - - - - -密码= 2.8 = py37h1ba5d50_0- - - - - -cudatoolkit = 10.1.243 = h6bb024c_0- - - - - -周期计= 0.10.0 = py37_0- - - - - -cython = 0.29.15 = py37he6710b0_0- - - - - -4.4.1装饰= = py_0- - - - - -莳萝= 0.3.1.1 = py37_1- - - - - -docutils = 0.15.2 = py37_0- - - - - -entrypoints = 0.3 = py37_0- - - - - -瓶= 1.1.1 = py_1- - - - - -freetype的= 2.9.1 = h8a8886c_1- - - - - -未来= 0.18.2 = py37_1- - - - - -恐吓= 0.3.3 = py_0- - - - - -gitdb2 = 2.0.6 = py_0- - - - - -gitpython = 3.0.5 = py_0- - - - - -google-auth = 1.11.2 = py_0- - - - - -google-auth-oauthlib = 0.4.1 = py_2- - - - - -google-pasta = 0.2.0 = py_0- - - - - -grpcio = 1.27.2 = py37hf8bcb03_0- - - - - -gunicorn = 20.0.4 = py37_0- - - - - -h5py = 2.10.0 = py37h7918eee_0- - - - - -hdf5 = 1.10.4 = hb1b8bf9_0- - - - - -icu = 58.2 = he6710b0_3- - - - - -idna = 2.8 = py37_0- - - - - -intel-openmp = 2020.0 = 166- - - - - -ipykernel = 5.1.4 = py37h39e3cac_0- - - - - -ipython = 7.12.0 = py37h5ca1d4c_0- - - - - -ipython_genutils = 0.2.0 = py37_0- - - - - -itsdangerous = 1.1.0 = py37_0- - - - - -绝地= 0.14.1 = py37_0- - - - - -jinja2 = 2.11.1 = py_0- - - - - -jmespath = 0.9.4 = py_0- - - - - -joblib = 0.14.1 = py_0- - - - - -jpeg = 9 b = h024ee3a_2- - - - - -jupyter_client = 5.3.4 = py37_0- - - - - -jupyter_core = 4.6.1 = py37_0- - - - - -kiwisolver = 1.1.0 = py37he6710b0_0- - - - - -krb5 = 1.16.4 = h173b8e3_0- - - - - -ld_impl_linux - 64 = 2.33.1 = h53a641e_7- - - - - -libedit = 3.1.20181209 = hc058e9b_0- - - - - -libffi = 3.2.1 = hd88cf55_4- - - - - -libgcc-ng = 9.1.0 = hdf63c60_0- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libpng = 1.6.37 = hbc83047_0- - - - - -libpq = 11.2 = h20c2e04_0- - - - - -libprotobuf = 3.11.4 = hd408876_0- - - - - -libsodium = 1.0.16 = h1bed415_0- - - - - -libstdcxx-ng = 9.1.0 = hdf63c60_0- - - - - -libtiff = 4.1.0 = h2733197_0- - - - - -lightgbm = tripwire = py37he6710b0_0- - - - - -lz4-c = 1.8.1.2 = h14c3975_0- - - - - -尖吻鲭鲨= 1.1.2 = py_0- - - - - -减价= 3.1.1 = py37_0- - - - - -markupsafe = 1.1.1 = py37h7b6447c_0- - - - - -matplotlib-base = 3.1.3 = py37hef1b27d_0- - - - - -mkl = 2020.0 = 166- - - - - -mkl-service = tripwire = py37he904b0f_0- - - - - -mkl_fft = 1.0.15 = py37ha843d7b_0- - - - - -mkl_random = 1.1.0 = py37hd6b4f25_0- - - - - -ncurses = 6.2 = he6710b0_1- - - - - -networkx = 2.4 = py_0- - - - - -忍者= 1.9.0 = py37hfd86e86_0- - - - - -nltk = 3.4.5 = py37_0- - - - - -numpy = 1.18.1 = py37h4f9e942_0- - - - - -numpy-base = 1.18.1 = py37hde5b4d6_1- - - - - -oauthlib = 3.1.0 = py_0- - - - - -olefile = 0.46 = py37_0- - - - - -openssl = 1.1.1g = h7b6447c_0- - - - - -包装= 20.1 = py_0- - - - - -熊猫= 1.0.1 = py37h0573a6f_0- - - - - -paramiko = 2.7.1 = py_0- - - - - -parso = 0.5.2 = py_0- - - - - -容易受骗的人= 0.5.1 = py37_0- - - - - -pexpect = 4.8.0 = py37_0- - - - - -pickleshare = 0.7.5 = py37_0- - - - - -枕头= 7.0.0 = py37hb39fc2d_0- - - - - -皮普= 20.0.2 = py37_3- - - - - -4.5.2情节= = py_0- - - - - -prompt_toolkit = 3.0.3 = py_0- - - - - -protobuf = 3.11.4 = py37he6710b0_0- - - - - -psutil = 5.6.7 = py37h7b6447c_0- - - - - -psycopg2 = 2.8.4 = py37h1ba5d50_0- - - - - -ptyprocess = 0.6.0 = py37_0- - - - - -pyasn1 = 0.4.8 = py_0- - - - - -pyasn1-modules = 0.2.7 = py_0- - - - - -pycparser = 2.19 = py37_0- - - - - -pygments = 2.5.2 = py_0- - - - - -pyjwt = 1.7.1上= py37_0- - - - - -= py37h7b6447c_0 1.3.0 pynacl =版本- - - - - -pyodbc = 4.0.30 = py37he6710b0_0- - - - - -pyopenssl = 19.1.0 = py37_0- - - - - -pyparsing = 2.4.6 = py_0- - - - - -pysocks = 1.7.1上= py37_0- - - - - -python =第3.7.6 = h0371630_2- - - - - -python-dateutil = 2.8.1发布= py_0- - - - - -python编辑器的1.0.4 = = py_0- - - - - -pytorch = 1.5.0 = py3.7_cuda10.1.243_cudnn7.6.3_0- - - - - -pytz = 2019.3 = py_0- - - - - -pyzmq = 18.1.1 = py37he6710b0_0- - - - - -readline = 7.0 = h7b6447c_5- - - - - -= 2.22.0 = py37_1请求- - - - - -= py_0 1.3.0 requests-oauthlib =版本- - - - - -重试= 1.3.3 = py37_2- - - - - -rsa = 4.0 = py_0- - - - - -s3transfer = 0.3.3 = py37_0- - - - - -scikit-learn = 0.22.1 = py37hd81dba3_0- - - - - -scipy = 1.4.1 = py37h0b6359f_0- - - - - -setuptools = 45.2.0 = py37_0- - - - - -simplejson = 3.17.0 = py37h7b6447c_0- - - - - -6 = 1.14.0 = py37_0- - - - - -smmap2 = 2.0.5 = py37_0- - - - - -sqlite = 3.31.1 = h62c20be_1- - - - - -sqlparse = 0.3.0 = py_0- - - - - -statsmodels = 0.11.0 = py37h7b6447c_0它- - - - - -汇总= 0.8.3 = py37_0- - - - - -tk = 8.6.8 = hbc83047_0- - - - - -torchvision = 0.6.0 = py37_cu101- - - - - -龙卷风= 6.0.3 = py37h7b6447c_3- - - - - -tqdm = 4.42.1 = py_0- - - - - -traitlets = 4.3.3 = py37_0- - - - - -unixodbc = 2.3.7 = h14c3975_0- - - - - -urllib3 = 1.25.8 = py37_0- - - - - -wcwidth = 0.1.8 = py_0- - - - - -websocket-client = 0.56.0 = py37_0- - - - - -werkzeug = 1.0.0 = py_0- - - - - -轮= 0.34.2 = py37_0- - - - - -打包= 1.11.2 = py37h7b6447c_0- - - - - -xz = 5.2.4 = h14c3975_4- - - - - -zeromq = 4.3.1 = he6710b0_3- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -zstd = 1.3.7 = h0b5b093_0- - - - - -皮普:- - - - - -astunparse = = 1.6.3- - - - - -databricks-cli = = 0.11.0- - - - - -diskcache = = 4.1.0- - - - - -码头工人= = 4.2.1- - - - - -大猩猩= = 0.3.0- - - - - -horovod = = 0.19.1- - - - - -hyperopt = = 0.2.4.db1- - - - - -keras-preprocessing = = 1.1.2- - - - - -mleap = = 0.16.0- - - - - -mlflow = = 1.8.0- - - - - -opt-einsum = = 3.2.1之上- - - - - -petastorm = = 0.9.2- - - - - -pyarrow = = 0.15.1- - - - - -pyyaml = = 5.3.1- - - - - -querystring-parser = = 4- - - - - -seaborn = = 0.10.0- - - - - -sparkdl = = 2.1.0-db1- - - - - -2.2.2 tensorboard = =- - - - - -tensorboard-plugin-wit = = 1.6.0.post3- - - - - -tensorflow-estimator = = 2.2.0- - - - - -tensorflow-gpu = = 2.2.0- - - - - -termcolor = = 1.1.0- - - - - -xgboost = = 1.1.1前缀:/砖/ conda / env / databricks-ml-gpu

引发包包含Python模块

火花包

Python模块

版本

graphframes

graphframes

0.8.0-db2-spark3.0

R库

R库的完全相同R库在砖运行时7.0 Beta。

Java和Scala库(Scala 2.12集群)

除了Java和Scala库砖7.0运行时,砖运行时7.0毫升包含以下jar:

组ID

工件ID

版本

com.typesafe.akka

akka-actor_2.12

2.5.23

ml.combust.mleap

mleap-databricks-runtime_2.12

0.17.0-4882dc3

ml.dmlc

xgboost4j-spark_2.12

1.0.0

ml.dmlc

xgboost4j_2.12

1.0.0

org.mlflow

mlflow-client

1.8.0

org.scala-lang.modules

scala-java8-compat_2.12

0.8.0

org.tensorflow

spark-tensorflow-connector_2.12

1.15.0