砖与Conda 5.4运行时(不支持)

我们很高兴能引进砖与Conda 5.4运行时,它可以让你利用Conda管理Python库和环境。这个运行时提供了两根Conda环境选择在创建集群:

  • 砖的标准环境包括许多流行的Python包的更新版本。这个环境是作为现有笔记本电脑上运行的替代数据砖运行时。这是默认砖Conda-based运行时环境。

  • 砖最小环境包含所需的最低数量的包PySpark和砖Python笔记本的功能。这个环境是理想的,如果你想自定义运行时各种Python包。

包括支持数据砖库工具(dbutils.library)

请注意

Scala、Java和R在砖5.4运行时库Conda砖运行时的5.4是相同的。详情,请参阅砖运行时的5.4(不支持)发行说明。信息如何使用砖和Conda运行时,看到的砖与Conda运行时

系统环境

系统环境与Conda不同于砖砖5.4运行时的运行时5.4如下:

  • Python:3.7.x。只支持Python 3。

以下是出口environment.yml文件默认根与Conda砖5.4运行时的环境。

砖的标准

的名字:databricks-standard渠道:- - - - - -违约依赖关系:- - - - - -asn1crypto = 0.24.0 = py37_0- - - - - -backcall = 0.1.0 = py37_0- - - - - -布拉斯特区= 1.0 = openblas- - - - - -宝途= 2.49.0 = py37_0- - - - - -boto3 = 1.9.111 = py_0- - - - - -botocore = 1.12.112 = py_0- - - - - -ca证书= 2018.03.07 = 0- - - - - -certifi = 2018.8.24 = py37_1- - - - - -cffi = 1.11.5 = py37he75722e_1- - - - - -chardet = 3.0.4 = py37_1- - - - - -密码= 2.3.1 = py37hc365091_0- - - - - -cython = 0.28.5 = py37hf484d3e_0- - - - - -安装装饰= 4.3.0 = py37_0- - - - - -docutils = 0.14 = py37_0- - - - - -idna = 2.7 = py37_0- - - - - -ipython = 6.5.0 = py37_0- - - - - -ipython_genutils = 0.2.0 = py37_0- - - - - -绝地= 0.12.1 = py37_0- - - - - -jmespath = 0.9.4 = py_0- - - - - -krb5 = 1.16.1 = hc83ff2d_6- - - - - -libedit = 3.1.20170329 = h6b74fdf_2- - - - - -libffi = 3.2.1 = hd88cf55_4- - - - - -libgcc-ng = 8.2.0 = hdf63c60_1- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libopenblas = 0.3.3 = h5a2b251_3- - - - - -libpq = 10.5 = h1ad7b7a_0- - - - - -libstdcxx-ng = 8.2.0 = hdf63c60_1- - - - - -ncurses = 6.1 = he6710b0_1- - - - - -nomkl = 3.0 = 0- - - - - -numpy = 1.15.1 = py37h99e49ec_0- - - - - -numpy-base = 1.15.1 = py37h2f8d375_0- - - - - -openssl = 1.0.2p = h14c3975_0- - - - - -熊猫= 0.23.4 = py37h04863e7_0- - - - - -parso = 0.3.1 = py37_0- - - - - -容易受骗的人= 0.5.0 = py37_0- - - - - -pexpect = 4.6.0 = py37_0- - - - - -pickleshare = 0.7.4 = py37_0- - - - - -皮普= 10.0.1 = py37_0- - - - - -prompt_toolkit = 1.0.15 = py37_0- - - - - -psycopg2 = 2.7.5 = py37hb7f436b_0- - - - - -ptyprocess = 0.6.0 = py37_0- - - - - -pycparser = 2.18 = py37_1- - - - - -pygments = 2.2.0 = py37_0- - - - - -pyopenssl = 18.0.0 = py37_0- - - - - -pysocks = 1.6.8 = py37_0- - - - - -python = 3.7.0 = hc3d631a_0- - - - - -python-dateutil = 2.7.3 = py37_0- - - - - -pytz = 2018.5 = py37_0- - - - - -readline = 7.0 = h7b6447c_5- - - - - -= 2.19.1 = py37_0请求- - - - - -s3transfer = 0.2.0 = py37_0- - - - - -scikit-learn = 0.19.2 = py37h22eb022_0- - - - - -scipy = 1.1.0 = py37he2b7bc3_2- - - - - -setuptools = 40.2.0 = py37_0- - - - - -simplegeneric = 0.8.1 = py37_2- - - - - -6 = 1.11.0 = py37_1- - - - - -sqlite = 3.24.0 = h84994c4_0- - - - - -statsmodels = 0.9.0 = py37h035aef0_0- - - - - -tk = 8.6.8 = hbc83047_0- - - - - -traitlets = 4.3.2 = py37_0- - - - - -urllib3 = 1.23 = py37_0- - - - - -wcwidth = 0.1.7 = py37_0- - - - - -轮= 0.31.1 = py37_0- - - - - -xz = 5.2.4 = h14c3975_4- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -皮普:- - - - - -周期计= = 0.10.0- - - - - -kiwisolver = = 1.1.0- - - - - -matplotlib = = 2.2.3- - - - - -pyarrow = = 0.12.0- - - - - -pyparsing = =测试盒框- - - - - -seaborn = = 0.9.0前缀:/砖/ conda / env / databricks-standard

砖最小

的名字:databricks-minimal渠道:- - - - - -违约依赖关系:- - - - - -backcall = 0.1.0 = py37_0- - - - - -布拉斯特区= 1.0 = openblas- - - - - -ca证书= 2018.03.07 = 0- - - - - -certifi = 2018.8.24 = py37_1- - - - - -安装装饰= 4.3.0 = py37_0- - - - - -ipython = 6.5.0 = py37_0- - - - - -ipython_genutils = 0.2.0 = py37_0- - - - - -绝地= 0.12.1 = py37_0- - - - - -libedit = 3.1.20170329 = h6b74fdf_2- - - - - -libffi = 3.2.1 = hd88cf55_4- - - - - -libgcc-ng = 8.2.0 = hdf63c60_1- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libopenblas = 0.3.3 = h5a2b251_3- - - - - -libstdcxx-ng = 8.2.0 = hdf63c60_1- - - - - -ncurses = 6.1 = he6710b0_1- - - - - -nomkl = 3.0 = 0- - - - - -numpy = 1.15.1 = py37h99e49ec_0- - - - - -numpy-base = 1.15.1 = py37h2f8d375_0- - - - - -openssl = 1.0.2p = h14c3975_0- - - - - -熊猫= 0.23.4 = py37h04863e7_0- - - - - -parso = 0.3.1 = py37_0- - - - - -pexpect = 4.6.0 = py37_0- - - - - -pickleshare = 0.7.4 = py37_0- - - - - -皮普= 10.0.1 = py37_0- - - - - -prompt_toolkit = 1.0.15 = py37_0- - - - - -ptyprocess = 0.6.0 = py37_0- - - - - -pygments = 2.2.0 = py37_0- - - - - -python = 3.7.0 = hc3d631a_0- - - - - -python-dateutil = 2.7.3 = py37_0- - - - - -pytz = 2018.5 = py37_0- - - - - -readline = 7.0 = h7b6447c_5- - - - - -setuptools = 40.2.0 = py37_0- - - - - -simplegeneric = 0.8.1 = py37_2- - - - - -6 = 1.11.0 = py37_1- - - - - -sqlite = 3.24.0 = h84994c4_0- - - - - -tk = 8.6.8 = hbc83047_0- - - - - -traitlets = 4.3.2 = py37_0- - - - - -wcwidth = 0.1.7 = py37_0- - - - - -轮= 0.31.1 = py37_0- - - - - -xz = 5.2.4 = h14c3975_4- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -皮普:- - - - - -pyarrow = = 0.12.0前缀:/砖/ conda / env / databricks-minimal