砖运行时的3.1(不支持)

在2017年8月初,砖公布的这张照片。

重要的

2017年10月30日这个版本被弃用。关于砖运行时弃用策略的更多信息和时间表,看看砖运行时支持生命周期

以下发布说明提供的信息数据砖3.1运行时由Apache火花。

的变化和改进

性能和DBIO

  • 更高的吞吐量写Hive-serde表:显著提高性能的写作Hive-serde表与多个增强层的查询优化和执行。

  • 更好的性能对toPandas:集成Apache与Apache改善PySpark火花的箭头DataFrame.toPandas

  • 更快的窗口处理函数:提高火花SQL窗口函数处理的性能。

  • 更优化的规则:添加多个绩效规则在火花SQL优化器催化剂。

流媒体

  • 5 x加速暴跌windows。

  • 减少延迟的状态操作。

  • 事务性文件水槽(私人预览):添加一个事务层结构化流FileSink。福利包括:回填与批处理作业的能力,压实对小文件,自动更新为读者(没有刷新表)。如果你有兴趣请联系您的帐户代表参与该特性的Alpha版本。

  • 可伸缩的状态存储(私人预览):使用分层存储的内存,ssd和S3有效执行存储很大的状态流计算。如果你有兴趣请联系您的帐户代表参与该特性的Alpha版本。

机器学习

  • 毫升评分模型库(私人预览):出口毫升模型和管道(例如,逻辑回归,随机森林,和featurization)执行Apache以外的火花在自定义部署环境。如果你有兴趣请联系您的帐户代表参与该特性的Alpha版本。

安全

结构化数据的访问控制现在一般可以通过火花的SQL接口。在这种背景下,由用户或组可以访问被限制为任何可获得的对象,如表、视图、数据库或函数。细粒度访问控制水平(即匹配特定条件的行或列)可以通过访问控制实现派生视图,这些视图可以包含任意查询。这些访问控制策略是由砖SQL查询分析器在运行时执行。看到蜂巢metastore特权和可获得的对象(遗留)为更多的信息。

其他功能和改进

  • 更好的UI火花:写作行为现在正确地显示在UI火花。

环境

Apache火花

砖运行时3.1包含Apache 2.2.0火花。除了砖运行时的3.0(不支持)砖运行时3.1还包括以下额外的bug修复和改进了火花:

已知的问题

  • 有一个问题引发和运行时3.1提交任务。请使用运行时版本3.2或更高版本。

  • 日志执行人页面上的链接不正确设置。请使用工人页面访问stdout和stderr链接的执行人。

系统环境

  • 操作系统:Ubuntu 16.04.2 LTS

  • Java:1.8.0_131

  • Scala集群:2.10.6 (Scala 2.10版)/ 2.11.8集群(Scala 2.11版本)

  • Python如果使用Python 3: 2.7.12(或3.5.2)

  • R3.2.3:R版本(2015-12-10)

预先安装Python库

图书馆

版本

图书馆

版本

图书馆

版本

ansi2html

1.1.1

argparse

1.2.1 "

backports-abc

0.5

宝途

2.42.0

boto3

1.4.1

botocore

1.4.70

brewer2mpl

1.4.1

certifi

2016.2.28

cffi

1.7.0

chardet

tripwire

彩色光

0.3.7

configobj

5.0.6

密码学

1.5

周期计

0.10.0

Cython

0.24.1

装饰

4.0.10

docutils

0.13.1

enum34

1.1.6

et-xmlfile

1.0.1

freetype-py

1.0.2中

funcsigs

1.0.2中

fusepy

2.0.4

期货

3.1.1

ggplot

0.6.8

html5lib

0.999

idna

2.1

ipaddress

1.0.16

ipython

2.2.0

ipython-genutils

0.1.0

jdcal

1.2

Jinja2

2.8

jmespath

0.9.0

llvmlite

0.13.0

lxml

3.6.4

MarkupSafe

0.23

matplotlib

1.5.3

mpld3

0.2

msgpack-python

0.4.7

ndg-httpsclient

0.3.3

numba

0.28.1

numpy

1.11.1

openpyxl

2.3.2

熊猫

0.18.1

pathlib2

魅惑

容易受骗的人

0.4.1

pexpect

4.0.1

pickleshare

0.7.4

枕头

3.3.1

皮普

9.0.1

厚度

3.9

prompt-toolkit

1.0.7

psycopg2

2.6.2

ptyprocess

0.5.1

py4j

0.10.3

pyarrow

0.4.1

pyasn1

0.1.9

pycparser

2.14

Pygments

2.1.3

PyGObject

3.20.0

pyOpenSSL

16.0.0

pyparsing

2.2.0

pypng

0.0.18

Python

2.7.12

python-dateutil

2.5.3

python-geohash

0.8.5

pytz

2016.6.1

请求

2.11.1

s3transfer

0.1.9

scikit-learn

0.18.1

scipy

0.18.1

冲刷

0.32

seaborn

是0.7.1

setuptools

36.0.1

simplejson

3.8.2

simples3

1.0

singledispatch

3.4.0.3

六个

1.10.0

statsmodels

0.6.1

龙卷风

4.5.1

traitlets

4.3.0

urllib3

1.19.1

virtualenv

15.0.1

wcwidth

0.1.7

0.30.0a0

wsgiref

0.1.2

预装R库

图书馆

版本

图书馆

版本

图书馆

版本

abind

1.4 - 3

为了

0.1

基地

3.2.3

黑洞

1.60.0-2

bitops

1.0 6

引导

-17 - 1.3

酿造

1.0 6

2.1 - 3

脱字符号

-71 - 6.0

时间

-47 - 2.3

-14 - 7.3

集群

2.0.5

codetools

-14 - 0.2

色彩

1.2 - 4

编译器

3.2.3

蜡笔

1.3.1

旋度

2.2

data.table

1.9.6

数据集

3.2.3

DBI

0.5 - 1

devtools

1.12.0

二色视者

2.0 0

消化

0.6.9

doMC

1.3.4

dplyr

0.5.0

foreach

3

外国

-66 - 0.8

“绿带运动”

2.1.1

ggplot2

魅惑

git2r

0.15.0

glmnet

2.0 - 5

图形

3.2.3

grDevices

3.2.3

网格

3.2.3

gsubfn

0.6 6

gtable

0.1.2

3.10.0.8

httr

1.2.1 "

hwriter

1.3.2

hwriterPlus

1.0 - 3

迭代器

1.0.8

jsonlite

1.1

KernSmooth

-15 - 2.23

标签

0.3

晶格

-34 - 0.20

lazyeval

0.2.0

的小

0.3.0

lme4

-12 - 1.1

lubridate

1.6.0

magrittr

1.5

mapproj

1.2 - 4

地图

3.0.2

质量

-45 - 7.3

矩阵

1.2 - -7.1

MatrixModels

0.4 - 1

memoise

1.0.0

方法

3.2.3

mgcv

-11 - 1.8

mime

0.5

minqa

1.2.4

多核

0.2

孟塞尔

0.4.2

mvtnorm

1.0 - 5

nlme

-124 - 3.1

nloptr

1.0.4

nnet

-12 - 7.3

openssl

0.9.4

平行

3.2.3

pbkrtest

0.4 6

pkgKitten

0.1.3

plyr

1.8.4

赞美

1.0.0

pROC

1.8

原型

-10 - 0.3

quantreg

5.29

R.methodsS3

1.7.1上

R.oo

1.20.0

R.utils

测试盒框

R6

2.2.0

randomForest

-12 - 4.6

RColorBrewer

1.1 - 2

Rcpp

0.12.7

RcppEigen

0.3.2.9.0

RCurl

1.95 - -4.8

reshape2

1.4.2

RODBC

-12 - 1.3

roxygen2

5.0.1

rpart

-10 - 4.1

Rserve

1.7 - 3

RSQLite

1.0.0

rstudioapi

0.6

尺度

0.3.0

sp

-15 - 1.0

SparkR

2.2.0

SparseM

1.72

空间

-11 - 7.3

样条函数

3.2.3

sqldf

-10 - 0.4

statmod

1.4.26

统计数据

3.2.3

stats4

3.2.3

stringi

1.0 - 1

stringr

1.0.0

生存

2.38 - 3

tcltk

3.2.3

TeachingDemos

2.10

testthat

1.0.2中

宠物猫

1.2

工具

3.2.3

跑龙套

3.2.3

晶须

0.3 - 2

withr

1.0.2中

预先安装的Java和Scala库(Scala 2.10集群版)

组ID

工件ID

版本

antlr

antlr

2.7.7

com.amazonaws

amazon-kinesis-client

1.7.3

com.amazonaws

aws-java-sdk-autoscaling

1.11.126

com.amazonaws

aws-java-sdk-cloudformation

1.11.126

com.amazonaws

aws-java-sdk-cloudfront

1.11.126

com.amazonaws

aws-java-sdk-cloudhsm

1.11.126

com.amazonaws

aws-java-sdk-cloudsearch

1.11.126

com.amazonaws

aws-java-sdk-cloudtrail

1.11.126

com.amazonaws

aws-java-sdk-cloudwatch

1.11.126

com.amazonaws

aws-java-sdk-cloudwatchmetrics

1.11.126

com.amazonaws

aws-java-sdk-codedeploy

1.11.126

com.amazonaws

aws-java-sdk-cognitoidentity

1.11.126

com.amazonaws

aws-java-sdk-cognitosync

1.11.126

com.amazonaws

aws-java-sdk-config

1.11.126

com.amazonaws

aws-java-sdk-core

1.11.126

com.amazonaws

aws-java-sdk-datapipeline

1.11.126

com.amazonaws

aws-java-sdk-directconnect

1.11.126

com.amazonaws

aws-java-sdk-directory

1.11.126

com.amazonaws

aws-java-sdk-dynamodb

1.11.126

com.amazonaws

aws-java-sdk-ec2

1.11.126

com.amazonaws

aws-java-sdk-ecs

1.11.126

com.amazonaws

aws-java-sdk-efs

1.11.126

com.amazonaws

aws-java-sdk-elasticache

1.11.126

com.amazonaws

aws-java-sdk-elasticbeanstalk

1.11.126

com.amazonaws

aws-java-sdk-elasticloadbalancing

1.11.126

com.amazonaws

aws-java-sdk-elastictranscoder

1.11.126

com.amazonaws

aws-java-sdk-emr

1.11.126

com.amazonaws

aws-java-sdk-glacier

1.11.126

com.amazonaws

aws-java-sdk-iam

1.11.126

com.amazonaws

aws-java-sdk-importexport

1.11.126

com.amazonaws

aws-java-sdk-kinesis

1.11.126

com.amazonaws

aws-java-sdk-kms

1.11.126

com.amazonaws

aws-java-sdk-lambda

1.11.126

com.amazonaws

aws-java-sdk-logs

1.11.126

com.amazonaws

aws-java-sdk-machinelearning

1.11.126

com.amazonaws

aws-java-sdk-opsworks

1.11.126

com.amazonaws

aws-java-sdk-rds

1.11.126

com.amazonaws

aws-java-sdk-redshift

1.11.126

com.amazonaws

aws-java-sdk-route53

1.11.126

com.amazonaws

aws-java-sdk-s3

1.11.126

com.amazonaws

aws-java-sdk-ses

1.11.126

com.amazonaws

aws-java-sdk-simpledb

1.11.126

com.amazonaws

aws-java-sdk-simpleworkflow

1.11.126

com.amazonaws

aws-java-sdk-sns

1.11.126

com.amazonaws

aws-java-sdk-sqs

1.11.126

com.amazonaws

aws-java-sdk-ssm

1.11.126

com.amazonaws

aws-java-sdk-storagegateway

1.11.126

com.amazonaws

aws-java-sdk-sts

1.11.126

com.amazonaws

aws-java-sdk-support

1.11.126

com.amazonaws

aws-java-sdk-swf-libraries

1.11.22

com.amazonaws

aws-java-sdk-workspaces

1.11.126

com.amazonaws

jmespath-java

1.11.126

com.carrotsearch

hppc

是0.7.1

com.chuusai

shapeless_2.10

2.3.2

com.clearspring.analytics

2.7.0

com.databricks

Rserve

1.8 - 3

com.databricks

dbml-local_2.10

0.2.0-db4-spark2.2

com.databricks

dbml-local_2.10-tests

0.2.0-db4-spark2.2

com.databricks

jets3t

0.7.1-0

com.databricks.scalapb

compilerplugin_2.10

0.4.15-9

com.databricks.scalapb

scalapb-runtime_2.10

0.4.15-9

com.esotericsoftware

kryo-shaded

3.0.3

com.esotericsoftware

minlog

1.3.0

com.fasterxml

同学

1.0.0

com.fasterxml.jackson.core

jackson-annotations

2.6.5

com.fasterxml.jackson.core

jackson-core

2.6.5

com.fasterxml.jackson.core

jackson-databind

2.6.5

com.fasterxml.jackson.dataformat

jackson-dataformat-cbor

2.6.5

com.fasterxml.jackson.datatype

jackson-datatype-joda

2.6.5

com.fasterxml.jackson.module

jackson-module-paranamer

2.6.5

com.fasterxml.jackson.module

jackson-module-scala_2.10

2.6.5

com.github.fommil

jniloader

1.1

com.github.fommil.netlib

核心

1.1.2

com.github.fommil.netlib

native_ref-java

1.1

com.github.fommil.netlib

native_ref-java-natives

1.1

com.github.fommil.netlib

native_system-java

1.1

com.github.fommil.netlib

native_system-java-natives

1.1

com.github.fommil.netlib

netlib-native_ref-linux-x86_64-natives

1.1

com.github.fommil.netlib

netlib-native_system-linux-x86_64-natives

1.1

com.github.rwl

jtransforms

测试盒框

com.google.code.findbugs

jsr305

2.0.1

com.google.code.gson

gson

2.2.4

com.google.guava

番石榴

15.0

com.google.protobuf

protobuf-java

2.6.1

com.googlecode.javaewah

JavaEWAH

0.3.2

com.h2database

h2

1.3.174

com.jamesmurty.utils

java-xmlbuilder

1.0

com.jcraft

jsch

0.1.50

com.jolbox

bonecp

0.8.0.RELEASE

com.mchange

c3p0

0.9.5.1

com.mchange

mchange-commons-java

0.2.10

com.microsoft.azure

azure-data-lake-store-sdk

)

com.microsoft.sqlserver

mssql-jdbc

6.1.0.jre8

com.ning

compress-lzf

1.0.3

com.sun.mail

javax.mail

1.5.2

com.thoughtworks.paranamer

paranamer

2.6

com.trueaccord.lenses

lenses_2.10

0.3

com.twitter

chill-java

0.8.0

com.twitter

chill_2.10

0.8.0

com.twitter

parquet-hadoop-bundle

1.6.0

com.twitter

util-app_2.10

6.23.0

com.twitter

util-core_2.10

6.23.0

com.twitter

util-jvm_2.10

6.23.0

com.typesafe

配置

1.2.1 "

com.typesafe

scalalogging-slf4j_2.10

1.1.0

com.univocity

univocity-parsers

2.2.1

com.vlkan

flatbuffers

1.2.0-3f79e055

com.zaxxer

HikariCP

2.4.1

commons-beanutils

commons-beanutils

1.7.0

commons-beanutils

commons-beanutils-core

1.8.0

commons-cli

commons-cli

1.2

commons-codec

commons-codec

1.10

commons-collections

commons-collections

3.2.2

commons configuration

commons configuration

1.6

commons-dbcp

commons-dbcp

1.4

commons-digester

commons-digester

1.8

commons-httpclient

commons-httpclient

3.1

commons-io

commons-io

2.4

commons lang

commons lang

2.6

通用日志

通用日志

1.1.3

commons net

commons net

2.2

commons-pool

commons-pool

1.5.4

info.ganglia.gmetric4j

gmetric4j

1.0.7

io.dropwizard.metrics

metrics-core

3.1.2

io.dropwizard.metrics

metrics-ganglia

3.1.2

io.dropwizard.metrics

metrics-graphite

3.1.2

io.dropwizard.metrics

metrics-healthchecks

3.1.2

io.dropwizard.metrics

metrics-jetty9

3.1.2

io.dropwizard.metrics

metrics-json

3.1.2

io.dropwizard.metrics

metrics-jvm

3.1.2

io.dropwizard.metrics

metrics-log4j

3.1.2

io.dropwizard.metrics

metrics-servlets

3.1.2

io.netty

网状的

3.9.9.Final

io.netty

netty-all

4.0.43.Final

io.prometheus

simpleclient

0.0.16

io.prometheus

simpleclient_common

0.0.16

io.prometheus

simpleclient_dropwizard

0.0.16

io.prometheus

simpleclient_servlet

0.0.16

io.prometheus.jmx

收集器

0.7

javax.activation

激活

1.1.1

javax.annotation

javax.annotation-api

1.2

javax.el

javax.el-api

2.2.4

javax.jdo

jdo api

3.0.1

javax.servlet

javax.servlet-api

3.1.0

javax.servlet.jsp

jsp-api

2.1

javax.transaction

jta

1.1

javax.validation

验证api

1.1.0.Final

javax.ws.rs

javax.ws.rs-api

2.0.1

javax.xml.bind

jaxb-api

2.2.2

javax.xml.stream

stax-api

1.0 - 2

javolution

javolution

5.5.1

jline

jline

2.11

joda-time

joda-time

2.9.3

log4j

apache-log4j-extras

1.2.17

log4j

log4j

1.2.17

mx4j

mx4j

3.0.2

mysql

mysql-connector-java

5.1.27

net.hydromatic

eigenbase-properties

1.1.5

net.iharder

base64

2.3.8

net.java.dev.jets3t

jets3t

0.9.3

net.jpountz.lz4

lz4

1.3.0

net.razorvine

地幔岩

4.13

net.sf.jpam

jpam

1.1

net.sf.opencsv

opencsv

2.3

net.sf.py4j

py4j

0.10.4

net.sf.supercsv

super-csv

2.2.0

net.sourceforge.f2j

arpack_combined_all

0.1

org.acplt

oncrpc

1.0.7

org.antlr

ST4

4.0.4

org.antlr

antlr-runtime

3.4

org.antlr

antlr4-runtime

4.5.3

org.antlr

stringtemplate

3.2.1之上

org.apache.ant

蚂蚁

1.9.2

org.apache.ant

ant-jsch

1.9.2

org.apache.ant

ant-launcher

1.9.2

org.apache.arrow

arrow-format

0.4.0

org.apache.arrow

arrow-memory

0.4.0

org.apache.arrow

arrow-vector

0.4.0

org.apache.avro

avro

1.7.7

org.apache.avro

avro-ipc

1.7.7

org.apache.avro

avro-ipc-tests

1.7.7

org.apache.avro

avro-mapred-hadoop2

1.7.7

org.apache.calcite

calcite-avatica

1.2.0-incubating

org.apache.calcite

calcite-core

1.2.0-incubating

org.apache.calcite

calcite-linq4j

1.2.0-incubating

org.apache.commons

commons-compress

1.4.1

org.apache.commons

commons-crypto

1.0.0

org.apache.commons

commons-lang3

3.5

org.apache.commons

commons-math3

3.4.1

org.apache.curator

curator-client

2.6.0

org.apache.curator

curator-framework

2.6.0

org.apache.curator

curator-recipes

2.6.0

org.apache.derby

德比

10.10.2.0

org.apache.directory.api

api-asn1-api

1.0.0-M20

org.apache.directory.api

api-util

1.0.0-M20

org.apache.directory.server

apacheds-i18n

2.0.0-M15

org.apache.directory.server

apacheds-kerberos-codec

2.0.0-M15

org.apache.hadoop

hadoop-annotations

2.7.3

org.apache.hadoop

hadoop-auth

2.7.3

org.apache.hadoop

hadoop-client

2.7.3

org.apache.hadoop

hadoop-common

2.7.3

org.apache.hadoop

hadoop-hdfs

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-app

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-common

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-core

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-jobclient

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-shuffle

2.7.3

org.apache.hadoop

hadoop-yarn-api

2.7.3

org.apache.hadoop

hadoop-yarn-client

2.7.3

org.apache.hadoop

hadoop-yarn-common

2.7.3

org.apache.hadoop

hadoop-yarn-server-common

2.7.3

org.apache.htrace

htrace-core

3.1.0-incubating

org.apache.httpcomponents

httpclient

4.5.2

org.apache.httpcomponents

httpcore

4.4.4

org.apache.ivy

艾薇

测试盒框

org.apache.parquet

parquet-column

1.8.2

org.apache.parquet

parquet-common

1.8.2

org.apache.parquet

parquet-encoding

1.8.2

org.apache.parquet

parquet-format

2.3.1

org.apache.parquet

parquet-hadoop

1.8.2

org.apache.parquet

parquet-jackson

1.8.2

org.apache.thrift

libfb303

0.9.3

org.apache.thrift

libthrift

0.9.3

org.apache.xbean

xbean-asm5-shaded

4.4

org.apache.zookeeper

动物园管理员

3.4.6

org.bouncycastle

bcprov-jdk15on

1.51

org.codehaus.jackson

jackson-core-asl

1.9.13

org.codehaus.jackson

jackson-jaxrs

1.9.13

org.codehaus.jackson

jackson-mapper-asl

1.9.13

org.codehaus.jackson

jackson-xc

1.9.13

org.codehaus.janino

commons-compiler

3.0.0

org.codehaus.janino

janino

3.0.0

org.datanucleus

datanucleus-api-jdo

3.2.6

org.datanucleus

datanucleus-core

3.2.10

org.datanucleus

datanucleus-rdbms

3.2.9

org.eclipse.jetty

jetty-client

9.3.11.v20160721

org.eclipse.jetty

jetty-continuation

9.3.11.v20160721

org.eclipse.jetty

jetty-http

9.3.11.v20160721

org.eclipse.jetty

jetty-io

9.3.11.v20160721

org.eclipse.jetty

jetty-jndi

9.3.11.v20160721

org.eclipse.jetty

jetty-plus

9.3.11.v20160721

org.eclipse.jetty

jetty-proxy

9.3.11.v20160721

org.eclipse.jetty

jetty-security

9.3.11.v20160721

org.eclipse.jetty

jetty服务器

9.3.11.v20160721

org.eclipse.jetty

jetty servlet

9.3.11.v20160721

org.eclipse.jetty

jetty-servlets

9.3.11.v20160721

org.eclipse.jetty

jetty-util

9.3.11.v20160721

org.eclipse.jetty

jetty-webapp

9.3.11.v20160721

org.eclipse.jetty

jetty-xml

9.3.11.v20160721

org.fusesource.jansi

jansi

1.4

org.fusesource.leveldbjni

leveldbjni-all

1.8

org.glassfish.hk2

hk2-api

2.4.0-b34

org.glassfish.hk2

hk2-locator

2.4.0-b34

org.glassfish.hk2

hk2-utils

2.4.0-b34

org.glassfish.hk2

osgi-resource-locator

1.0.1

org.glassfish.hk2.external

aopalliance-repackaged

2.4.0-b34

org.glassfish.hk2.external

javax.inject

2.4.0-b34

org.glassfish.jersey.bundles.repackaged

jersey-guava

2.22.2

org.glassfish.jersey.containers

jersey-container-servlet

2.22.2

org.glassfish.jersey.containers

jersey-container-servlet-core

2.22.2

org.glassfish.jersey.core

jersey客户端

2.22.2

org.glassfish.jersey.core

jersey-common

2.22.2

org.glassfish.jersey.core

jersey-server

2.22.2

org.glassfish.jersey.media

jersey-media-jaxb

2.22.2

org.hibernate

hibernate验证框架

5.1.1.Final

org.iq80.snappy

时髦的

0.2

org.javassist

javassist

3.18.1-GA

org.jboss.logging

jboss-logging

3.1.3.GA

org.jdbi

jdbi

2.63.1

org.joda

joda-convert

1.7

org.jodd

jodd-core

3.5.2

org.jpmml

pmml模型

1.2.15

org.jpmml

pmml-schema

1.2.15

org.json4s

json4s-ast_2.10

3.2.11

org.json4s

json4s-core_2.10

3.2.11

org.json4s

json4s-jackson_2.10

3.2.11

org.mockito

mockito-all

1.9.5

org.objenesis

objenesis

2.1

org.postgresql

postgresql

9.4 1204 - jdbc41

org.roaringbitmap

RoaringBitmap

0.5.11

org.rocksdb

rocksdbjni

5.2.1

org.rosuda.REngine

REngine

魅惑

org.scala-lang

jline

2.10.6

org.scala-lang

scala-compiler_2.10

2.10.6

org.scala-lang

scala-library_2.10

2.10.6

org.scala-lang

scala-reflect_2.10

2.10.6

org.scala-lang

scalap_2.10

2.10.6

org.scala-sbt

测试界面

1.0

org.scalacheck

scalacheck_2.10

1.12.5

org.scalamacros

quasiquotes_2.10

2.0.0

org.scalanlp

breeze-macros_2.10

0.13.1

org.scalanlp

breeze_2.10

0.13.1

org.scalatest

scalatest_2.10

2.2.6款

org.slf4j

jcl-over-slf4j

1.7.16

org.slf4j

jul-to-slf4j

1.7.16

org.slf4j

slf4j-api

1.7.16

org.slf4j

slf4j-log4j12

1.7.16

org.spark-project.hive

hive-beeline

1.2.1.spark2

org.spark-project.hive

hive-cli

1.2.1.spark2

org.spark-project.hive

hive-exec

1.2.1.spark2

org.spark-project.hive

hive-jdbc

1.2.1.spark2

org.spark-project.hive

hive-metastore

1.2.1.spark2

org.spark-project.spark

未使用的

1.0.0

org.spire-math

spire-macros_2.10

0.13.0

org.spire-math

spire_2.10

0.13.0

org.springframework

spring核心

4.1.4.RELEASE

org.springframework

spring测试

4.1.4.RELEASE

org.tukaani

xz

1.0

org.typelevel

machinist_2.10

0.6.1

org.typelevel

macro-compat_2.10

1.1.1

org.xerial

sqlite-jdbc

3.8.11.2

org.xerial.snappy

snappy-java

1.1.2.6

org.yaml

snakeyaml

1.16

奥罗

奥罗

2.0.8

software.amazon.ion

ion-java

1.0.2中

stax

stax-api

1.0.1

xmlenc

xmlenc

0.52

预先安装的Java和Scala库(Scala 2.11集群版)

组ID

工件ID

版本

antlr

antlr

2.7.7

com.amazonaws

amazon-kinesis-client

1.7.3

com.amazonaws

aws-java-sdk-autoscaling

1.11.126

com.amazonaws

aws-java-sdk-cloudformation

1.11.126

com.amazonaws

aws-java-sdk-cloudfront

1.11.126

com.amazonaws

aws-java-sdk-cloudhsm

1.11.126

com.amazonaws

aws-java-sdk-cloudsearch

1.11.126

com.amazonaws

aws-java-sdk-cloudtrail

1.11.126

com.amazonaws

aws-java-sdk-cloudwatch

1.11.126

com.amazonaws

aws-java-sdk-cloudwatchmetrics

1.11.126

com.amazonaws

aws-java-sdk-codedeploy

1.11.126

com.amazonaws

aws-java-sdk-cognitoidentity

1.11.126

com.amazonaws

aws-java-sdk-cognitosync

1.11.126

com.amazonaws

aws-java-sdk-config

1.11.126

com.amazonaws

aws-java-sdk-core

1.11.126

com.amazonaws

aws-java-sdk-datapipeline

1.11.126

com.amazonaws

aws-java-sdk-directconnect

1.11.126

com.amazonaws

aws-java-sdk-directory

1.11.126

com.amazonaws

aws-java-sdk-dynamodb

1.11.126

com.amazonaws

aws-java-sdk-ec2

1.11.126

com.amazonaws

aws-java-sdk-ecs

1.11.126

com.amazonaws

aws-java-sdk-efs

1.11.126

com.amazonaws

aws-java-sdk-elasticache

1.11.126

com.amazonaws

aws-java-sdk-elasticbeanstalk

1.11.126

com.amazonaws

aws-java-sdk-elasticloadbalancing

1.11.126

com.amazonaws

aws-java-sdk-elastictranscoder

1.11.126

com.amazonaws

aws-java-sdk-emr

1.11.126

com.amazonaws

aws-java-sdk-glacier

1.11.126

com.amazonaws

aws-java-sdk-iam

1.11.126

com.amazonaws

aws-java-sdk-importexport

1.11.126

com.amazonaws

aws-java-sdk-kinesis

1.11.126

com.amazonaws

aws-java-sdk-kms

1.11.126

com.amazonaws

aws-java-sdk-lambda

1.11.126

com.amazonaws

aws-java-sdk-logs

1.11.126

com.amazonaws

aws-java-sdk-machinelearning

1.11.126

com.amazonaws

aws-java-sdk-opsworks

1.11.126

com.amazonaws

aws-java-sdk-rds

1.11.126

com.amazonaws

aws-java-sdk-redshift

1.11.126

com.amazonaws

aws-java-sdk-route53

1.11.126

com.amazonaws

aws-java-sdk-s3

1.11.126

com.amazonaws

aws-java-sdk-ses

1.11.126

com.amazonaws

aws-java-sdk-simpledb

1.11.126

com.amazonaws

aws-java-sdk-simpleworkflow

1.11.126

com.amazonaws

aws-java-sdk-sns

1.11.126

com.amazonaws

aws-java-sdk-sqs

1.11.126

com.amazonaws

aws-java-sdk-ssm

1.11.126

com.amazonaws

aws-java-sdk-storagegateway

1.11.126

com.amazonaws

aws-java-sdk-sts

1.11.126

com.amazonaws

aws-java-sdk-support

1.11.126

com.amazonaws

aws-java-sdk-swf-libraries

1.11.22

com.amazonaws

aws-java-sdk-workspaces

1.11.126

com.amazonaws

jmespath-java

1.11.126

com.carrotsearch

hppc

是0.7.1

com.chuusai

shapeless_2.11

2.3.2

com.clearspring.analytics

2.7.0

com.databricks

Rserve

1.8 - 3

com.databricks

dbml-local_2.11

0.2.0-db4-spark2.2

com.databricks

dbml-local_2.11-tests

0.2.0-db4-spark2.2

com.databricks

jets3t

0.7.1-0

com.databricks.scalapb

compilerplugin_2.11

0.4.15-9

com.databricks.scalapb

scalapb-runtime_2.11

0.4.15-9

com.esotericsoftware

kryo-shaded

3.0.3

com.esotericsoftware

minlog

1.3.0

com.fasterxml

同学

1.0.0

com.fasterxml.jackson.core

jackson-annotations

2.6.5

com.fasterxml.jackson.core

jackson-core

2.6.5

com.fasterxml.jackson.core

jackson-databind

2.6.5

com.fasterxml.jackson.dataformat

jackson-dataformat-cbor

2.6.5

com.fasterxml.jackson.datatype

jackson-datatype-joda

2.6.5

com.fasterxml.jackson.module

jackson-module-paranamer

2.6.5

com.fasterxml.jackson.module

jackson-module-scala_2.11

2.6.5

com.github.fommil

jniloader

1.1

com.github.fommil.netlib

核心

1.1.2

com.github.fommil.netlib

native_ref-java

1.1

com.github.fommil.netlib

native_ref-java-natives

1.1

com.github.fommil.netlib

native_system-java

1.1

com.github.fommil.netlib

native_system-java-natives

1.1

com.github.fommil.netlib

netlib-native_ref-linux-x86_64-natives

1.1

com.github.fommil.netlib

netlib-native_system-linux-x86_64-natives

1.1

com.github.rwl

jtransforms

测试盒框

com.google.code.findbugs

jsr305

2.0.1

com.google.code.gson

gson

2.2.4

com.google.guava

番石榴

15.0

com.google.protobuf

protobuf-java

2.6.1

com.googlecode.javaewah

JavaEWAH

0.3.2

com.h2database

h2

1.3.174

com.jamesmurty.utils

java-xmlbuilder

1.0

com.jcraft

jsch

0.1.50

com.jolbox

bonecp

0.8.0.RELEASE

com.mchange

c3p0

0.9.5.1

com.mchange

mchange-commons-java

0.2.10

com.microsoft.azure

azure-data-lake-store-sdk

)

com.microsoft.sqlserver

mssql-jdbc

6.1.0.jre8

com.ning

compress-lzf

1.0.3

com.sun.mail

javax.mail

1.5.2

com.thoughtworks.paranamer

paranamer

2.6

com.trueaccord.lenses

lenses_2.11

0.3

com.twitter

chill-java

0.8.0

com.twitter

chill_2.11

0.8.0

com.twitter

parquet-hadoop-bundle

1.6.0

com.twitter

util-app_2.11

6.23.0

com.twitter

util-core_2.11

6.23.0

com.twitter

util-jvm_2.11

6.23.0

com.typesafe

配置

1.2.1 "

com.typesafe.scala-logging

scala-logging-api_2.11

2.1.2

com.typesafe.scala-logging

scala-logging-slf4j_2.11

2.1.2

com.univocity

univocity-parsers

2.2.1

com.vlkan

flatbuffers

1.2.0-3f79e055

com.zaxxer

HikariCP

2.4.1

commons-beanutils

commons-beanutils

1.7.0

commons-beanutils

commons-beanutils-core

1.8.0

commons-cli

commons-cli

1.2

commons-codec

commons-codec

1.10

commons-collections

commons-collections

3.2.2

commons configuration

commons configuration

1.6

commons-dbcp

commons-dbcp

1.4

commons-digester

commons-digester

1.8

commons-httpclient

commons-httpclient

3.1

commons-io

commons-io

2.4

commons lang

commons lang

2.6

通用日志

通用日志

1.1.3

commons net

commons net

2.2

commons-pool

commons-pool

1.5.4

info.ganglia.gmetric4j

gmetric4j

1.0.7

io.dropwizard.metrics

metrics-core

3.1.2

io.dropwizard.metrics

metrics-ganglia

3.1.2

io.dropwizard.metrics

metrics-graphite

3.1.2

io.dropwizard.metrics

metrics-healthchecks

3.1.2

io.dropwizard.metrics

metrics-jetty9

3.1.2

io.dropwizard.metrics

metrics-json

3.1.2

io.dropwizard.metrics

metrics-jvm

3.1.2

io.dropwizard.metrics

metrics-log4j

3.1.2

io.dropwizard.metrics

metrics-servlets

3.1.2

io.netty

网状的

3.9.9.Final

io.netty

netty-all

4.0.43.Final

io.prometheus

simpleclient

0.0.16

io.prometheus

simpleclient_common

0.0.16

io.prometheus

simpleclient_dropwizard

0.0.16

io.prometheus

simpleclient_servlet

0.0.16

io.prometheus.jmx

收集器

0.7

javax.activation

激活

1.1.1

javax.annotation

javax.annotation-api

1.2

javax.el

javax.el-api

2.2.4

javax.jdo

jdo api

3.0.1

javax.servlet

javax.servlet-api

3.1.0

javax.servlet.jsp

jsp-api

2.1

javax.transaction

jta

1.1

javax.validation

验证api

1.1.0.Final

javax.ws.rs

javax.ws.rs-api

2.0.1

javax.xml.bind

jaxb-api

2.2.2

javax.xml.stream

stax-api

1.0 - 2

javolution

javolution

5.5.1

jline

jline

2.11

joda-time

joda-time

2.9.3

log4j

apache-log4j-extras

1.2.17

log4j

log4j

1.2.17

mx4j

mx4j

3.0.2

mysql

mysql-connector-java

5.1.27

net.hydromatic

eigenbase-properties

1.1.5

net.iharder

base64

2.3.8

net.java.dev.jets3t

jets3t

0.9.3

net.jpountz.lz4

lz4

1.3.0

net.razorvine

地幔岩

4.13

net.sf.jpam

jpam

1.1

net.sf.opencsv

opencsv

2.3

net.sf.py4j

py4j

0.10.4

net.sf.supercsv

super-csv

2.2.0

net.sourceforge.f2j

arpack_combined_all

0.1

org.acplt

oncrpc

1.0.7

org.antlr

ST4

4.0.4

org.antlr

antlr-runtime

3.4

org.antlr

antlr4-runtime

4.5.3

org.antlr

stringtemplate

3.2.1之上

org.apache.ant

蚂蚁

1.9.2

org.apache.ant

ant-jsch

1.9.2

org.apache.ant

ant-launcher

1.9.2

org.apache.arrow

arrow-format

0.4.0

org.apache.arrow

arrow-memory

0.4.0

org.apache.arrow

arrow-vector

0.4.0

org.apache.avro

avro

1.7.7

org.apache.avro

avro-ipc

1.7.7

org.apache.avro

avro-ipc-tests

1.7.7

org.apache.avro

avro-mapred-hadoop2

1.7.7

org.apache.calcite

calcite-avatica

1.2.0-incubating

org.apache.calcite

calcite-core

1.2.0-incubating

org.apache.calcite

calcite-linq4j

1.2.0-incubating

org.apache.commons

commons-compress

1.4.1

org.apache.commons

commons-crypto

1.0.0

org.apache.commons

commons-lang3

3.5

org.apache.commons

commons-math3

3.4.1

org.apache.curator

curator-client

2.6.0

org.apache.curator

curator-framework

2.6.0

org.apache.curator

curator-recipes

2.6.0

org.apache.derby

德比

10.10.2.0

org.apache.directory.api

api-asn1-api

1.0.0-M20

org.apache.directory.api

api-util

1.0.0-M20

org.apache.directory.server

apacheds-i18n

2.0.0-M15

org.apache.directory.server

apacheds-kerberos-codec

2.0.0-M15

org.apache.hadoop

hadoop-annotations

2.7.3

org.apache.hadoop

hadoop-auth

2.7.3

org.apache.hadoop

hadoop-client

2.7.3

org.apache.hadoop

hadoop-common

2.7.3

org.apache.hadoop

hadoop-hdfs

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-app

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-common

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-core

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-jobclient

2.7.3

org.apache.hadoop

hadoop-mapreduce-client-shuffle

2.7.3

org.apache.hadoop

hadoop-yarn-api

2.7.3

org.apache.hadoop

hadoop-yarn-client

2.7.3

org.apache.hadoop

hadoop-yarn-common

2.7.3

org.apache.hadoop

hadoop-yarn-server-common

2.7.3

org.apache.htrace

htrace-core

3.1.0-incubating

org.apache.httpcomponents

httpclient

4.5.2

org.apache.httpcomponents

httpcore

4.4.4

org.apache.ivy

艾薇

测试盒框

org.apache.parquet

parquet-column

1.8.2

org.apache.parquet

parquet-common

1.8.2

org.apache.parquet

parquet-encoding

1.8.2

org.apache.parquet

parquet-format

2.3.1

org.apache.parquet

parquet-hadoop

1.8.2

org.apache.parquet

parquet-jackson

1.8.2

org.apache.thrift

libfb303

0.9.3

org.apache.thrift

libthrift

0.9.3

org.apache.xbean

xbean-asm5-shaded

4.4

org.apache.zookeeper

动物园管理员

3.4.6

org.bouncycastle

bcprov-jdk15on

1.51

org.codehaus.jackson

jackson-core-asl

1.9.13

org.codehaus.jackson

jackson-jaxrs

1.9.13

org.codehaus.jackson

jackson-mapper-asl

1.9.13

org.codehaus.jackson

jackson-xc

1.9.13

org.codehaus.janino

commons-compiler

3.0.0

org.codehaus.janino

janino

3.0.0

org.datanucleus

datanucleus-api-jdo

3.2.6

org.datanucleus

datanucleus-core

3.2.10

org.datanucleus

datanucleus-rdbms

3.2.9

org.eclipse.jetty

jetty-client

9.3.11.v20160721

org.eclipse.jetty

jetty-continuation

9.3.11.v20160721

org.eclipse.jetty

jetty-http

9.3.11.v20160721

org.eclipse.jetty

jetty-io

9.3.11.v20160721

org.eclipse.jetty

jetty-jndi

9.3.11.v20160721

org.eclipse.jetty

jetty-plus

9.3.11.v20160721

org.eclipse.jetty

jetty-proxy

9.3.11.v20160721

org.eclipse.jetty

jetty-security

9.3.11.v20160721

org.eclipse.jetty

jetty服务器

9.3.11.v20160721

org.eclipse.jetty

jetty servlet

9.3.11.v20160721

org.eclipse.jetty

jetty-servlets

9.3.11.v20160721

org.eclipse.jetty

jetty-util

9.3.11.v20160721

org.eclipse.jetty

jetty-webapp

9.3.11.v20160721

org.eclipse.jetty

jetty-xml

9.3.11.v20160721

org.fusesource.leveldbjni

leveldbjni-all

1.8

org.glassfish.hk2

hk2-api

2.4.0-b34

org.glassfish.hk2

hk2-locator

2.4.0-b34

org.glassfish.hk2

hk2-utils

2.4.0-b34

org.glassfish.hk2

osgi-resource-locator

1.0.1

org.glassfish.hk2.external

aopalliance-repackaged

2.4.0-b34

org.glassfish.hk2.external

javax.inject

2.4.0-b34

org.glassfish.jersey.bundles.repackaged

jersey-guava

2.22.2

org.glassfish.jersey.containers

jersey-container-servlet

2.22.2

org.glassfish.jersey.containers

jersey-container-servlet-core

2.22.2

org.glassfish.jersey.core

jersey客户端

2.22.2

org.glassfish.jersey.core

jersey-common

2.22.2

org.glassfish.jersey.core

jersey-server

2.22.2

org.glassfish.jersey.media

jersey-media-jaxb

2.22.2

org.hibernate

hibernate验证框架

5.1.1.Final

org.iq80.snappy

时髦的

0.2

org.javassist

javassist

3.18.1-GA

org.jboss.logging

jboss-logging

3.1.3.GA

org.jdbi

jdbi

2.63.1

org.joda

joda-convert

1.7

org.jodd

jodd-core

3.5.2

org.jpmml

pmml模型

1.2.15

org.jpmml

pmml-schema

1.2.15

org.json4s

json4s-ast_2.11

3.2.11

org.json4s

json4s-core_2.11

3.2.11

org.json4s

json4s-jackson_2.11

3.2.11

org.mockito

mockito-all

1.9.5

org.objenesis

objenesis

2.1

org.postgresql

postgresql

9.4 1204 - jdbc41

org.roaringbitmap

RoaringBitmap

0.5.11

org.rocksdb

rocksdbjni

5.2.1

org.rosuda.REngine

REngine

魅惑

org.scala-lang

scala-compiler_2.11

2.11.8

org.scala-lang

scala-library_2.11

2.11.8

org.scala-lang

scala-reflect_2.11

2.11.8

org.scala-lang

scalap_2.11

2.11.8

org.scala-lang.modules

scala-parser-combinators_2.11

1.0.2中

org.scala-lang.modules

scala-xml_2.11

1.0.2中

org.scala-sbt

测试界面

1.0

org.scalacheck

scalacheck_2.11

1.12.5

org.scalanlp

breeze-macros_2.11

0.13.1

org.scalanlp

breeze_2.11

0.13.1

org.scalatest

scalatest_2.11

2.2.6款

org.slf4j

jcl-over-slf4j

1.7.16

org.slf4j

jul-to-slf4j

1.7.16

org.slf4j

slf4j-api

1.7.16

org.slf4j

slf4j-log4j12

1.7.16

org.spark-project.hive

hive-beeline

1.2.1.spark2

org.spark-project.hive

hive-cli

1.2.1.spark2

org.spark-project.hive

hive-exec

1.2.1.spark2

org.spark-project.hive

hive-jdbc

1.2.1.spark2

org.spark-project.hive

hive-metastore

1.2.1.spark2

org.spark-project.spark

未使用的

1.0.0

org.spire-math

spire-macros_2.11

0.13.0

org.spire-math

spire_2.11

0.13.0

org.springframework

spring核心

4.1.4.RELEASE

org.springframework

spring测试

4.1.4.RELEASE

org.tukaani

xz

1.0

org.typelevel

machinist_2.11

0.6.1

org.typelevel

macro-compat_2.11

1.1.1

org.xerial

sqlite-jdbc

3.8.11.2

org.xerial.snappy

snappy-java

1.1.2.6

org.yaml

snakeyaml

1.16

奥罗

奥罗

2.0.8

software.amazon.ion

ion-java

1.0.2中

stax

stax-api

1.0.1

xmlenc

xmlenc

0.52