Project Dependency Management

compile

The following is a list of compile dependencies in the DependencyManagement of this project. These dependencies can be included in the submodules to compile and run the submodule:

GroupId ArtifactId Version Type License
args4j args4j 2.0.29 jar MIT License
com.amazon.deequ deequ 2.0.4-spark-3.1 jar Apache License, Version 2.0
com.chuusai shapeless_2.12 2.3.3 jar Apache 2
com.criteo rsvd 1.0-spark3 jar Apache License 2.0
com.datastax.spark spark-cassandra-connector_2.12 3.1.0 jar Apache 2
com.fasterxml.jackson.core jackson-databind 2.10.0 jar The Apache Software License, Version 2.0
com.fasterxml.jackson.dataformat jackson-dataformat-yaml 2.10.0 jar The Apache Software License, Version 2.0
com.github.ben-manes.caffeine caffeine 2.9.3 jar Apache License, Version 2.0
com.github.nscala-time nscala-time_2.12 2.26.0 jar Apache
com.github.scopt scopt_2.12 3.5.0 jar MIT License
com.github.ua-parser uap-java 1.5.3 jar The Apache License, Version 2.0
com.googlecode.json-simple json-simple 1.1.1 jar The Apache Software License, Version 2.0
com.maxmind.geoip2 geoip2 2.5.0 jar Apache License, Version 2.0
com.outr profig-macros_2.12 2.3.8 jar MIT
com.outr profig_2.12 2.3.8 jar MIT
com.sun.mail javax.mail 1.6.2 jar CDDL/GPLv2+CE
commons-codec commons-codec 1.15 jar Apache License, Version 2.0
commons-validator commons-validator 1.4.1 jar Apache License, Version 2.0
graphframes graphframes 0.8.1-spark3.0-s_2.12 jar Apache-2.0
io.circe circe-core_2.12 0.13.0 jar Apache 2.0
io.circe circe-generic-extras_2.12 0.13.0 jar Apache 2.0
io.circe circe-generic_2.12 0.13.0 jar Apache 2.0
joda-time joda-time 2.10.8 jar Apache License, Version 2.0
org.apache.commons commons-lang3 3.5 jar Apache License, Version 2.0
org.apache.httpcomponents httpclient 4.5.12 jar Apache License, Version 2.0
org.apache.httpcomponents httpcore 4.4.13 jar Apache License, Version 2.0
org.apache.lucene lucene-analyzers-common 5.5.3 jar Apache 2
org.apache.spark spark-avro_2.12 3.1.2 jar Apache 2.0 License
org.apache.spark spark-graphx_2.12 3.1.2 jar Apache 2.0 License
org.apache.spark spark-mllib_2.12 3.1.2 jar Apache 2.0 License
org.reflections reflections 0.9.7 jar WTFPL
org.scala-lang scala-reflect 2.12.4 jar BSD 3-Clause
org.springframework.security spring-security-web 3.2.5.RELEASE jar The Apache Software License, Version 2.0
org.typelevel cats-core_2.12 2.1.0 jar MIT
org.wikimedia eventutilities-shaded 1.3.4 jar The Apache Software License, Version 2.0
org.wikimedia eventutilities-spark 1.3.4 jar The Apache Software License, Version 2.0
org.wikimedia.analytics.refinery.core refinery-core 0.2.35-SNAPSHOT jar Apache License 2.0
org.wikimedia.analytics.refinery.spark refinery-spark 0.2.35-SNAPSHOT jar Apache License 2.0
org.wikimedia.analytics.refinery.tools refinery-tools 0.2.35-SNAPSHOT jar Apache License 2.0
org.yaml snakeyaml 1.20 jar Apache License, Version 2.0

test

The following is a list of test dependencies in the DependencyManagement of this project. These dependencies can be included in the submodules to compile and run unit tests for the submodule:

GroupId ArtifactId Version Type License
com.holdenkarau spark-testing-base_2.12 3.1.1_1.1.0 jar Apache License 2.0
io.netty netty-all 4.1.56.Final jar Apache License, Version 2.0
junit junit 4.13.1 jar Eclipse Public License 1.0
org.scalactic scalactic_2.12 3.0.5 jar the Apache License, ASL Version 2.0
org.scalamock scalamock-scalatest-support_2.12 3.6.0 jar MIT
org.scalatest scalatest_2.12 3.0.5 jar the Apache License, ASL Version 2.0
org.xerial.snappy snappy-java 1.1.2.5 jar The Apache Software License, Version 2.0
pl.pragmatists JUnitParams 1.0.3 jar Apache 2

provided

The following is a list of provided dependencies in the DependencyManagement of this project. These dependencies can be included in the submodules to compile the submodule, but should be provided by default when using the library:

GroupId ArtifactId Version Type License
com.github.spotbugs spotbugs-annotations 4.1.2 jar GNU LESSER GENERAL PUBLIC LICENSE, Version 2.1
javax.servlet javax.servlet-api 3.0.1 jar CDDL + GPLv2 with classpath exception
log4j log4j 1.2.17 jar The Apache Software License, Version 2.0
org.apache.hadoop hadoop-annotations 2.10.1 jar Apache License, Version 2.0
org.apache.hadoop hadoop-client 2.10.1 jar Apache License, Version 2.0
org.apache.hadoop hadoop-common 2.10.1 jar Apache License, Version 2.0
org.apache.hadoop hadoop-hdfs 2.10.1 jar Apache License, Version 2.0
org.apache.hive hive-cli 2.3.6 jar The Apache Software License, Version 2.0
org.apache.hive hive-exec 2.3.6 jar The Apache Software License, Version 2.0
org.apache.hive hive-jdbc 2.3.6 jar The Apache Software License, Version 2.0
org.apache.iceberg iceberg-spark-runtime-3.1_2.12 1.2.1 jar The Apache Software License, Version 2.0
org.apache.spark spark-core_2.12 3.1.2 jar Apache 2.0 License
org.apache.spark spark-hive-thriftserver_2.12 3.1.2 jar Apache 2.0 License
org.apache.spark spark-hive_2.12 3.1.2 jar Apache 2.0 License
org.apache.spark spark-sql_2.12 3.1.2 jar Apache 2.0 License
org.apache.spark spark-streaming_2.12 3.1.2 jar Apache 2.0 License
org.scala-lang scala-library 2.12.10 jar Apache-2.0