Terasort-like benchmark for spark 2.x that uses dataframes, saves files in parquet etc for a more realistic testing.
Scala versions:
2.11
sparkbench 1.0
Group ID:
com.bigstep
Artifact ID:
sparkbench_2.11
Version:
1.0
Release Date:
Jul 12, 2018
Licenses:
Files:
Full Scala Version:
2.11.12
Developers:
libraryDependencies += "com.bigstep" %% "sparkbench" % "1.0"
ivy"com.bigstep::sparkbench:1.0"
//> using dep "com.bigstep::sparkbench:1.0"
import $ivy.`com.bigstep::sparkbench:1.0`
<dependency> <groupId>com.bigstep</groupId> <artifactId>sparkbench_2.11</artifactId> <version>1.0</version> </dependency>
compile group: 'com.bigstep', name: 'sparkbench_2.11', version: '1.0'