Terasort-like benchmark for spark 2.x that uses dataframes, saves files in parquet etc for a more realistic testing.
Scala versions:
2.11
sparkbench 1.0.14
Group ID:
com.bigstep
Artifact ID:
sparkbench_2.11
Version:
1.0.14
Release Date:
Jul 13, 2018
Licenses:
Files:
Full Scala Version:
2.11.12
Developers:
libraryDependencies += "com.bigstep" %% "sparkbench" % "1.0.14"
ivy"com.bigstep::sparkbench:1.0.14"
//> using dep "com.bigstep::sparkbench:1.0.14"
import $ivy.`com.bigstep::sparkbench:1.0.14`
<dependency> <groupId>com.bigstep</groupId> <artifactId>sparkbench_2.11</artifactId> <version>1.0.14</version> </dependency>
compile group: 'com.bigstep', name: 'sparkbench_2.11', version: '1.0.14'