Works with HDFS for common operations and Scala compatibility.
Package is under com.globo.bigdata.ghdfs
- Include in your dependencies:
"com.globo.bigdata" %% "ghdfs" % "0.0.13"
val hdfs = HdfsManager(Properties.envOrNone("HADOOP_CONF_DIR"))
hdfs.write(Path)
hdfs.write(Path, InputStream)
hdfs.read(Path)
hdfs.status(Path)
hdfs.move(Path, Path)
hdfs.listFiles(Path, recursive = false).foreach(...)
hdfs.delete(Path, recursive = true)
etc...
hdfs.getFS.exists(hadoopPath)
For development and contributing, please follow Contributing Guide and ALWAYS respect the Code of Conduct