RBENREJEB@RBR-OS:/USR/SHARE/DOC/NETCDF-SPARK-PARSER/USAGE$ CAT README

Usage

NetCDF Spark Parser · Documentation

Program page Source on GitHub

This chapter is being written. Until it is ready, see the README on GitHub.

Reading a local file

val schema = StructType(Seq(
  StructField("temperature", FloatType),
  StructField("humidity", FloatType),
  StructField("timestamp", StringType)
))

val df = spark.read.format("netcdf")
  .schema(schema)
  .option("path", "/path/to/your/netcdf-file.nc")
  .load()

Reading from Amazon S3

Partitioning large files