Packages

•  package root

  Definition Classes

  root

•  package com

  Definition Classes

  root

•  package spotify

  Definition Classes

  com

•  package scio

  Definition Classes

  spotify

•  package extra

  Definition Classes

  scio

•  package csv

  Main package for CSV type-safe APIs.

  Main package for CSV type-safe APIs. Import all.

  import com.spotify.scio.extra.csv._

  Definition Classes

  extra

•  object CsvIO

  This package uses a CSV mapper called Kantan.

  This package uses a CSV mapper called Kantan.

  import the following:

  import kantan.csv._
  import com.spotify.scio.extra.csv._

  Reading

  with a header

  Kantan docs

  case class User(name: String, age: Int)
  implicit val decoder = HeaderDecoder.decoder("fullName", "userAge")(User.apply _)
  val users: SCollection[User] = scioContext.csvFile(path)

  without a header

  Kantan docs

  case class User(name: String, age: Int)
  implicit val decoder = RowDecoder.ordered { (name: String, age: Int) => User(name, age) }
  val csvConfiguration = CsvIO.ReadParam(csvConfiguration = CsvIO.DefaultCsvConfiguration.withoutHeader)
  val users: SCollection[User] = scioContext.csvFile(path, csvConfiguration)

  Writing

  with a header

  Kantan docs

  case class User(name: String, age: Int)
  implicit val encoder = HeaderEncoder.caseEncoder("fullName", "age")(User.unapply)
  
  val users: SCollection[User] = ???
  users.saveAsCsvFile(path)

  without a header

  Kantan docs

  case class User(name: String, age: Int)
  implicit val encoder = RowEncoder.encoder(0, 1)((u: User) => (u.name, u.age))
  
  val users: SCollection[User] = ???
  users.saveAsCsvFile(path)

  Definition Classes

  csv

• Read
• ReadParam
• ReadWrite
• Write
• WriteParam

com.spotify.scio.extra.csv.CsvIO

ReadParam

Companion object ReadParam