final class DynamicParquetExampleSCollectionOps extends AnyVal
- Source
- SCollectionSyntax.scala
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- DynamicParquetExampleSCollectionOps
- AnyVal
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Instance Constructors
- new DynamicParquetExampleSCollectionOps(self: SCollection[Example])
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- Any
- final def ##: Int
- Definition Classes
- Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def getClass(): Class[_ <: AnyVal]
- Definition Classes
- AnyVal → Any
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def saveAsDynamicParquetExampleFile(path: String, schema: Schema, numShards: Int = ParquetExampleIO.WriteParam.DefaultNumShards, suffix: String = ParquetExampleIO.WriteParam.DefaultSuffix, compression: CompressionCodecName = ParquetExampleIO.WriteParam.DefaultCompression, conf: Configuration = ParquetExampleIO.WriteParam.DefaultConfiguration, tempDirectory: String = ParquetExampleIO.WriteParam.DefaultTempDirectory, prefix: String = ParquetExampleIO.WriteParam.DefaultPrefix)(destinationFn: (Example) => String): ClosedTap[Nothing]
Save this SCollection of Example records as a Parquet files written to dynamic destinations.
- def toString(): String
- Definition Classes
- Any