class SampleSCollectionFunctions[T] extends AnyRef
- Alphabetic
- By Inheritance
- SampleSCollectionFunctions
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new SampleSCollectionFunctions(self: SCollection[T])
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def sample(withReplacement: Boolean, fraction: Double): SCollection[T]
Return a sampled subset of this SCollection.
Return a sampled subset of this SCollection. Does not trigger shuffling.
- withReplacement
if
true
the same element can be produced more than once, otherwise the same element will be sampled only once- fraction
the sampling fraction
- def sample(sampleSize: Int): SCollection[Iterable[T]]
Return a sampled subset of this SCollection containing exactly
sampleSize
items.Return a sampled subset of this SCollection containing exactly
sampleSize
items. Involves combine operation resulting in shuffling. All the elements of the output should fit into main memory of a single worker machine.- returns
a new SCollection whose single value is an
Iterable
of the samples
- def sampleByteSized(totalByteSize: Long): SCollection[Iterable[T]]
Return a sampled subset of this SCollection containing at most serializable
totalByteSize
.Return a sampled subset of this SCollection containing at most serializable
totalByteSize
. Involves combine operation resulting in shuffling. All the elements of the output should fit into main memory of a single worker machine.- returns
a new SCollection whose single value is an
Iterable
of the samples
- def sampleWeighted(totalWeight: Long, cost: (T) => Long): SCollection[Iterable[T]]
Return a sampled subset of this SCollection containing weighted items with at most
totalWeight
sum.Return a sampled subset of this SCollection containing weighted items with at most
totalWeight
sum. Involves combine operation resulting in shuffling. All the elements of the output should fit into main memory of a single worker machine.- returns
a new SCollection whose single value is an
Iterable
of the samples
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()