Packages

  • package root
    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package spotify
    Definition Classes
    com
  • package scio
    Definition Classes
    spotify
  • package extra
    Definition Classes
    scio
  • object Iterators

    Utilities for Scala iterators.

    Utilities for Scala iterators.

    Adds a timeSeries method to Iterator[T] so that it can be windowed with different logic.

    import com.spotify.scio.extra.Iterators._

case class Event(user: String, action: String, timestamp: Long)
val i: Iterator[Event] = // ...

// 60 minutes fixed windows offset by 30 minutes
// E.g. minute [30, 90), [90, 120), [120, 150), [150, 180) ...
i.timeSeries(_.timestamp).fixed(3600000, 1800000)

// session windows with 60 minute gaps between windows
i.timeSeries(_.timestamp).session(3600000)

// 60 minutes sliding windows, one every 10 minutes, offset by 5 minutes
// E.g. minute [5, 65), [15, 75), [25, 85), [35, 95) ...
i.timeSeries(_.timestamp).session(3600000, 600000, 300000)
    Definition Classes
    extra
  • RichIterator
  • TimeSeriesIterator

implicit final class RichIterator[T] extends AnyVal

Enhance Iterator by adding a timeSeries method.

Source
Iterators.scala
Linear Supertypes
AnyVal, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RichIterator
  2. AnyVal
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new RichIterator(self: Iterator[T])

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    Any
  2. final def ##: Int
    Definition Classes
    Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def getClass(): Class[_ <: AnyVal]
    Definition Classes
    AnyVal → Any
  6. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  7. def timeSeries(timestampFn: (T) => Long): TimeSeriesIterator[T]

    Convert this iterator to a TimeSeriesIterator.

    Convert this iterator to a TimeSeriesIterator.

    timestampFn

    function to extract timestamp.

  8. def toString(): String
    Definition Classes
    Any

Inherited from AnyVal

Inherited from Any

Ungrouped