Packages

trait KinesisWriter extends ConnectorWriter

Write a batch DataFrame to Kinesis using record batching. The following parameters are expected: streamName The Kinesis stream name region The region of the Kinesis stream dataFrame The DataFrame to write partitionKey The static partition key to use partitionKeyIndex The field index in the DataFrame row containing the value to use as the partition key separator The field separator to use when formatting the row data credential An optional credential to use to authenticate to Kinesis

Linear Supertypes
ConnectorWriter, Serializable, Serializable, AnyRef, Any
Known Subclasses
BatchKinesisWriter, StructuredStreamingKinesisSink
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. KinesisWriter
  2. ConnectorWriter
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def credential: Option[AWSCredential]
  2. abstract def partitionKey: Option[String]
  3. abstract def partitionKeyIndex: Option[Int]
  4. abstract def region: String
  5. abstract def separator: String
  6. abstract def streamName: String

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. val buffer: ArrayBuffer[PutRecordsRequestEntry]
    Attributes
    protected
  6. val bufferSize: Long
    Attributes
    protected
  7. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  8. def close(): Unit
    Definition Classes
    KinesisWriter → ConnectorWriter
  9. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. val kinesisClient: AmazonKinesis
    Attributes
    protected
  16. val maxBufferSize: Int
  17. val maxRecords: Int
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. def open(): Unit
    Definition Classes
    KinesisWriter → ConnectorWriter
  22. def process(value: Row): Unit
    Definition Classes
    KinesisWriter → ConnectorWriter
  23. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  24. def toString(): String
    Definition Classes
    AnyRef → Any
  25. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from ConnectorWriter

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped