Serialized Form

Package org.wikimedia.eventutilities.flink

Class org.wikimedia.eventutilities.flink.EventRowSerializer extends org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.types.Row> implements Serializable

Serialization Methods

readObject

private void readObject(ObjectInputStream in)
                 throws IOException,
                        ClassNotFoundException

Called during java deserialization. We need this because we have two transient fields, constructor and field initial values are not applied when restoring an object and thus these two fields would remain null if we did not explicitly set them when restoring this object state.

Throws:

IOException

ClassNotFoundException

Serialized Fields

fieldSerializers

org.apache.flink.api.common.typeutils.TypeSerializer<T>[] fieldSerializers

positionByName

LinkedHashMap<K,V> positionByName

Class org.wikimedia.eventutilities.flink.EventRowTypeInfo extends org.apache.flink.api.java.typeutils.RowTypeInfo implements Serializable

Serialized Fields

positionByName

LinkedHashMap<K,V> positionByName

aliasedRowKey

TreeMap<K,V> aliasedRowKey

keyTypeInfo

EventRowTypeInfo keyTypeInfo

Package org.wikimedia.eventutilities.flink.formats.json

Class org.wikimedia.eventutilities.flink.formats.json.JsonRowDataSerializationSchema extends Object implements Serializable

serialVersionUID:

1L

Serialized Fields

rowType

org.apache.flink.table.types.logical.RowType rowType

RowType to generate the runtime converter.

normalization

Function<T,R> normalization

Event generator responsible for fetching the schema and validating the event against it.

runtimeConverter

RowDataToJsonConverters.RowDataToJsonConverter runtimeConverter

The converter that converts internal data formats to JsonNode.

mapper

com.fasterxml.jackson.databind.ObjectMapper mapper

Object mapper that is used to create output JSON objects.

timestampFormat

org.apache.flink.formats.common.TimestampFormat timestampFormat

Timestamp format specification which is used to parse timestamp.

mapNullKeyMode

org.apache.flink.formats.json.JsonFormatOptions.MapNullKeyMode mapNullKeyMode

The handling mode when serializing null keys for map data.

mapNullKeyLiteral

String mapNullKeyLiteral

The string literal when handling mode for map null key LITERAL.

encodeDecimalAsPlainNumber

boolean encodeDecimalAsPlainNumber

Flag indicating whether to serialize all decimals as plain numbers.

Class org.wikimedia.eventutilities.flink.formats.json.JsonRowDeserializationSchema extends Object implements Serializable

serialVersionUID:

-228294330688809195L

Serialized Fields

typeInfo

org.apache.flink.api.java.typeutils.RowTypeInfo typeInfo

Type information describing the result type.

failOnMissingField

boolean failOnMissingField

objectMapper

com.fasterxml.jackson.databind.ObjectMapper objectMapper

Object mapper for parsing the JSON.

runtimeConverter

org.wikimedia.eventutilities.flink.formats.json.JsonRowDeserializationSchema.DeserializationRuntimeConverter runtimeConverter

ignoreParseErrors

boolean ignoreParseErrors

Flag indicating whether to ignore invalid fields/rows (default: throw an exception).

rowFieldMode

JsonRowDeserializationSchema.RowFieldMode rowFieldMode

'field mode' of deserialized Rows. See Row documentation for more info.

Class org.wikimedia.eventutilities.flink.formats.json.JsonRowSerializationSchema extends Object implements Serializable

serialVersionUID:

-2885556750743978636L

Serialized Fields

typeInfo

org.apache.flink.api.java.typeutils.RowTypeInfo typeInfo

Type information describing the input type.

normalization

Function<T,R> normalization

Event generator responsible for fetching the schema and validating the event against it.

runtimeConverter

org.wikimedia.eventutilities.flink.formats.json.JsonRowSerializationSchema.SerializationRuntimeConverter runtimeConverter

mapper

com.fasterxml.jackson.databind.ObjectMapper mapper

Class org.wikimedia.eventutilities.flink.formats.json.KafkaEventSerializationSchema extends Object implements Serializable

Serialized Fields

topic

String topic

partitioner

org.apache.flink.streaming.connectors.kafka.partitioner.FlinkKafkaPartitioner<T> partitioner

serializationSchema

org.apache.flink.api.common.serialization.SerializationSchema<T> serializationSchema

ingestionTimeClock

SerializableClock ingestionTimeClock

eventRowTypeInfo

EventRowTypeInfo eventRowTypeInfo

timestampStrategy

KafkaRecordTimestampStrategy timestampStrategy

jsonKeySerializer

JsonRowSerializationSchema jsonKeySerializer

Class org.wikimedia.eventutilities.flink.formats.json.RowDataToJsonConverters extends Object implements Serializable

serialVersionUID:

1L

Serialized Fields

timestampFormat

org.apache.flink.formats.common.TimestampFormat timestampFormat

Timestamp format specification which is used to parse timestamp.

mapNullKeyMode

org.apache.flink.formats.json.JsonFormatOptions.MapNullKeyMode mapNullKeyMode

The handling mode when serializing null keys for map data.

mapNullKeyLiteral

String mapNullKeyLiteral

The string literal when handling mode for map null key LITERAL. is

Package org.wikimedia.eventutilities.flink.stream

Class org.wikimedia.eventutilities.flink.stream.FileSinkJsonRowEncoder extends Object implements Serializable

serialVersionUID:

1L

Serialized Fields

serializationSchema

org.apache.flink.api.common.serialization.SerializationSchema<T> serializationSchema

ingestionTimeClock

SerializableClock ingestionTimeClock

eventRowTypeInfo

EventRowTypeInfo eventRowTypeInfo

Class org.wikimedia.eventutilities.flink.stream.LineStreamFormat extends org.apache.flink.connector.file.src.reader.SimpleStreamFormat<T> implements Serializable

serialVersionUID:

1L

Serialized Fields

deserializationSchema

org.apache.flink.api.common.serialization.DeserializationSchema<T> deserializationSchema

Class org.wikimedia.eventutilities.flink.stream.SSESourceFunction extends Object implements Serializable

serialVersionUID:

1L

Serialized Fields

endpoint

URI endpoint

deserializer

org.apache.flink.api.common.serialization.DeserializationSchema<T> deserializer