org.wikimedia.gobblin.utils

Class JsonStringTimestampExtractor

java.lang.Object

org.wikimedia.gobblin.utils.JsonStringTimestampExtractor

public class JsonStringTimestampExtractor
extends Object

A utility class parsing JSON from byte[] ans extracting a timestamp from the data. The class provides static functions to initialize both the timestamp and the timestamp-format fields from a WriterPartitioner. If a record doesn't contain the specified field, or if no field is specified, the current timestamp will be used. Accepted formats are:

• unix (same as unix_seconds)
• unix_seconds
• unix_milliseconds
• ISO_8601
• CUSTOM - Using the timestampCustomFormat parameter (can be empty for other values)

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	JsonStringTimestampExtractor.TimestampFormat

Constructor Summary

Constructors

Constructor and Description
JsonStringTimestampExtractor(Collection<String> timestampPointers, String timestampFormat)

Method Summary

Modifier and Type	Method and Description
long	getRecordTimestamp(String payload)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JsonStringTimestampExtractor

public JsonStringTimestampExtractor(Collection<String> timestampPointers,
                                    String timestampFormat)

Method Detail

getRecordTimestamp

public long getRecordTimestamp(String payload)