org.apache.flink.connectors.hive.read

Class HiveTableFileInputFormat

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,org.apache.flink.core.fs.FileInputSplit>

org.apache.flink.api.common.io.FileInputFormat<org.apache.flink.table.data.RowData>

org.apache.flink.connectors.hive.read.HiveTableFileInputFormat

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>, org.apache.flink.core.io.InputSplitSource<org.apache.flink.core.fs.FileInputSplit>

public class HiveTableFileInputFormat
extends org.apache.flink.api.common.io.FileInputFormat<org.apache.flink.table.data.RowData>

A FileInputFormat that wraps a HiveTableInputFormat.

We only use a HiveTableInputFormat to read the data of a FileInputSplit. `createInputSplits`, `getInputSplitAssigner` will use FileInputFormat's logic.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.common.io.FileInputFormat

org.apache.flink.api.common.io.FileInputFormat.FileBaseStatistics, org.apache.flink.api.common.io.FileInputFormat.InputSplitOpenThread

Field Summary

Fields inherited from class org.apache.flink.api.common.io.FileInputFormat

currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

Constructor Summary

Constructors

Constructor and Description
HiveTableFileInputFormat(HiveTableInputFormat inputFormat, HiveTablePartition hiveTablePartition)

Method Summary

Modifier and Type	Method and Description
void	close()
void	closeInputFormat()
void	configure(org.apache.flink.configuration.Configuration parameters)
org.apache.flink.table.data.RowData	nextRecord(org.apache.flink.table.data.RowData reuse)
void	open(org.apache.flink.core.fs.FileInputSplit fileSplit)
void	openInputFormat()
boolean	reachedEnd()
void	setRuntimeContext(org.apache.flink.api.common.functions.RuntimeContext t)

Methods inherited from class org.apache.flink.api.common.io.FileInputFormat

acceptFile, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFilePaths, getFileStats, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, getStatistics, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilePaths, setFilePaths, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, supportsMultiPaths, testForUnsplittable, toString

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

getRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

HiveTableFileInputFormat

public HiveTableFileInputFormat(HiveTableInputFormat inputFormat,
                                HiveTablePartition hiveTablePartition)

Method Detail

open

public void open(org.apache.flink.core.fs.FileInputSplit fileSplit)
          throws IOException

Specified by:

open in interface org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>

Overrides:

open in class org.apache.flink.api.common.io.FileInputFormat<org.apache.flink.table.data.RowData>

Throws:

IOException

reachedEnd

public boolean reachedEnd()
                   throws IOException

Throws:

IOException

nextRecord

public org.apache.flink.table.data.RowData nextRecord(org.apache.flink.table.data.RowData reuse)
                                               throws IOException

Throws:

IOException

configure

public void configure(org.apache.flink.configuration.Configuration parameters)

Specified by:

configure in interface org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>

Overrides:

configure in class org.apache.flink.api.common.io.FileInputFormat<org.apache.flink.table.data.RowData>

close

public void close()
           throws IOException

Specified by:

close in interface org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>

Overrides:

close in class org.apache.flink.api.common.io.FileInputFormat<org.apache.flink.table.data.RowData>

Throws:

IOException

setRuntimeContext

public void setRuntimeContext(org.apache.flink.api.common.functions.RuntimeContext t)

Overrides:

setRuntimeContext in class org.apache.flink.api.common.io.RichInputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>

openInputFormat

public void openInputFormat()
                     throws IOException

Overrides:

openInputFormat in class org.apache.flink.api.common.io.RichInputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>

Throws:

IOException

closeInputFormat

public void closeInputFormat()
                      throws IOException

Overrides:

closeInputFormat in class org.apache.flink.api.common.io.RichInputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>

Throws:

IOException