org.apache.flink.connectors.hive.read

类 HiveTableInputFormat

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<T,SPITTYPE>

org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<org.apache.flink.table.dataformat.BaseRow,HiveTableInputSplit>

org.apache.flink.connectors.hive.read.HiveTableInputFormat

所有已实现的接口:

Serializable, org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.dataformat.BaseRow,HiveTableInputSplit>, org.apache.flink.core.io.InputSplitSource<HiveTableInputSplit>

public class HiveTableInputFormat
extends org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<org.apache.flink.table.dataformat.BaseRow,HiveTableInputSplit>

The HiveTableInputFormat are inspired by the HCatInputFormat and HadoopInputFormatBase. It's used to read from hive partition/non-partition table.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected SplitReader	reader

从类继承的字段 org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

credentials

构造器概要

构造器

构造器和说明
HiveTableInputFormat(org.apache.hadoop.mapred.JobConf jobConf, org.apache.flink.table.catalog.CatalogTable catalogTable, List<HiveTablePartition> partitions, int[] projectedFields, long limit, String hiveVersion, boolean useMapRedReader)

方法概要

限定符和类型	方法和说明
void	close()
void	configure(org.apache.flink.configuration.Configuration parameters)
HiveTableInputSplit[]	createInputSplits(int minNumSplits)
org.apache.flink.core.io.InputSplitAssigner	getInputSplitAssigner(HiveTableInputSplit[] inputSplits)
org.apache.flink.api.common.io.statistics.BaseStatistics	getStatistics(org.apache.flink.api.common.io.statistics.BaseStatistics cachedStats)
org.apache.flink.table.dataformat.BaseRow	nextRecord(org.apache.flink.table.dataformat.BaseRow reuse)
void	open(HiveTableInputSplit split)
boolean	reachedEnd()

从类继承的方法 org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

getCredentialsFromUGI, read, write

从类继承的方法 org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

reader

@VisibleForTesting
protected transient SplitReader reader

构造器详细资料

HiveTableInputFormat

public HiveTableInputFormat(org.apache.hadoop.mapred.JobConf jobConf,
                            org.apache.flink.table.catalog.CatalogTable catalogTable,
                            List<HiveTablePartition> partitions,
                            int[] projectedFields,
                            long limit,
                            String hiveVersion,
                            boolean useMapRedReader)

方法详细资料

configure

public void configure(org.apache.flink.configuration.Configuration parameters)

open

public void open(HiveTableInputSplit split)
          throws IOException

抛出:

IOException

reachedEnd

public boolean reachedEnd()
                   throws IOException

抛出:

IOException

nextRecord

public org.apache.flink.table.dataformat.BaseRow nextRecord(org.apache.flink.table.dataformat.BaseRow reuse)
                                                     throws IOException

抛出:

IOException

close

public void close()
           throws IOException

抛出:

IOException

createInputSplits

public HiveTableInputSplit[] createInputSplits(int minNumSplits)
                                        throws IOException

抛出:

IOException

getStatistics

public org.apache.flink.api.common.io.statistics.BaseStatistics getStatistics(org.apache.flink.api.common.io.statistics.BaseStatistics cachedStats)

getInputSplitAssigner

public org.apache.flink.core.io.InputSplitAssigner getInputSplitAssigner(HiveTableInputSplit[] inputSplits)