org.apache.flink.connectors.hive.read

类 HiveTableInputFormat

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<T,SPITTYPE>

org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<org.apache.flink.table.data.RowData,HiveTableInputSplit>

org.apache.flink.connectors.hive.read.HiveTableInputFormat

所有已实现的接口:

Serializable, org.apache.flink.api.common.io.CheckpointableInputFormat<HiveTableInputSplit,Long>, org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>, org.apache.flink.core.io.InputSplitSource<HiveTableInputSplit>

public class HiveTableInputFormat
extends org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<org.apache.flink.table.data.RowData,HiveTableInputSplit>
implements org.apache.flink.api.common.io.CheckpointableInputFormat<HiveTableInputSplit,Long>

The HiveTableInputFormat are inspired by the HCatInputFormat and HadoopInputFormatBase. It's used to read from hive partition/non-partition table.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected SplitReader	reader

从类继承的字段 org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

credentials

构造器概要

构造器

构造器和说明
HiveTableInputFormat(org.apache.hadoop.mapred.JobConf jobConf, org.apache.flink.table.catalog.CatalogTable catalogTable, List<HiveTablePartition> partitions, int[] projectedFields, long limit, String hiveVersion, boolean useMapRedReader)

方法概要

限定符和类型	方法和说明
void	close()
void	configure(org.apache.flink.configuration.Configuration parameters)
HiveTableInputSplit[]	createInputSplits(int minNumSplits)
static HiveTableInputSplit[]	createInputSplits(int minNumSplits, List<HiveTablePartition> partitions, org.apache.hadoop.mapred.JobConf jobConf)
Long	getCurrentState()
org.apache.flink.core.io.InputSplitAssigner	getInputSplitAssigner(HiveTableInputSplit[] inputSplits)
org.apache.hadoop.mapred.JobConf	getJobConf()
org.apache.flink.api.common.io.statistics.BaseStatistics	getStatistics(org.apache.flink.api.common.io.statistics.BaseStatistics cachedStats)
org.apache.flink.table.data.RowData	nextRecord(org.apache.flink.table.data.RowData reuse)
void	open(HiveTableInputSplit split)
boolean	reachedEnd()
void	reopen(HiveTableInputSplit split, Long state)

从类继承的方法 org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

getCredentialsFromUGI, read, write

从类继承的方法 org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

reader

@VisibleForTesting
protected transient SplitReader reader

构造器详细资料

HiveTableInputFormat

public HiveTableInputFormat(org.apache.hadoop.mapred.JobConf jobConf,
                            org.apache.flink.table.catalog.CatalogTable catalogTable,
                            List<HiveTablePartition> partitions,
                            int[] projectedFields,
                            long limit,
                            String hiveVersion,
                            boolean useMapRedReader)

方法详细资料

getJobConf

public org.apache.hadoop.mapred.JobConf getJobConf()

configure

public void configure(org.apache.flink.configuration.Configuration parameters)

指定者:

configure 在接口中 org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>

open

public void open(HiveTableInputSplit split)
          throws IOException

指定者:

open 在接口中 org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>

抛出:

IOException

reopen

public void reopen(HiveTableInputSplit split,
                   Long state)
            throws IOException

指定者:

reopen 在接口中 org.apache.flink.api.common.io.CheckpointableInputFormat<HiveTableInputSplit,Long>

抛出:

IOException

getCurrentState

public Long getCurrentState()

指定者:

getCurrentState 在接口中 org.apache.flink.api.common.io.CheckpointableInputFormat<HiveTableInputSplit,Long>

reachedEnd

public boolean reachedEnd()
                   throws IOException

指定者:

reachedEnd 在接口中 org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>

抛出:

IOException

nextRecord

public org.apache.flink.table.data.RowData nextRecord(org.apache.flink.table.data.RowData reuse)
                                               throws IOException

指定者:

nextRecord 在接口中 org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>

抛出:

IOException

close

public void close()
           throws IOException

指定者:

close 在接口中 org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>

抛出:

IOException

createInputSplits

public HiveTableInputSplit[] createInputSplits(int minNumSplits)
                                        throws IOException

指定者:

createInputSplits 在接口中 org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>

指定者:

createInputSplits 在接口中 org.apache.flink.core.io.InputSplitSource<HiveTableInputSplit>

抛出:

IOException

createInputSplits

public static HiveTableInputSplit[] createInputSplits(int minNumSplits,
                                                      List<HiveTablePartition> partitions,
                                                      org.apache.hadoop.mapred.JobConf jobConf)
                                               throws IOException

抛出:

IOException

getStatistics

public org.apache.flink.api.common.io.statistics.BaseStatistics getStatistics(org.apache.flink.api.common.io.statistics.BaseStatistics cachedStats)

指定者:

getStatistics 在接口中 org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>

getInputSplitAssigner

public org.apache.flink.core.io.InputSplitAssigner getInputSplitAssigner(HiveTableInputSplit[] inputSplits)

指定者:

getInputSplitAssigner 在接口中 org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,HiveTableInputSplit>

指定者:

getInputSplitAssigner 在接口中 org.apache.flink.core.io.InputSplitSource<HiveTableInputSplit>