org.apache.flink.connectors.hive.util

Class HivePartitionUtils

java.lang.Object

org.apache.flink.connectors.hive.util.HivePartitionUtils

public class HivePartitionUtils
extends Object

Utils to load hive partitions from HiveMetaStore.

Constructor Summary

Constructors

Constructor and Description
HivePartitionUtils()

Method Summary

Modifier and Type	Method and Description
static List<HiveTablePartition>	getAllPartitions(org.apache.hadoop.mapred.JobConf jobConf, String hiveVersion, org.apache.flink.table.catalog.ObjectPath tablePath, org.apache.flink.table.catalog.CatalogTable catalogTable, HiveShim hiveShim, List<Map<String,String>> remainingPartitions) Returns all HiveTablePartitions of a hive table, returns single HiveTablePartition if the hive table is not partitioned.
static org.apache.hadoop.fs.FileStatus[]	getFileStatusRecurse(org.apache.hadoop.fs.Path path, int expectLevel, org.apache.hadoop.fs.FileSystem fs)
static List<String>	partitionSpecToValues(Map<String,String> spec, List<String> partitionColNames)
static Object	restorePartitionValueFromType(HiveShim shim, String valStr, org.apache.flink.table.types.DataType type)
static HiveTablePartition	toHiveTablePartition(List<String> partitionKeys, String[] fieldNames, org.apache.flink.table.types.DataType[] fieldTypes, HiveShim shim, Properties tableProps, String defaultPartitionName, org.apache.hadoop.hive.metastore.api.Partition partition)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HivePartitionUtils

public HivePartitionUtils()

Method Detail

restorePartitionValueFromType

public static Object restorePartitionValueFromType(HiveShim shim,
                                                   String valStr,
                                                   org.apache.flink.table.types.DataType type)

getAllPartitions

public static List<HiveTablePartition> getAllPartitions(org.apache.hadoop.mapred.JobConf jobConf,
                                                        String hiveVersion,
                                                        org.apache.flink.table.catalog.ObjectPath tablePath,
                                                        org.apache.flink.table.catalog.CatalogTable catalogTable,
                                                        HiveShim hiveShim,
                                                        List<Map<String,String>> remainingPartitions)

Returns all HiveTablePartitions of a hive table, returns single HiveTablePartition if the hive table is not partitioned.

partitionSpecToValues

public static List<String> partitionSpecToValues(Map<String,String> spec,
                                                 List<String> partitionColNames)

toHiveTablePartition

public static HiveTablePartition toHiveTablePartition(List<String> partitionKeys,
                                                      String[] fieldNames,
                                                      org.apache.flink.table.types.DataType[] fieldTypes,
                                                      HiveShim shim,
                                                      Properties tableProps,
                                                      String defaultPartitionName,
                                                      org.apache.hadoop.hive.metastore.api.Partition partition)

getFileStatusRecurse

public static org.apache.hadoop.fs.FileStatus[] getFileStatusRecurse(org.apache.hadoop.fs.Path path,
                                                                     int expectLevel,
                                                                     org.apache.hadoop.fs.FileSystem fs)