org.apache.pinot.tools.backfill

Class BackfillSegmentUtils

java.lang.Object

org.apache.pinot.tools.backfill.BackfillSegmentUtils

public class BackfillSegmentUtils
extends Object

Contains APIs which are used for backfilling the pinot segments with dateTimeFieldSpec

Field Summary

Fields

Modifier and Type	Field and Description
static String	TAR_SUFFIX

Constructor Summary

Constructors

Constructor and Description
BackfillSegmentUtils(String controllerHost, String controllerPort)

Method Summary

Modifier and Type	Method and Description
boolean	downloadSegment(String tableName, String segmentName, File downloadSegmentDir, File tableBackupDir) Downloads a segment from a table to a directory locally, and backs it up to given backup path
List<String>	getAllSegments(String tableName, CommonConstants.Segment.SegmentType segmentType) Fetches the list of all segment names for a table
boolean	uploadSegment(String rawTableName, String segmentName, File segmentDir, File outputDir) Uploads the segment tar to the controller.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TAR_SUFFIX

public static final String TAR_SUFFIX

See Also:

Constant Field Values

Constructor Detail

BackfillSegmentUtils

public BackfillSegmentUtils(String controllerHost,
                            String controllerPort)

Method Detail

getAllSegments

public List<String> getAllSegments(String tableName,
                                   CommonConstants.Segment.SegmentType segmentType)
                            throws IOException

Fetches the list of all segment names for a table

Parameters:

tableName -

Returns:

Throws:

IOException

downloadSegment

public boolean downloadSegment(String tableName,
                               String segmentName,
                               File downloadSegmentDir,
                               File tableBackupDir)

Downloads a segment from a table to a directory locally, and backs it up to given backup path

Parameters:

tableName -

segmentName -

downloadSegmentDir - - download segment path

tableBackupDir - - backup segments path

Returns:

uploadSegment

public boolean uploadSegment(String rawTableName,
                             String segmentName,
                             File segmentDir,
                             File outputDir)

Uploads the segment tar to the controller.