Package org.apache.pinot.tools.backfill

Class BackfillSegmentUtils

java.lang.Object

org.apache.pinot.tools.backfill.BackfillSegmentUtils

public class BackfillSegmentUtils
extends Object

Contains APIs which are used for backfilling the pinot segments with dateTimeFieldSpec

Field Summary

Fields

Modifier and Type	Field	Description
static String	TAR_SUFFIX

Constructor Summary

Constructors

Constructor	Description
BackfillSegmentUtils(String controllerHost, String controllerPort)

Method Summary

Modifier and Type	Method	Description
boolean	downloadSegment(String tableName, String segmentName, File downloadSegmentDir, File tableBackupDir)	Downloads a segment from a table to a directory locally, and backs it up to given backup path
List<String>	getAllSegments(String tableName, org.apache.pinot.spi.utils.CommonConstants.Segment.SegmentType segmentType)	Fetches the list of all segment names for a table
boolean	uploadSegment(String rawTableName, String segmentName, File segmentDir, File outputDir)	Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TAR_SUFFIX

public static final String TAR_SUFFIX

See Also:

Constant Field Values

Constructor Detail

BackfillSegmentUtils

public BackfillSegmentUtils(String controllerHost,
                            String controllerPort)

Method Detail

getAllSegments

public List<String> getAllSegments(String tableName,
                                   org.apache.pinot.spi.utils.CommonConstants.Segment.SegmentType segmentType)
                            throws IOException

Fetches the list of all segment names for a table

Parameters:

tableName -

Returns:

Throws:

IOException

downloadSegment

public boolean downloadSegment(String tableName,
                               String segmentName,
                               File downloadSegmentDir,
                               File tableBackupDir)

Downloads a segment from a table to a directory locally, and backs it up to given backup path

Parameters:

tableName -

segmentName -

downloadSegmentDir - - download segment path

tableBackupDir - - backup segments path

Returns:

uploadSegment

@Deprecated
public boolean uploadSegment(String rawTableName,
                             String segmentName,
                             File segmentDir,
                             File outputDir)

Deprecated.

Uploads the segment tar to the controller. NOTE: this method does not support auth tokens