org.apache.pinot.tools.anonymizer

Class MapBasedGlobalDictionaries

java.lang.Object

org.apache.pinot.tools.anonymizer.MapBasedGlobalDictionaries

All Implemented Interfaces:

GlobalDictionaries

public class MapBasedGlobalDictionaries
extends Object
implements GlobalDictionaries

Field Summary

Fields inherited from interface org.apache.pinot.tools.anonymizer.GlobalDictionaries

DICT_FILE_EXTENSION

Method Summary

Modifier and Type	Method and Description
void	addDerivedValuesToGlobalDictionaries() This is the third and final step where we complete the global dictionaries by generating values: For numeric columns, we generate in order since we start with a base value.
void	addOrigValueToGlobalDictionary(Object origValue, String column, ColumnMetadata columnMetadata, int cardinality) First step towards building global dictionary by inserting the original values from segments into global dictionary
Object	getDerivedValueForOrigValueSV(String column, Object origValue)
Object[]	getDerivedValuesForOrigValuesMV(String column, Object[] origMultiValues)
void	serialize(String outputDir)
void	sortOriginalValuesInGlobalDictionaries() This is the second step where we complete the global dictionaries by sorting the original values to get sort order across all segments

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

addOrigValueToGlobalDictionary

public void addOrigValueToGlobalDictionary(Object origValue,
                                           String column,
                                           ColumnMetadata columnMetadata,
                                           int cardinality)

First step towards building global dictionary by inserting the original values from segments into global dictionary

Specified by:

addOrigValueToGlobalDictionary in interface GlobalDictionaries

Parameters:

origValue - original value

column - column name

columnMetadata - column metadata

cardinality - total cardinality of column

sortOriginalValuesInGlobalDictionaries

public void sortOriginalValuesInGlobalDictionaries()

This is the second step where we complete the global dictionaries by sorting the original values to get sort order across all segments

Specified by:

sortOriginalValuesInGlobalDictionaries in interface GlobalDictionaries

addDerivedValuesToGlobalDictionaries

public void addDerivedValuesToGlobalDictionaries()

This is the third and final step where we complete the global dictionaries by generating values: For numeric columns, we generate in order since we start with a base value. For string column, we first generate and then sort

Specified by:

addDerivedValuesToGlobalDictionaries in interface GlobalDictionaries

serialize

public void serialize(String outputDir)
               throws Exception

Specified by:

serialize in interface GlobalDictionaries

Throws:

Exception

getDerivedValueForOrigValueSV

public Object getDerivedValueForOrigValueSV(String column,
                                            Object origValue)

Specified by:

getDerivedValueForOrigValueSV in interface GlobalDictionaries

getDerivedValuesForOrigValuesMV

public Object[] getDerivedValuesForOrigValuesMV(String column,
                                                Object[] origMultiValues)

Specified by:

getDerivedValuesForOrigValuesMV in interface GlobalDictionaries