org.apache.nifi.processors.iceberg.converter

Class IcebergRecordConverter

java.lang.Object

org.apache.nifi.processors.iceberg.converter.IcebergRecordConverter

public class IcebergRecordConverter
extends Object

This class is responsible for schema traversal and data conversion between NiFi and Iceberg internal record structure.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	IcebergRecordConverter.ArrayTypeWithIcebergSchema Data type for Arrays which contains Records.
static class	IcebergRecordConverter.IcebergPartnerAccessors
private static class	IcebergRecordConverter.IcebergSchemaVisitor
private static class	IcebergRecordConverter.MapTypeWithIcebergSchema Data type for Maps which contains Records in the entries value.
private static class	IcebergRecordConverter.RecordTypeWithFieldNameMapper Since the RecordSchema stores the field name and value pairs in a HashMap it makes the retrieval case-sensitive, so we create a name mapper for case-insensitive handling.
private static class	IcebergRecordConverter.UUIDDataType Parquet writer expects the UUID value in different format, so it needs to be converted differently: #1881

Field Summary

Fields

Modifier and Type	Field and Description
private DataConverter<Record,org.apache.iceberg.data.GenericRecord>	converter
ComponentLog	logger
UnmatchedColumnBehavior	unmatchedColumnBehavior

Constructor Summary

Constructors

Constructor and Description
IcebergRecordConverter(org.apache.iceberg.Schema schema, RecordSchema recordSchema, org.apache.iceberg.FileFormat fileFormat, UnmatchedColumnBehavior unmatchedColumnBehavior, ComponentLog logger)

Method Summary

Modifier and Type	Method and Description
org.apache.iceberg.data.GenericRecord	convert(Record record)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

converter

private final DataConverter<Record,org.apache.iceberg.data.GenericRecord> converter

unmatchedColumnBehavior

public final UnmatchedColumnBehavior unmatchedColumnBehavior

logger

public ComponentLog logger

Constructor Detail

IcebergRecordConverter

public IcebergRecordConverter(org.apache.iceberg.Schema schema,
                              RecordSchema recordSchema,
                              org.apache.iceberg.FileFormat fileFormat,
                              UnmatchedColumnBehavior unmatchedColumnBehavior,
                              ComponentLog logger)

Method Detail

convert

public org.apache.iceberg.data.GenericRecord convert(Record record)