org.apache.jena.hadoop.rdf.io.input

Class AbstractNLineFileInputFormat<TKey,TValue>

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<TKey,TValue>

org.apache.jena.hadoop.rdf.io.input.AbstractNLineFileInputFormat<TKey,TValue>

Type Parameters:

TKey - Key type

TValue - Value type

Direct Known Subclasses:

BlockedNQuadsInputFormat, BlockedNTriplesInputFormat, NQuadsInputFormat, NTriplesInputFormat

public abstract class AbstractNLineFileInputFormat<TKey,TValue>
extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<TKey,TValue>

Abstract line based input format that reuses the machinery from NLineInputFormat to calculate the splits

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

DEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE

Constructor Summary

Constructors

Constructor and Description
AbstractNLineFileInputFormat()

Method Summary

Modifier and Type	Method and Description
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext job) Logically splits the set of input files for the job, splits N lines of the input as one split.

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class org.apache.hadoop.mapreduce.InputFormat

createRecordReader

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractNLineFileInputFormat

public AbstractNLineFileInputFormat()

Method Detail

getSplits

public final List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext job)
                                                             throws IOException

Logically splits the set of input files for the job, splits N lines of the input as one split.

Overrides:

getSplits in class org.apache.hadoop.mapreduce.lib.input.FileInputFormat<TKey,TValue>

Throws:

IOException

See Also:

FileInputFormat.getSplits(JobContext)