org.apache.jena.hadoop.rdf.io.input.nquads

Class WholeFileNQuadsInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<TKey,TValue>

org.apache.jena.hadoop.rdf.io.input.AbstractWholeFileInputFormat<org.apache.hadoop.io.LongWritable,QuadWritable>

org.apache.jena.hadoop.rdf.io.input.nquads.WholeFileNQuadsInputFormat

public class WholeFileNQuadsInputFormat
extends AbstractWholeFileInputFormat<org.apache.hadoop.io.LongWritable,QuadWritable>

NQuads input format where files are processed as complete files rather than in a line based manner as with the NQuadsInputFormat

This has the advantage of less parser setup overhead but the disadvantage that the input cannot be split over multiple mappers.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

DEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE

Constructor Summary

Constructors

Constructor and Description
WholeFileNQuadsInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,QuadWritable>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WholeFileNQuadsInputFormat

public WholeFileNQuadsInputFormat()

Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,QuadWritable> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                   org.apache.hadoop.mapreduce.TaskAttemptContext context)

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.LongWritable,QuadWritable>