Index
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form
A
- AbstractAvroSerializer - Class in org.apache.storm.hdfs.avro
-
This abstract class can be extended to implement concrete classes capable of (de)serializing generic avro objects across a Topology.
- AbstractAvroSerializer() - Constructor for class org.apache.storm.hdfs.avro.AbstractAvroSerializer
- AbstractHdfsBolt - Class in org.apache.storm.hdfs.bolt
- AbstractHdfsBolt() - Constructor for class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- AbstractHDFSWriter - Class in org.apache.storm.hdfs.common
- AbstractHDFSWriter(FileRotationPolicy, Path) - Constructor for class org.apache.storm.hdfs.common.AbstractHDFSWriter
- ack(Object) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- acquireOldestExpiredLock(FileSystem, Path, int, String) - Static method in class org.apache.storm.hdfs.spout.FileLock
-
Finds a oldest expired lock file (using modification timestamp), then takes ownership of the lock file.
- addAvroKryoSerializations(Config) - Static method in class org.apache.storm.hdfs.avro.AvroUtils
-
A helper method to extract avro serialization configurations from the topology configuration and register specific kryo serializers as necessary.
- addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
-
Deprecated.
- addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- ARCHIVE_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.
- AvroGenericRecordBolt - Class in org.apache.storm.hdfs.bolt
- AvroGenericRecordBolt() - Constructor for class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- AvroGenericRecordHDFSWriter - Class in org.apache.storm.hdfs.common
- AvroGenericRecordHDFSWriter(FileRotationPolicy, Path, FSDataOutputStream, Schema) - Constructor for class org.apache.storm.hdfs.common.AvroGenericRecordHDFSWriter
- AvroSchemaRegistry - Interface in org.apache.storm.hdfs.avro
- AvroUtils - Class in org.apache.storm.hdfs.avro
- AvroUtils() - Constructor for class org.apache.storm.hdfs.avro.AvroUtils
B
- BAD_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setBadFilesDir(String) - beginCommit(Long) - Method in class org.apache.storm.hdfs.trident.HdfsState
- BUFFER_SIZE - Static variable in class org.apache.storm.hdfs.spout.SequenceFileReader
- BUFFER_SIZE - Static variable in class org.apache.storm.hdfs.spout.TextFileReader
C
- CHARSET - Static variable in class org.apache.storm.hdfs.spout.TextFileReader
- cleanup() - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- CLOCKS_INSYNC - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setClocksInSync(boolean) - clone() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- clone() - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
- close() - Method in interface org.apache.storm.hdfs.bolt.Writer
- close() - Method in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- close() - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- close() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader
- close() - Method in class org.apache.storm.hdfs.spout.TextFileReader
- collector - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- commit(Long) - Method in class org.apache.storm.hdfs.trident.HdfsState
- COMMIT_FREQ_COUNT - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setCommitFrequencyCount(int) - COMMIT_FREQ_SEC - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setCommitFrequencySec(int) - compare(FileStatus, FileStatus) - Method in class org.apache.storm.hdfs.common.ModifTimeComparator
- compareTo(FileOffset) - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- compareTo(FileOffset) - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
- componentId - Variable in class org.apache.storm.hdfs.spout.FileLock.LogEntry
- configKey - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- configKey - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
- Configs - Class in org.apache.storm.hdfs.spout
- Configs() - Constructor for class org.apache.storm.hdfs.spout.Configs
- Configs.ReaderTypeValidator - Class in org.apache.storm.hdfs.spout
- copy() - Method in interface org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy
-
Must be able to copy the rotation policy.
- copy() - Method in class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy
- copy() - Method in class org.apache.storm.hdfs.bolt.rotation.NoRotationPolicy
- copy() - Method in class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
- CountSyncPolicy - Class in org.apache.storm.hdfs.bolt.sync
-
SyncPolicy implementation that will trigger a file system sync after a certain number of tuples have been processed.
- CountSyncPolicy - Class in org.apache.storm.hdfs.trident.sync
-
SyncPolicy implementation that will trigger a file system sync after a certain number of tuples have been processed.
- CountSyncPolicy(int) - Constructor for class org.apache.storm.hdfs.bolt.sync.CountSyncPolicy
- CountSyncPolicy(int) - Constructor for class org.apache.storm.hdfs.trident.sync.CountSyncPolicy
- currentRecord - Variable in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
D
- DAYS - Enum constant in enum class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
- DAYS - Enum constant in enum class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
- declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- DEFAULT_COMMIT_FREQ_COUNT - Static variable in class org.apache.storm.hdfs.spout.Configs
- DEFAULT_COMMIT_FREQ_SEC - Static variable in class org.apache.storm.hdfs.spout.Configs
- DEFAULT_FIELD_DELIMITER - Static variable in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
- DEFAULT_FIELD_DELIMITER - Static variable in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
- DEFAULT_HDFS_CONFIG_KEY - Static variable in class org.apache.storm.hdfs.spout.Configs
- DEFAULT_LOCK_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Filenames with this suffix in archive dir will be ignored by the Spout.
- DEFAULT_LOCK_TIMEOUT - Static variable in class org.apache.storm.hdfs.spout.Configs
- DEFAULT_MAX_OUTSTANDING - Static variable in class org.apache.storm.hdfs.spout.Configs
- DEFAULT_RECORD_DELIMITER - Static variable in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
- DEFAULT_RECORD_DELIMITER - Static variable in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
- defaultFields - Static variable in class org.apache.storm.hdfs.spout.SequenceFileReader
- defaultFields - Static variable in class org.apache.storm.hdfs.spout.TextFileReader
- DefaultFileNameFormat - Class in org.apache.storm.hdfs.bolt.format
-
Creates file names with the following format:
- DefaultFileNameFormat - Class in org.apache.storm.hdfs.trident.format
-
Creates file names with the following format:
- DefaultFileNameFormat() - Constructor for class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
- DefaultFileNameFormat() - Constructor for class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
- DefaultSequenceFormat - Class in org.apache.storm.hdfs.bolt.format
-
Basic
SequenceFormatimplementation that usesLongWritablefor keys andTextfor values. - DefaultSequenceFormat - Class in org.apache.storm.hdfs.trident.format
-
Basic
SequenceFormatimplementation that usesLongWritablefor keys andTextfor values. - DefaultSequenceFormat(String, String) - Constructor for class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
- DefaultSequenceFormat(String, String) - Constructor for class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
- DelimitedRecordFormat - Class in org.apache.storm.hdfs.bolt.format
-
RecordFormat implementation that uses field and record delimiters.
- DelimitedRecordFormat - Class in org.apache.storm.hdfs.trident.format
-
RecordFormat implementation that uses field and record delimiters.
- DelimitedRecordFormat() - Constructor for class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
- DelimitedRecordFormat() - Constructor for class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
- deserialize(String) - Static method in class org.apache.storm.hdfs.spout.FileLock.LogEntry
- DIR_LOCK_FILE - Static variable in class org.apache.storm.hdfs.spout.DirLock
- DirLock - Class in org.apache.storm.hdfs.spout
-
Facility to synchronize access to HDFS directory.
- doClose() - Method in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- doClose() - Method in class org.apache.storm.hdfs.common.AvroGenericRecordHDFSWriter
- doClose() - Method in class org.apache.storm.hdfs.common.HDFSWriter
- doClose() - Method in class org.apache.storm.hdfs.common.SequenceFileWriter
- doCommit(Long) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- doCommit(Long) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- doPrepare(Map<String, Object>, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- doPrepare(Map<String, Object>, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- doPrepare(Map<String, Object>, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- doPrepare(Map<String, Object>, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- doSync() - Method in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- doSync() - Method in class org.apache.storm.hdfs.common.AvroGenericRecordHDFSWriter
- doSync() - Method in class org.apache.storm.hdfs.common.HDFSWriter
- doSync() - Method in class org.apache.storm.hdfs.common.SequenceFileWriter
- doWrite(Tuple) - Method in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- doWrite(Tuple) - Method in class org.apache.storm.hdfs.common.AvroGenericRecordHDFSWriter
- doWrite(Tuple) - Method in class org.apache.storm.hdfs.common.HDFSWriter
- doWrite(Tuple) - Method in class org.apache.storm.hdfs.common.SequenceFileWriter
- dumpState(PrintStream) - Method in class org.apache.storm.hdfs.spout.ProgressTracker
E
- emitData(List<Object>, HdfsSpout.MessageId) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- equals(Object) - Method in class org.apache.storm.hdfs.spout.TextFileReader
- equals(Object) - Method in class org.apache.storm.hdfs.spout.FileLock.LogEntry
- equals(Object) - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- equals(Object) - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
- eventTime - Variable in class org.apache.storm.hdfs.spout.FileLock.LogEntry
- execute(List<TridentTuple>) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- execute(List<TridentTuple>) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- execute(FileSystem, Path) - Method in class org.apache.storm.hdfs.common.rotation.MoveFileAction
- execute(FileSystem, Path) - Method in interface org.apache.storm.hdfs.common.rotation.RotationAction
- execute(Tuple) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
F
- fail(Object) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- FileLock - Class in org.apache.storm.hdfs.spout
-
Facility to synchronize access to HDFS files.
- FileLock.LogEntry - Class in org.apache.storm.hdfs.spout
- fileNameFormat - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- fileNameFormat - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
- FileNameFormat - Interface in org.apache.storm.hdfs.bolt.format
-
Formatter interface for determining HDFS file names.
- FileNameFormat - Interface in org.apache.storm.hdfs.trident.format
-
Formatter interface for determining HDFS file names.
- fileOffset - Variable in class org.apache.storm.hdfs.spout.FileLock.LogEntry
- filePath - Variable in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- fileRetryCount - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- FileRotationPolicy - Interface in org.apache.storm.hdfs.bolt.rotation
-
Used by the HdfsBolt to decide when to rotate files.
- FileRotationPolicy - Interface in org.apache.storm.hdfs.trident.rotation
-
Used by the HdfsBolt to decide when to rotate files.
- FileSizeRotationPolicy - Class in org.apache.storm.hdfs.bolt.rotation
-
File rotation policy that will rotate files when a certain file size is reached.
- FileSizeRotationPolicy - Class in org.apache.storm.hdfs.trident.rotation
-
File rotation policy that will rotate files when a certain file size is reached.
- FileSizeRotationPolicy(float, FileSizeRotationPolicy.Units) - Constructor for class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy
- FileSizeRotationPolicy(float, FileSizeRotationPolicy.Units) - Constructor for class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
- FileSizeRotationPolicy(long) - Constructor for class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy
- FileSizeRotationPolicy.Units - Enum Class in org.apache.storm.hdfs.bolt.rotation
- FileSizeRotationPolicy.Units - Enum Class in org.apache.storm.hdfs.trident.rotation
- FixedAvroSerializer - Class in org.apache.storm.hdfs.avro
-
A class to help (de)serialize a pre-defined set of Avro schemas.
- FixedAvroSerializer() - Constructor for class org.apache.storm.hdfs.avro.FixedAvroSerializer
- format - Variable in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- format(TridentTuple) - Method in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
- format(TridentTuple) - Method in interface org.apache.storm.hdfs.trident.format.RecordFormat
- format(Tuple) - Method in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
- format(Tuple) - Method in interface org.apache.storm.hdfs.bolt.format.RecordFormat
- fs - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- fs - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
- fsUrl - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- fsUrl - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
G
- GB - Enum constant in enum class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
- GB - Enum constant in enum class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
- GenericAvroSerializer - Class in org.apache.storm.hdfs.avro
-
A default implementation of the AvroSerializer that will just pass literal schemas back and forth.
- GenericAvroSerializer() - Constructor for class org.apache.storm.hdfs.avro.GenericAvroSerializer
- getBasePathForNextFile(Tuple) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- getByteCount() - Method in enum class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
- getByteCount() - Method in enum class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
- getCollector() - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- getCommitPosition() - Method in class org.apache.storm.hdfs.spout.ProgressTracker
- getComponentConfiguration() - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- getCurrentOffset() - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- getCurrentOffset() - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- getFileOffset() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader
- getFileOffset() - Method in class org.apache.storm.hdfs.spout.TextFileReader
- getFilePath() - Method in interface org.apache.storm.hdfs.bolt.Writer
- getFilePath() - Method in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- getFilePath() - Method in class org.apache.storm.hdfs.spout.TextFileReader
- getFingerprint(Schema) - Method in interface org.apache.storm.hdfs.avro.AvroSchemaRegistry
- getFingerprint(Schema) - Method in class org.apache.storm.hdfs.avro.FixedAvroSerializer
- getFingerprint(Schema) - Method in class org.apache.storm.hdfs.avro.GenericAvroSerializer
- getInterval() - Method in class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
- getInterval() - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
- getKey() - Method in class org.apache.storm.hdfs.common.HdfsUtils.Pair
- getLastEntry(FileSystem, Path) - Static method in class org.apache.storm.hdfs.spout.FileLock
-
returns the last log entry.
- getLastEntryIfStale(FileSystem, Path, long) - Static method in class org.apache.storm.hdfs.spout.FileLock
-
checks if lockFile is older than 'olderThan' UTC time by examining the modification time on file and (if necessary) the timestamp in last log entry in the file.
- getLastLogEntry() - Method in class org.apache.storm.hdfs.spout.FileLock
- getLockDirPath() - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- getLockFile() - Method in class org.apache.storm.hdfs.spout.DirLock
- getLockFile() - Method in class org.apache.storm.hdfs.spout.FileLock
- getMaxBytes() - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
- getMilliSeconds() - Method in enum class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
- getMilliSeconds() - Method in enum class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
- getName(long, long) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
- getName(long, long) - Method in interface org.apache.storm.hdfs.bolt.format.FileNameFormat
-
Returns the filename the HdfsBolt will create.
- getName(long, long) - Method in class org.apache.storm.hdfs.bolt.format.SimpleFileNameFormat
- getName(long, long) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
- getName(long, long) - Method in interface org.apache.storm.hdfs.trident.format.FileNameFormat
-
Returns the filename the HdfsBolt will create.
- getName(long, long) - Method in class org.apache.storm.hdfs.trident.format.SimpleFileNameFormat
- getPartitionPath(Tuple) - Method in class org.apache.storm.hdfs.common.NullPartitioner
- getPartitionPath(Tuple) - Method in interface org.apache.storm.hdfs.common.Partitioner
-
Return a relative path that the tuple should be written to.
- getPath() - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
- getPath() - Method in interface org.apache.storm.hdfs.bolt.format.FileNameFormat
- getPath() - Method in class org.apache.storm.hdfs.bolt.format.SimpleFileNameFormat
- getPath() - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
- getPath() - Method in interface org.apache.storm.hdfs.trident.format.FileNameFormat
- getPath() - Method in class org.apache.storm.hdfs.trident.format.SimpleFileNameFormat
- getSchema(String) - Method in interface org.apache.storm.hdfs.avro.AvroSchemaRegistry
- getSchema(String) - Method in class org.apache.storm.hdfs.avro.FixedAvroSerializer
- getSchema(String) - Method in class org.apache.storm.hdfs.avro.GenericAvroSerializer
- getValue() - Method in class org.apache.storm.hdfs.common.HdfsUtils.Pair
- getWriterKey(Tuple) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- getWriterKey(Tuple) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
-
AvroGenericRecordBolt must override this method because messages with different schemas cannot be written to the same file.
- getWriterKey(Tuple) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- getWriterKey(Tuple) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
H
- hashCode() - Method in class org.apache.storm.hdfs.spout.TextFileReader
- hashCode() - Method in class org.apache.storm.hdfs.spout.FileLock.LogEntry
- hashCode() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- hashCode() - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
- HDFS_URI - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setHdfsUri(String) - HdfsBolt - Class in org.apache.storm.hdfs.bolt
- HdfsBolt() - Constructor for class org.apache.storm.hdfs.bolt.HdfsBolt
- hdfsConfig - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- hdfsConfig - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
- HdfsFileOptions() - Constructor for class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- HdfsSpout - Class in org.apache.storm.hdfs.spout
- HdfsSpout() - Constructor for class org.apache.storm.hdfs.spout.HdfsSpout
- HdfsState - Class in org.apache.storm.hdfs.trident
- HdfsState.HdfsFileOptions - Class in org.apache.storm.hdfs.trident
- HdfsState.Options - Class in org.apache.storm.hdfs.trident
- HdfsState.SequenceFileOptions - Class in org.apache.storm.hdfs.trident
- HdfsStateFactory - Class in org.apache.storm.hdfs.trident
- HdfsStateFactory() - Constructor for class org.apache.storm.hdfs.trident.HdfsStateFactory
- HdfsUpdater - Class in org.apache.storm.hdfs.trident
- HdfsUpdater() - Constructor for class org.apache.storm.hdfs.trident.HdfsUpdater
- HdfsUtils - Class in org.apache.storm.hdfs.common
- HdfsUtils() - Constructor for class org.apache.storm.hdfs.common.HdfsUtils
- HdfsUtils.Pair<K,
V> - Class in org.apache.storm.hdfs.common - HDFSWriter - Class in org.apache.storm.hdfs.common
- HDFSWriter(FileRotationPolicy, Path, FSDataOutputStream, RecordFormat) - Constructor for class org.apache.storm.hdfs.common.HDFSWriter
- heartbeat(String) - Method in class org.apache.storm.hdfs.spout.FileLock
- HOURS - Enum constant in enum class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
- HOURS - Enum constant in enum class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
I
- IGNORE_SUFFIX - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setIgnoreSuffix(String) - isNextOffset(FileOffset) - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- isNextOffset(FileOffset) - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
K
- KB - Enum constant in enum class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
- KB - Enum constant in enum class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
- key(TridentTuple) - Method in class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
- key(TridentTuple) - Method in interface org.apache.storm.hdfs.trident.format.SequenceFormat
-
Given a tuple, return the key that should be written to the sequence file.
- key(Tuple) - Method in class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
- key(Tuple) - Method in interface org.apache.storm.hdfs.bolt.format.SequenceFormat
-
Given a tuple, return the key that should be written to the sequence file.
- keyClass() - Method in class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
- keyClass() - Method in interface org.apache.storm.hdfs.bolt.format.SequenceFormat
-
Key class used by implementation (e.g.
- keyClass() - Method in class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
- keyClass() - Method in interface org.apache.storm.hdfs.trident.format.SequenceFormat
-
Key class used by implementation (e.g.
L
- lastSyncPoint - Variable in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- lastUsedTime - Variable in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- listFilesByModificationTime(FileSystem, Path, long) - Static method in class org.apache.storm.hdfs.common.HdfsUtils
-
list files sorted by modification time that have not been modified since 'olderThan'.
- locateOldestExpiredLock(FileSystem, Path, int) - Static method in class org.apache.storm.hdfs.spout.FileLock
-
Finds oldest expired lock file (using modification timestamp), then takes ownership of the lock file.
- LOCK_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setLockDir(String) - LOCK_TIMEOUT - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setLockTimeoutSec(int) - LOG - Static variable in class org.apache.storm.hdfs.trident.HdfsState
- LogEntry(long, String, String) - Constructor for class org.apache.storm.hdfs.spout.FileLock.LogEntry
M
- makeNewWriter(Path, Tuple) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- makeNewWriter(Path, Tuple) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- makeNewWriter(Path, Tuple) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- makeNewWriter(Path, Tuple) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- makeState(Map<String, Object>, IMetricsContext, int, int) - Method in class org.apache.storm.hdfs.trident.HdfsStateFactory
- mark(long) - Method in interface org.apache.storm.hdfs.trident.rotation.FileRotationPolicy
-
Check if a file rotation should be performed based on the offset at which file is being written.
- mark(long) - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
- mark(long) - Method in class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
- mark(long) - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
- mark(TridentTuple, long) - Method in interface org.apache.storm.hdfs.trident.rotation.FileRotationPolicy
-
Called for every tuple the HdfsBolt executes.
- mark(TridentTuple, long) - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
- mark(TridentTuple, long) - Method in class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
- mark(TridentTuple, long) - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
-
Called for every tuple the HdfsBolt executes.
- mark(TridentTuple, long) - Method in class org.apache.storm.hdfs.trident.sync.CountSyncPolicy
- mark(TridentTuple, long) - Method in interface org.apache.storm.hdfs.trident.sync.SyncPolicy
-
Called for every tuple the HdfsBolt executes.
- mark(Tuple, long) - Method in interface org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy
-
Called for every tuple the HdfsBolt executes.
- mark(Tuple, long) - Method in class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy
- mark(Tuple, long) - Method in class org.apache.storm.hdfs.bolt.rotation.NoRotationPolicy
- mark(Tuple, long) - Method in class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
-
Called for every tuple the HdfsBolt executes.
- mark(Tuple, long) - Method in class org.apache.storm.hdfs.bolt.sync.CountSyncPolicy
- mark(Tuple, long) - Method in interface org.apache.storm.hdfs.bolt.sync.SyncPolicy
-
Called for every tuple the HdfsBolt executes.
- MAX_OUTSTANDING - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setMaxOutstanding(int) - maxOpenFiles - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- MB - Enum constant in enum class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
- MB - Enum constant in enum class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
- MINUTES - Enum constant in enum class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
- MINUTES - Enum constant in enum class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
- ModifTimeComparator - Class in org.apache.storm.hdfs.common
- ModifTimeComparator() - Constructor for class org.apache.storm.hdfs.common.ModifTimeComparator
- MoveFileAction - Class in org.apache.storm.hdfs.common.rotation
- MoveFileAction() - Constructor for class org.apache.storm.hdfs.common.rotation.MoveFileAction
N
- needsRotation - Variable in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- needsRotation() - Method in interface org.apache.storm.hdfs.bolt.Writer
- needsRotation() - Method in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- next() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader
- next() - Method in class org.apache.storm.hdfs.spout.TextFileReader
- nextTuple() - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- NoRotationPolicy - Class in org.apache.storm.hdfs.bolt.rotation
-
File rotation policy that will never rotate...
- NoRotationPolicy - Class in org.apache.storm.hdfs.trident.rotation
-
File rotation policy that will never rotate...
- NoRotationPolicy() - Constructor for class org.apache.storm.hdfs.bolt.rotation.NoRotationPolicy
- NoRotationPolicy() - Constructor for class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
- NullPartitioner - Class in org.apache.storm.hdfs.common
-
The NullPartitioner partitions every tuple to the empty string.
- NullPartitioner() - Constructor for class org.apache.storm.hdfs.common.NullPartitioner
O
- of(K, V) - Static method in class org.apache.storm.hdfs.common.HdfsUtils.Pair
- offset - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- offset - Variable in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- Offset(long, long) - Constructor for class org.apache.storm.hdfs.spout.TextFileReader.Offset
- Offset(long, long, long) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- Offset(long, long, long, long, long) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- Offset(String) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- Offset(String) - Constructor for class org.apache.storm.hdfs.spout.TextFileReader.Offset
- open(Map<String, Object>, TopologyContext, SpoutOutputCollector) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- Options() - Constructor for class org.apache.storm.hdfs.trident.HdfsState.Options
- org.apache.storm.hdfs.avro - package org.apache.storm.hdfs.avro
- org.apache.storm.hdfs.bolt - package org.apache.storm.hdfs.bolt
- org.apache.storm.hdfs.bolt.format - package org.apache.storm.hdfs.bolt.format
- org.apache.storm.hdfs.bolt.rotation - package org.apache.storm.hdfs.bolt.rotation
- org.apache.storm.hdfs.bolt.sync - package org.apache.storm.hdfs.bolt.sync
- org.apache.storm.hdfs.common - package org.apache.storm.hdfs.common
- org.apache.storm.hdfs.common.rotation - package org.apache.storm.hdfs.common.rotation
- org.apache.storm.hdfs.spout - package org.apache.storm.hdfs.spout
- org.apache.storm.hdfs.trident - package org.apache.storm.hdfs.trident
- org.apache.storm.hdfs.trident.format - package org.apache.storm.hdfs.trident.format
- org.apache.storm.hdfs.trident.rotation - package org.apache.storm.hdfs.trident.rotation
- org.apache.storm.hdfs.trident.sync - package org.apache.storm.hdfs.trident.sync
P
- Pair(K, V) - Constructor for class org.apache.storm.hdfs.common.HdfsUtils.Pair
- ParseException - Exception in org.apache.storm.hdfs.spout
- ParseException(String, Throwable) - Constructor for exception org.apache.storm.hdfs.spout.ParseException
- partitioner - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- Partitioner - Interface in org.apache.storm.hdfs.common
- prepare(Map<String, Object>, int, int) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
- prepare(Map<String, Object>, int, int) - Method in interface org.apache.storm.hdfs.trident.format.FileNameFormat
- prepare(Map<String, Object>, int, int) - Method in class org.apache.storm.hdfs.trident.format.SimpleFileNameFormat
- prepare(Map<String, Object>, TopologyContext) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
- prepare(Map<String, Object>, TopologyContext) - Method in interface org.apache.storm.hdfs.bolt.format.FileNameFormat
- prepare(Map<String, Object>, TopologyContext) - Method in class org.apache.storm.hdfs.bolt.format.SimpleFileNameFormat
- prepare(Map<String, Object>, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
-
Marked as final to prevent override.
- ProgressTracker - Class in org.apache.storm.hdfs.spout
- ProgressTracker() - Constructor for class org.apache.storm.hdfs.spout.ProgressTracker
R
- read(Kryo, Input, Class<? extends GenericContainer>) - Method in class org.apache.storm.hdfs.avro.AbstractAvroSerializer
- READER_TYPE - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setReaderType(String) - ReaderTypeValidator() - Constructor for class org.apache.storm.hdfs.spout.Configs.ReaderTypeValidator
- recordAckedOffset(FileOffset) - Method in class org.apache.storm.hdfs.spout.ProgressTracker
- RecordFormat - Interface in org.apache.storm.hdfs.bolt.format
-
Formats a Tuple object into a byte array that will be written to HDFS.
- RecordFormat - Interface in org.apache.storm.hdfs.trident.format
-
Formats a Tuple object into a byte array that will be written to HDFS.
- recordsSinceLastSync - Variable in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- release() - Method in class org.apache.storm.hdfs.spout.DirLock
-
Release lock on dir by deleting the lock file.
- release() - Method in class org.apache.storm.hdfs.spout.FileLock
-
Release lock by deleting file.
- reset() - Method in interface org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy
-
Called after the HdfsBolt rotates a file.
- reset() - Method in class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy
- reset() - Method in class org.apache.storm.hdfs.bolt.rotation.NoRotationPolicy
- reset() - Method in class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
-
Called after the HdfsBolt rotates a file.
- reset() - Method in class org.apache.storm.hdfs.bolt.sync.CountSyncPolicy
- reset() - Method in interface org.apache.storm.hdfs.bolt.sync.SyncPolicy
-
Called after the HdfsBolt performs a sync.
- reset() - Method in interface org.apache.storm.hdfs.trident.rotation.FileRotationPolicy
-
Called after the HdfsBolt rotates a file.
- reset() - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
- reset() - Method in class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
- reset() - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
-
Called after the HdfsBolt rotates a file.
- reset() - Method in class org.apache.storm.hdfs.trident.sync.CountSyncPolicy
- reset() - Method in interface org.apache.storm.hdfs.trident.sync.SyncPolicy
-
Called after the HdfsBolt performs a sync.
- rotateOutputFile() - Method in class org.apache.storm.hdfs.trident.HdfsState.Options
- rotateOutputFile(boolean) - Method in class org.apache.storm.hdfs.trident.HdfsState.Options
- rotateOutputFile(Writer) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- rotation - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
- RotationAction - Interface in org.apache.storm.hdfs.common.rotation
- rotationActions - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- rotationActions - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
- rotationCounterMap - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- rotationPolicy - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- rotationPolicy - Variable in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- rotationPolicy - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
- rotationTimer - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
S
- SECONDS - Enum constant in enum class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
- SECONDS - Enum constant in enum class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
- SEQ - Static variable in class org.apache.storm.hdfs.spout.Configs
- SequenceFileBolt - Class in org.apache.storm.hdfs.bolt
- SequenceFileBolt() - Constructor for class org.apache.storm.hdfs.bolt.SequenceFileBolt
- SequenceFileOptions() - Constructor for class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- SequenceFileReader<KeyT extends org.apache.hadoop.io.Writable,
ValueT extends org.apache.hadoop.io.Writable> - Class in org.apache.storm.hdfs.spout - SequenceFileReader(FileSystem, Path, Map<String, Object>) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader
- SequenceFileReader(FileSystem, Path, Map<String, Object>, String) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader
- SequenceFileReader.Offset - Class in org.apache.storm.hdfs.spout
- SequenceFileWriter - Class in org.apache.storm.hdfs.common
- SequenceFileWriter(FileRotationPolicy, Path, SequenceFile.Writer, SequenceFormat) - Constructor for class org.apache.storm.hdfs.common.SequenceFileWriter
- SequenceFormat - Interface in org.apache.storm.hdfs.bolt.format
-
Interface for converting
Tupleobjects to HDFS sequence file key-value pairs. - SequenceFormat - Interface in org.apache.storm.hdfs.trident.format
-
Interface for converting
TridentTupleobjects to HDFS sequence file key-value pairs. - setArchiveDir(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setBadFilesDir(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setClocksInSync(boolean) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setCommitFrequencyCount(int) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setCommitFrequencySec(int) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setHdfsUri(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setIgnoreSuffix(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setLockDir(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setLockTimeoutSec(int) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setMaxOutstanding(int) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setReaderType(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- setSourceDir(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
- SimpleFileNameFormat - Class in org.apache.storm.hdfs.bolt.format
- SimpleFileNameFormat - Class in org.apache.storm.hdfs.trident.format
- SimpleFileNameFormat() - Constructor for class org.apache.storm.hdfs.bolt.format.SimpleFileNameFormat
- SimpleFileNameFormat() - Constructor for class org.apache.storm.hdfs.trident.format.SimpleFileNameFormat
- size() - Method in class org.apache.storm.hdfs.spout.ProgressTracker
- SOURCE_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
-
Deprecated.please use
HdfsSpout.setSourceDir(String) - start() - Method in interface org.apache.storm.hdfs.trident.rotation.FileRotationPolicy
-
Start the policy.
- start() - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
- start() - Method in class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
- start() - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
-
Start the timer to run at fixed intervals.
- sync() - Method in interface org.apache.storm.hdfs.bolt.Writer
- sync() - Method in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- syncPolicy - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- SyncPolicy - Interface in org.apache.storm.hdfs.bolt.sync
-
Interface for controlling when the HdfsBolt syncs and flushes the filesystem.
- SyncPolicy - Interface in org.apache.storm.hdfs.trident.sync
-
Interface for controlling when the HdfsBolt syncs and flushes the filesystem.
T
- takeOwnership(FileSystem, Path, FileLock.LogEntry, String) - Static method in class org.apache.storm.hdfs.spout.FileLock
-
Takes ownership of the lock file if possible.
- takeOwnershipIfStale(FileSystem, Path, int) - Static method in class org.apache.storm.hdfs.spout.DirLock
-
if the lock on the directory is stale, take ownership.
- TB - Enum constant in enum class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
- TB - Enum constant in enum class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
- TEXT - Static variable in class org.apache.storm.hdfs.spout.Configs
- TextFileReader - Class in org.apache.storm.hdfs.spout
- TextFileReader(FileSystem, Path, Map<String, Object>) - Constructor for class org.apache.storm.hdfs.spout.TextFileReader
- TextFileReader(FileSystem, Path, Map<String, Object>, String) - Constructor for class org.apache.storm.hdfs.spout.TextFileReader
- TextFileReader.Offset - Class in org.apache.storm.hdfs.spout
- tickTupleInterval - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- TimedRotationPolicy - Class in org.apache.storm.hdfs.bolt.rotation
- TimedRotationPolicy - Class in org.apache.storm.hdfs.trident.rotation
- TimedRotationPolicy(float, TimedRotationPolicy.TimeUnit) - Constructor for class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
- TimedRotationPolicy(float, TimedRotationPolicy.TimeUnit) - Constructor for class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
- TimedRotationPolicy(long) - Constructor for class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
- TimedRotationPolicy.TimeUnit - Enum Class in org.apache.storm.hdfs.bolt.rotation
- TimedRotationPolicy.TimeUnit - Enum Class in org.apache.storm.hdfs.trident.rotation
- toDestination(String) - Method in class org.apache.storm.hdfs.common.rotation.MoveFileAction
- toString() - Method in class org.apache.storm.hdfs.spout.FileLock.LogEntry
- toString() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
- toString() - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
- tryCreateFile(FileSystem, Path) - Static method in class org.apache.storm.hdfs.common.HdfsUtils
-
Returns null if file already exists.
- tryLock(FileSystem, Path) - Static method in class org.apache.storm.hdfs.spout.DirLock
-
Get a lock on file if not already locked.
- tryLock(FileSystem, Path, Path, String) - Static method in class org.apache.storm.hdfs.spout.FileLock
-
returns lock on file or null if file is already locked.
U
- updateState(List<TridentTuple>, TridentCollector) - Method in class org.apache.storm.hdfs.trident.HdfsState
- updateState(HdfsState, List<TridentTuple>, TridentCollector) - Method in class org.apache.storm.hdfs.trident.HdfsUpdater
V
- validateField(String, Object) - Method in class org.apache.storm.hdfs.spout.Configs.ReaderTypeValidator
- value(TridentTuple) - Method in class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
- value(TridentTuple) - Method in interface org.apache.storm.hdfs.trident.format.SequenceFormat
-
Given a tuple, return the value that should be written to the sequence file.
- value(Tuple) - Method in class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
- value(Tuple) - Method in interface org.apache.storm.hdfs.bolt.format.SequenceFormat
-
Given a tuple, return the value that should be written to the sequence file.
- valueClass() - Method in class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
- valueClass() - Method in interface org.apache.storm.hdfs.bolt.format.SequenceFormat
-
Value class used by implementation (e.g.
- valueClass() - Method in class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
- valueClass() - Method in interface org.apache.storm.hdfs.trident.format.SequenceFormat
-
Value class used by implementation (e.g.
- valueOf(String) - Static method in enum class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
-
Returns the enum constant of this class with the specified name.
- values() - Static method in enum class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
-
Returns an array containing the constants of this enum class, in the order they are declared.
W
- withBufferSize(int) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
-
Set the size of the buffer used for hdfs file copy in case of recovery.
- withCompressionCodec(String) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withCompressionCodec(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- withCompressionType(SequenceFile.CompressionType) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withCompressionType(SequenceFile.CompressionType) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- withConfigKey(String) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- withConfigKey(String) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withConfigKey(String) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withConfigKey(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
-
set key name under which HDFS options are placed.
- withConfigKey(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- withConfigKey(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- withExtension(String) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
-
Overrides the default file extension.
- withExtension(String) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
-
Overrides the default file extension.
- withFieldDelimiter(String) - Method in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
-
Overrides the default field delimiter.
- withFieldDelimiter(String) - Method in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
-
Overrides the default field delimiter.
- withFields(Fields) - Method in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
-
Only output the specified fields.
- withFields(Fields) - Method in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
-
Only output the specified fields.
- withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- withFsUrl(String) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- withFsUrl(String) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withFsUrl(String) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withFsUrl(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- withFsUrl(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- withMaxOpenFiles(int) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- withMaxOpenFiles(int) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withMaxOpenFiles(int) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withName(String) - Method in class org.apache.storm.hdfs.bolt.format.SimpleFileNameFormat
-
support parameters:
$TIME - current time. - withName(String) - Method in class org.apache.storm.hdfs.trident.format.SimpleFileNameFormat
-
support parameters:
$TIME - current time. - withOptions(HdfsState.Options) - Method in class org.apache.storm.hdfs.trident.HdfsStateFactory
- withOutputFields(String...) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
-
Output field names.
- withOutputStream(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
-
Set output stream name.
- withPartitioner(Partitioner) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- withPartitioner(Partitioner) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withPartitioner(Partitioner) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withPath(String) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
- withPath(String) - Method in class org.apache.storm.hdfs.bolt.format.SimpleFileNameFormat
- withPath(String) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
- withPath(String) - Method in class org.apache.storm.hdfs.trident.format.SimpleFileNameFormat
- withPrefix(String) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
-
Overrides the default prefix.
- withPrefix(String) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
-
Overrides the default prefix.
- withRecordDelimiter(String) - Method in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
-
Overrides the default record delimiter.
- withRecordDelimiter(String) - Method in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
-
Overrides the default record delimiter.
- withRecordFormat(RecordFormat) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withRecordFormat(RecordFormat) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- withRetryCount(int) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withRetryCount(int) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
- withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- withSequenceFormat(SequenceFormat) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withSequenceFormat(SequenceFormat) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
- withSyncPolicy(SyncPolicy) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- withSyncPolicy(SyncPolicy) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withSyncPolicy(SyncPolicy) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withTickTupleIntervalSeconds(int) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
- withTickTupleIntervalSeconds(int) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
- withTickTupleIntervalSeconds(int) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
- withTimeFormat(String) - Method in class org.apache.storm.hdfs.bolt.format.SimpleFileNameFormat
- withTimeFormat(String) - Method in class org.apache.storm.hdfs.trident.format.SimpleFileNameFormat
- write(Kryo, Output, GenericContainer) - Method in class org.apache.storm.hdfs.avro.AbstractAvroSerializer
- write(Tuple) - Method in interface org.apache.storm.hdfs.bolt.Writer
- write(Tuple) - Method in class org.apache.storm.hdfs.common.AbstractHDFSWriter
- writeLock - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
- Writer - Interface in org.apache.storm.hdfs.bolt
- writers - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form
HdfsSpout.setArchiveDir(String)