Serialized Form (storm-hdfs-examples 2.5.0 API)

Package org.apache.storm.hdfs.bolt
- Class org.apache.storm.hdfs.bolt.AbstractHdfsBolt extends org.apache.storm.topology.base.BaseRichBolt implements Serializable
  - Serialized Fields
    - writers
```
Map<K,V> writers
```
    - rotationCounterMap
```
Map<K,V> rotationCounterMap
```
    - rotationActions
```
List<E> rotationActions
```
    - collector
```
org.apache.storm.task.OutputCollector collector
```
    - syncPolicy
```
org.apache.storm.hdfs.bolt.sync.SyncPolicy syncPolicy
```
    - rotationPolicy
```
org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy rotationPolicy
```
    - fileNameFormat
```
org.apache.storm.hdfs.bolt.format.FileNameFormat fileNameFormat
```
    - fsUrl
```
String fsUrl
```
    - configKey
```
String configKey
```
    - offset
```
long offset
```
    - fileRetryCount
```
Integer fileRetryCount
```
    - tickTupleInterval
```
Integer tickTupleInterval
```
    - maxOpenFiles
```
Integer maxOpenFiles
```
    - partitioner
```
org.apache.storm.hdfs.common.Partitioner partitioner
```
    - tupleBatch
```
List<E> tupleBatch
```
- Class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt extends org.apache.storm.hdfs.bolt.AbstractHdfsBolt implements Serializable
- Class org.apache.storm.hdfs.bolt.HdfsBolt extends org.apache.storm.hdfs.bolt.AbstractHdfsBolt implements Serializable
  - Serialized Fields
    - format
```
org.apache.storm.hdfs.bolt.format.RecordFormat format
```
- Class org.apache.storm.hdfs.bolt.HdfsFileTopology.MyBolt extends org.apache.storm.topology.base.BaseRichBolt implements Serializable
  - Serialized Fields
    - counts
```
HashMap<K,V> counts
```
    - collector
```
org.apache.storm.task.OutputCollector collector
```
- Class org.apache.storm.hdfs.bolt.HdfsFileTopology.SentenceSpout extends org.apache.storm.topology.base.BaseRichSpout implements Serializable
  - Serialized Fields
    - pending
```
ConcurrentHashMap<K,V> pending
```
    - collector
```
org.apache.storm.spout.SpoutOutputCollector collector
```
    - sentences
```
String[] sentences
```
    - index
```
int index
```
    - count
```
int count
```
    - total
```
long total
```
- Class org.apache.storm.hdfs.bolt.SequenceFileBolt extends org.apache.storm.hdfs.bolt.AbstractHdfsBolt implements Serializable
  - Serialized Fields
    - format
```
org.apache.storm.hdfs.bolt.format.SequenceFormat format
```
    - compressionType
```
org.apache.hadoop.io.SequenceFile.CompressionType compressionType
```
    - compressionCodec
```
String compressionCodec
```
- Class org.apache.storm.hdfs.bolt.SequenceFileTopology.MyBolt extends org.apache.storm.topology.base.BaseRichBolt implements Serializable
  - Serialized Fields
    - counts
```
HashMap<K,V> counts
```
    - collector
```
org.apache.storm.task.OutputCollector collector
```
- Class org.apache.storm.hdfs.bolt.SequenceFileTopology.SentenceSpout extends org.apache.storm.topology.base.BaseRichSpout implements Serializable
  - Serialized Fields
    - pending
```
ConcurrentHashMap<K,V> pending
```
    - collector
```
org.apache.storm.spout.SpoutOutputCollector collector
```
    - sentences
```
String[] sentences
```
    - index
```
int index
```
    - count
```
int count
```
    - total
```
long total
```

Package org.apache.storm.hdfs.spout

Class org.apache.storm.hdfs.spout.HdfsSpout extends org.apache.storm.topology.base.BaseRichSpout implements Serializable

Serialized Fields

commitTimeElapsed
```
AtomicBoolean commitTimeElapsed
```
inflight
```
HashMap<K,V> inflight
```
retryList
```
LinkedBlockingQueue<E> retryList
```

lastExpiredLock

org.apache.storm.hdfs.common.HdfsUtils.Pair<K,V> lastExpiredLock

hdfsUri
```
String hdfsUri
```
readerType
```
String readerType
```

outputFields

org.apache.storm.tuple.Fields outputFields

sourceDir
```
String sourceDir
```
sourceDirPath
```
org.apache.hadoop.fs.Path sourceDirPath
```
archiveDir
```
String archiveDir
```

archiveDirPath

org.apache.hadoop.fs.Path archiveDirPath

badFilesDir
```
String badFilesDir
```

badFilesDirPath

org.apache.hadoop.fs.Path badFilesDirPath

lockDir
```
String lockDir
```
lockDirPath
```
org.apache.hadoop.fs.Path lockDirPath
```
commitFrequencyCount
```
int commitFrequencyCount
```
commitFrequencySec
```
int commitFrequencySec
```
maxOutstanding
```
int maxOutstanding
```
lockTimeoutSec
```
int lockTimeoutSec
```
clocksInSync
```
boolean clocksInSync
```
inprogressSuffix
```
String inprogressSuffix
```
ignoreSuffix
```
String ignoreSuffix
```
outputStreamName
```
String outputStreamName
```

tracker

org.apache.storm.hdfs.spout.ProgressTracker tracker

hdfs
```
org.apache.hadoop.fs.FileSystem hdfs
```

reader

org.apache.storm.hdfs.spout.FileReader reader

collector

org.apache.storm.spout.SpoutOutputCollector collector

hdfsConfig

org.apache.hadoop.conf.Configuration hdfsConfig

conf
```
Map<K,V> conf
```

lock

org.apache.storm.hdfs.spout.FileLock lock

spoutId
```
String spoutId
```
lastExpiredLockTime
```
long lastExpiredLockTime
```
tupleCounter
```
long tupleCounter
```
ackEnabled
```
boolean ackEnabled
```
acksSinceLastCommit
```
int acksSinceLastCommit
```
commitTimer
```
Timer commitTimer
```
fileReadCompletely
```
boolean fileReadCompletely
```
configKey
```
String configKey
```

Class org.apache.storm.hdfs.spout.HdfsSpoutTopology.ConstBolt extends org.apache.storm.topology.base.BaseRichBolt implements Serializable

serialVersionUID:

-5313598399155365865L
- Serialized Fields
  - count
```
int count
```
  - collector
```
org.apache.storm.task.OutputCollector collector
```
Class org.apache.storm.hdfs.spout.ParseException extends Exception implements Serializable

Package org.apache.storm.hdfs.trident
- Class org.apache.storm.hdfs.trident.FixedBatchSpout extends Object implements Serializable
  - Serialized Fields
    - fields
```
org.apache.storm.tuple.Fields fields
```
    - outputs
```
List<E>[] outputs
```
    - maxBatchSize
```
int maxBatchSize
```
    - batches
```
HashMap<K,V> batches
```
    - index
```
int index
```
    - cycle
```
boolean cycle
```
- Class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions extends org.apache.storm.hdfs.trident.HdfsState.Options implements Serializable
  - Serialized Fields
    - format
```
org.apache.storm.hdfs.trident.format.RecordFormat format
```
    - offset
```
long offset
```
    - bufferSize
```
int bufferSize
```
- Class org.apache.storm.hdfs.trident.HdfsState.Options extends Object implements Serializable
  - Serialized Fields
    - fsUrl
```
String fsUrl
```
    - configKey
```
String configKey
```
    - rotationPolicy
```
org.apache.storm.hdfs.trident.rotation.FileRotationPolicy rotationPolicy
```
    - fileNameFormat
```
org.apache.storm.hdfs.trident.format.FileNameFormat fileNameFormat
```
    - rotation
```
int rotation
```
    - rotationActions
```
ArrayList<E> rotationActions
```
    - currentFile
```
org.apache.hadoop.fs.Path currentFile
```
- Class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions extends org.apache.storm.hdfs.trident.HdfsState.Options implements Serializable
  - Serialized Fields
    - format
```
org.apache.storm.hdfs.trident.format.SequenceFormat format
```
    - compressionType
```
org.apache.hadoop.io.SequenceFile.CompressionType compressionType
```
    - compressionCodec
```
String compressionCodec
```
- Class org.apache.storm.hdfs.trident.HdfsStateFactory extends Object implements Serializable
  - Serialized Fields
    - options
```
org.apache.storm.hdfs.trident.HdfsState.Options options
```
- Class org.apache.storm.hdfs.trident.HdfsUpdater extends org.apache.storm.trident.state.BaseStateUpdater<org.apache.storm.hdfs.trident.HdfsState> implements Serializable

Serialized Form

Package org.apache.storm.hdfs.bolt

Class org.apache.storm.hdfs.bolt.AbstractHdfsBolt extends org.apache.storm.topology.base.BaseRichBolt implements Serializable

Serialized Fields

writers

rotationCounterMap

rotationActions

collector

syncPolicy

rotationPolicy

fileNameFormat

fsUrl

configKey

offset

fileRetryCount

tickTupleInterval

maxOpenFiles

partitioner

tupleBatch

Class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt extends org.apache.storm.hdfs.bolt.AbstractHdfsBolt implements Serializable

Class org.apache.storm.hdfs.bolt.HdfsBolt extends org.apache.storm.hdfs.bolt.AbstractHdfsBolt implements Serializable

Serialized Fields

format

Class org.apache.storm.hdfs.bolt.HdfsFileTopology.MyBolt extends org.apache.storm.topology.base.BaseRichBolt implements Serializable

Serialized Fields

counts

collector

Class org.apache.storm.hdfs.bolt.HdfsFileTopology.SentenceSpout extends org.apache.storm.topology.base.BaseRichSpout implements Serializable

Serialized Fields

pending

collector

sentences

index

count

total

Class org.apache.storm.hdfs.bolt.SequenceFileBolt extends org.apache.storm.hdfs.bolt.AbstractHdfsBolt implements Serializable

Serialized Fields

format

compressionType

compressionCodec

Class org.apache.storm.hdfs.bolt.SequenceFileTopology.MyBolt extends org.apache.storm.topology.base.BaseRichBolt implements Serializable

Serialized Fields

counts

collector

Class org.apache.storm.hdfs.bolt.SequenceFileTopology.SentenceSpout extends org.apache.storm.topology.base.BaseRichSpout implements Serializable

Serialized Fields

pending

collector

sentences

index

count

total

Package org.apache.storm.hdfs.spout

Class org.apache.storm.hdfs.spout.HdfsSpout extends org.apache.storm.topology.base.BaseRichSpout implements Serializable

Serialized Fields

commitTimeElapsed

inflight

retryList

lastExpiredLock

hdfsUri

readerType

outputFields

sourceDir

sourceDirPath

archiveDir

archiveDirPath

badFilesDir

badFilesDirPath

lockDir

lockDirPath

commitFrequencyCount

commitFrequencySec

maxOutstanding

lockTimeoutSec

clocksInSync

inprogressSuffix

ignoreSuffix

outputStreamName

tracker

hdfs