B C D G H I M N O P S T

B

build(Iterable<CrawlDataItem>) - Static method in class org.netpreserve.logtrix.CrawlSummary

Builds a global crawl summary (not broken down).

byHost(Iterable<CrawlDataItem>) - Static method in class org.netpreserve.logtrix.CrawlSummary

byRegisteredDomain(Iterable<CrawlDataItem>) - Static method in class org.netpreserve.logtrix.CrawlSummary

C

canonicalizeMimeType(String) - Static method in class org.netpreserve.logtrix.CrawlLogUtils

close() - Method in class org.netpreserve.logtrix.CrawlLogIterator

Closes the crawl.log file.

CrawlDataItem - Class in org.netpreserve.logtrix

A base class for individual items of crawl data that should be added to the index.

CrawlLogIterator - Class in org.netpreserve.logtrix

CrawlLogIterator(Path) - Constructor for class org.netpreserve.logtrix.CrawlLogIterator

Create a new CrawlLogIterator that reads items from a Heritrix crawl.log

CrawlLogIterator(Reader) - Constructor for class org.netpreserve.logtrix.CrawlLogIterator

CrawlLogIterator(InputStream) - Constructor for class org.netpreserve.logtrix.CrawlLogIterator

CrawlLogUtils - Class in org.netpreserve.logtrix

CrawlLogUtils() - Constructor for class org.netpreserve.logtrix.CrawlLogUtils

CrawlSummary - Class in org.netpreserve.logtrix

CrawlSummary() - Constructor for class org.netpreserve.logtrix.CrawlSummary

D

describe(int) - Static method in class org.netpreserve.logtrix.StatusCodes

Given a status code from a crawl log returns human readable description.

G

getBytes() - Method in class org.netpreserve.logtrix.Stats

getCaptureBegan() - Method in class org.netpreserve.logtrix.CrawlDataItem

getCaptureDuration() - Method in class org.netpreserve.logtrix.CrawlDataItem

getContentDigest() - Method in class org.netpreserve.logtrix.CrawlDataItem

getCount() - Method in class org.netpreserve.logtrix.Stats

getDescription() - Method in class org.netpreserve.logtrix.Stats

getEtag() - Method in class org.netpreserve.logtrix.CrawlDataItem

getExtraInfo() - Method in class org.netpreserve.logtrix.CrawlDataItem

getFirstTime() - Method in class org.netpreserve.logtrix.Stats

getHoppath() - Method in class org.netpreserve.logtrix.CrawlDataItem

getLastTime() - Method in class org.netpreserve.logtrix.Stats

getMillis() - Method in class org.netpreserve.logtrix.Stats

getMimeType() - Method in class org.netpreserve.logtrix.CrawlDataItem

getMimeTypes() - Method in class org.netpreserve.logtrix.CrawlSummary

getOriginalCrawlLogLine() - Method in class org.netpreserve.logtrix.CrawlDataItem

getParentURL() - Method in class org.netpreserve.logtrix.CrawlDataItem

getRegisteredDomains() - Method in class org.netpreserve.logtrix.CrawlSummary

getSize() - Method in class org.netpreserve.logtrix.CrawlDataItem

getSizeHisto() - Method in class org.netpreserve.logtrix.CrawlSummary

getStatusCode() - Method in class org.netpreserve.logtrix.CrawlDataItem

getStatusCodes() - Method in class org.netpreserve.logtrix.CrawlSummary

getTimestamp() - Method in class org.netpreserve.logtrix.CrawlDataItem

getTotals() - Method in class org.netpreserve.logtrix.CrawlSummary

getUniqueBytes() - Method in class org.netpreserve.logtrix.Stats

getUniqueCount() - Method in class org.netpreserve.logtrix.Stats

getUniqueMillis() - Method in class org.netpreserve.logtrix.Stats

getURL() - Method in class org.netpreserve.logtrix.CrawlDataItem

groupedBy(Iterable<CrawlDataItem>, Function<CrawlDataItem, String>) - Static method in class org.netpreserve.logtrix.CrawlSummary

Builds a crawl summary grouped by the given key function.

H

hasNext() - Method in class org.netpreserve.logtrix.CrawlLogIterator

Returns true if there are more items available.

I

isClientError(int) - Static method in class org.netpreserve.logtrix.StatusCodes

isCrawlerError(int) - Static method in class org.netpreserve.logtrix.StatusCodes

isDuplicate() - Method in class org.netpreserve.logtrix.CrawlDataItem

isError(int) - Static method in class org.netpreserve.logtrix.StatusCodes

isInformational(int) - Static method in class org.netpreserve.logtrix.StatusCodes

isRedirection(int) - Static method in class org.netpreserve.logtrix.StatusCodes

isServerError(int) - Static method in class org.netpreserve.logtrix.StatusCodes

isSuccessful(int) - Static method in class org.netpreserve.logtrix.StatusCodes

iterator() - Method in class org.netpreserve.logtrix.CrawlLogIterator

M

main(String[]) - Static method in class org.netpreserve.logtrix.CrawlSummary

N

next() - Method in class org.netpreserve.logtrix.CrawlLogIterator

Returns the next valid item from the crawl log.

O

org.netpreserve.logtrix - package org.netpreserve.logtrix

P

parseLine(String) - Method in class org.netpreserve.logtrix.CrawlLogIterator

Parse the a line in the crawl log.

prepareNext() - Method in class org.netpreserve.logtrix.CrawlLogIterator

Ready the next item.

S

Stats - Class in org.netpreserve.logtrix

StatusCodes - Class in org.netpreserve.logtrix

Utility methods for working with HTTP and Heritrix status codes.

StatusCodes() - Constructor for class org.netpreserve.logtrix.StatusCodes

T

topN(long) - Method in class org.netpreserve.logtrix.CrawlSummary

Returns a new CrawlSummary with the mime-type and status-code lists limited to the top-N results.

B C D G H I M N O P S T