| Modifier and Type | Method and Description |
|---|---|
CrawlDataItem |
CrawlLogIterator.next()
Returns the next valid item from the crawl log.
|
protected CrawlDataItem |
CrawlLogIterator.parseLine(String line)
Parse the a line in the crawl log.
|
| Modifier and Type | Method and Description |
|---|---|
Iterator<CrawlDataItem> |
CrawlLogIterator.iterator() |
| Modifier and Type | Method and Description |
|---|---|
static CrawlSummary |
CrawlSummary.build(Iterable<CrawlDataItem> log)
Builds a global crawl summary (not broken down).
|
static Map<String,CrawlSummary> |
CrawlSummary.byHost(Iterable<CrawlDataItem> log) |
static Map<String,CrawlSummary> |
CrawlSummary.byRegisteredDomain(Iterable<CrawlDataItem> log) |
static Map<String,CrawlSummary> |
CrawlSummary.groupedBy(Iterable<CrawlDataItem> log,
java.util.function.Function<CrawlDataItem,String> keyFunction)
Builds a crawl summary grouped by the given key function.
|
static Map<String,CrawlSummary> |
CrawlSummary.groupedBy(Iterable<CrawlDataItem> log,
java.util.function.Function<CrawlDataItem,String> keyFunction)
Builds a crawl summary grouped by the given key function.
|
Copyright © 2019. All rights reserved.