org.netpreserve.logtrix

Class CrawlSummary

java.lang.Object

org.netpreserve.logtrix.CrawlSummary

public class CrawlSummary
extends Object

Constructor Summary

Constructors

Constructor and Description
CrawlSummary()

Method Summary

Modifier and Type	Method and Description
static CrawlSummary	build(Iterable<CrawlDataItem> log) Builds a global crawl summary (not broken down).
static Map<String,CrawlSummary>	byHost(Iterable<CrawlDataItem> log)
static Map<String,CrawlSummary>	byRegisteredDomain(Iterable<CrawlDataItem> log)
Map<String,Stats>	getMimeTypes()
Map<String,Stats>	getRegisteredDomains()
Map<Long,Stats>	getSizeHisto()
Map<Integer,Stats>	getStatusCodes()
Stats	getTotals()
static Map<String,CrawlSummary>	groupedBy(Iterable<CrawlDataItem> log, java.util.function.Function<CrawlDataItem,String> keyFunction) Builds a crawl summary grouped by the given key function.
static void	main(String[] args)
CrawlSummary	topN(long n) Returns a new CrawlSummary with the mime-type and status-code lists limited to the top-N results.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CrawlSummary

public CrawlSummary()

Method Detail

build

public static CrawlSummary build(Iterable<CrawlDataItem> log)

Builds a global crawl summary (not broken down).

groupedBy

public static Map<String,CrawlSummary> groupedBy(Iterable<CrawlDataItem> log,
                                                 java.util.function.Function<CrawlDataItem,String> keyFunction)

Builds a crawl summary grouped by the given key function.

byHost

public static Map<String,CrawlSummary> byHost(Iterable<CrawlDataItem> log)

byRegisteredDomain

public static Map<String,CrawlSummary> byRegisteredDomain(Iterable<CrawlDataItem> log)

topN

public CrawlSummary topN(long n)

Returns a new CrawlSummary with the mime-type and status-code lists limited to the top-N results.

getTotals

public Stats getTotals()

getStatusCodes

public Map<Integer,Stats> getStatusCodes()

getMimeTypes

public Map<String,Stats> getMimeTypes()

getSizeHisto

public Map<Long,Stats> getSizeHisto()

getRegisteredDomains

public Map<String,Stats> getRegisteredDomains()

main

public static void main(String[] args)
                 throws IOException

Throws:

IOException