Skip navigation links
A B C D E F G H I J K L M N O P Q R S T U V W 

A

aborted(Campaign, Crawl, double) - Static method in class de.l3s.icrawl.domain.status.CrawlStatus
 
aborted(long, String, double) - Static method in class de.l3s.icrawl.domain.status.ExportStatus
 
ABORTED - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
The job has been stopped because of a user request.
AbstractApiFetcher - Class in de.l3s.icrawl.api
Base class for API fetcher implementations.
AbstractApiFetcher() - Constructor for class de.l3s.icrawl.api.AbstractApiFetcher
 
add(T) - Method in class de.l3s.icrawl.domain.support.CountedSet
 
add(T, int) - Method in class de.l3s.icrawl.domain.support.CountedSet
 
add() - Method in class de.l3s.icrawl.ui.CampaignController
 
add(Campaign) - Method in class de.l3s.icrawl.ui.CrawlController
 
addCampaign(Campaign) - Method in interface de.l3s.icrawl.service.CrawlService
Add a new crawl campaign to the repository.
addCampaign(Campaign) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
addCrawl(Crawl) - Method in class de.l3s.icrawl.domain.specification.Campaign
 
addCrawl(Crawl) - Method in interface de.l3s.icrawl.service.CrawlService
 
addCrawl(Crawl) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
addElementHidingRule(ElementFilter) - Method in class de.l3s.icrawl.adblock.FilterSet.Builder
 
addEntity(NamedEntity) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
addExceptionRule(Filter) - Method in class de.l3s.icrawl.adblock.FilterSet.Builder
 
addFormatters(FormatterRegistry) - Method in class de.l3s.icrawl.ui.MvcConfig
 
addKeyword(String) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
addLabel(NamedEntity.Label) - Method in class de.l3s.icrawl.domain.specification.NamedEntity
 
addLabel(String, String) - Method in class de.l3s.icrawl.domain.specification.NamedEntity
 
addLabel(Label) - Method in class de.l3s.icrawl.service.EvaluationService
 
addMetadata(String, Object) - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
addMetadata(Map<String, Object>) - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
addMetadata(String, Object) - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
addMetadata(Map<String, Object>) - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
addMetadata(String, Object) - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
addMetadata(Map<String, Object>) - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
addMetadata(String, Object) - Method in class de.l3s.icrawl.domain.specification.CrawlUrl
 
addRequest(ApiRequest, ApiFetcherContext) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
AddressPartFilter - Class in de.l3s.icrawl.adblock
 
AddressPartFilter(String, boolean, TypeRestriction, DomainRestriction) - Constructor for class de.l3s.icrawl.adblock.AddressPartFilter
 
addSeed(CrawlUrl) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
addToLog(Collection<LogEntry>) - Method in class de.l3s.icrawl.domain.evaluation.SessionLog
 
addUri(String, ApiFetcherContext) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
addUri(String, ApiFetcherContext) - Method in interface de.l3s.icrawl.api.ApiFetcher
Start following updates for the given URI The processing of the request SHOULD happen asynchronously.
addUrlRule(Filter) - Method in class de.l3s.icrawl.adblock.FilterSet.Builder
 
addViewControllers(ViewControllerRegistry) - Method in class de.l3s.icrawl.ui.MvcConfig
 
addVote(EvaluationVote) - Method in class de.l3s.icrawl.domain.evaluation.EvaluationUrl
 
addVote(EvaluationVote) - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
addVote(Evaluator, String, int, String) - Method in class de.l3s.icrawl.service.EvaluationService
 
aggregateCrawlStatus(Collection<? extends TaskExecution>) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
analyze(DocumentFragment, Set<String>) - Method in class de.l3s.icrawl.online.ContentAnalyser
 
analyze(List<String>, Set<String>) - Method in class de.l3s.icrawl.online.ContentAnalyser
 
analyze(List<SeedSearchResult>) - Method in interface de.l3s.icrawl.ui.wizard.SeedCandidateAnalyzer
 
analyze(List<SeedSearchResult>) - Method in class de.l3s.icrawl.ui.wizard.SeedCandidateAnalyzerImpl
 
ANCHOR_SCORE_WEIGHT - Static variable in class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
API_BATCH_ID - Static variable in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
ApiFetcher - Interface in de.l3s.icrawl.api
Module to monitor streams of documents from an API.
ApiFetcher.Status - Enum in de.l3s.icrawl.api
Current runtime status of the fetcher.
ApiFetcherConfig - Class in de.l3s.icrawl.domain.specification
 
ApiFetcherConfig() - Constructor for class de.l3s.icrawl.domain.specification.ApiFetcherConfig
 
ApiFetcherConfig(String, String) - Constructor for class de.l3s.icrawl.domain.specification.ApiFetcherConfig
 
ApiFetcherContext - Interface in de.l3s.icrawl.api
Callback interface for API fetchers.
ApiFetcherDocument - Class in de.l3s.icrawl.domain.api
A document retrieved from a (social media) API.
ApiFetcherDocument.Builder - Class in de.l3s.icrawl.domain.api
Construct a ApiFetcherDocument step by step.
ApiFetcherException - Exception in de.l3s.icrawl.domain.api
Could not retrieve data through a Web platform API.
ApiFetcherException(String) - Constructor for exception de.l3s.icrawl.domain.api.ApiFetcherException
 
ApiFetcherException(Throwable) - Constructor for exception de.l3s.icrawl.domain.api.ApiFetcherException
 
ApiFetcherException(String, Throwable) - Constructor for exception de.l3s.icrawl.domain.api.ApiFetcherException
 
ApiFetcherExecutionRecord - Class in de.l3s.icrawl.domain.crawl
 
ApiFetcherExecutionRecord(Long, Campaign, Crawl, DateTime, DateTime, String, String) - Constructor for class de.l3s.icrawl.domain.crawl.ApiFetcherExecutionRecord
 
ApiFetcherJob - Class in de.l3s.icrawl.apifetcher
 
ApiFetcherJob(ApiFetcher, Injector, Crawl, ApiFetcherConfig) - Constructor for class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
ApiFetcherManager - Interface in de.l3s.icrawl.apifetcher
 
apiFetcherManager - Variable in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
ApiFetcherManagerImpl - Class in de.l3s.icrawl.apifetcher
 
ApiFetcherManagerImpl(Map<String, ApiFetcher>, InjectorFactory) - Constructor for class de.l3s.icrawl.apifetcher.ApiFetcherManagerImpl
 
ApiFetcherStatus - Class in de.l3s.icrawl.domain.status
 
ApiRequest - Class in de.l3s.icrawl.domain.api
 
ApiRequest(String, String, Set<String>, Set<String>, Set<String>, Set<String>, Set<String>, Map<String, String>) - Constructor for class de.l3s.icrawl.domain.api.ApiRequest
 
ApiRequest(String, String) - Constructor for class de.l3s.icrawl.domain.api.ApiRequest
 
ApiSearcher - Interface in de.l3s.icrawl.ui.wizard
 
ApiStatus - Class in de.l3s.icrawl.domain.status
 
ApiStatus(Multiset<ApiStatus.ErrorType>, long, long, long) - Constructor for class de.l3s.icrawl.domain.status.ApiStatus
 
ApiStatus.ErrorBehavior - Enum in de.l3s.icrawl.domain.status
 
ApiStatus.ErrorType - Enum in de.l3s.icrawl.domain.status
 
ApiUrlParser - Class in de.l3s.icrawl.api
 
ApiUrlParser() - Constructor for class de.l3s.icrawl.api.ApiUrlParser
 
ApolloMessageBusManager - Class in de.l3s.icrawl.process.impl
 
ApolloMessageBusManager(File, int, int) - Constructor for class de.l3s.icrawl.process.impl.ApolloMessageBusManager
 
applyConfiguration() - Method in class de.l3s.icrawl.crawlmanager.CrawlJob
 
archiveCampaign(Campaign) - Method in interface de.l3s.icrawl.service.CrawlService
Mark a campaign as archived.
archiveCampaign(Campaign) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
Arguments() - Constructor for class de.l3s.icrawl.evaluation.ReferenceVectorExtractor.Arguments
 
asByteBuffer(long) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asByteBuffer(String) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asByteBuffer(float) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asByteBuffer(double) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asByteBuffer(Map<String, Double>) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asFloat(ByteBuffer) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asInt(ByteBuffer) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asList(ByteBuffer, Class<T>) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asLong(ByteBuffer) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asMap(ByteBuffer, Class<K>, Class<V>) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asMultiset(ByteBuffer, Class<T>) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
asMultiset() - Method in class de.l3s.icrawl.domain.support.CountedSet
 
assemble(Serializable, Object) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
asString(ByteBuffer) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
AugmentedCrawlStatus - Class in de.l3s.icrawl.domain.status
 
AugmentedCrawlStatus(long, long, String, DateTime, long, int, String, double) - Constructor for class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 

B

BatchController - Class in de.l3s.icrawl.ui
 
BatchController() - Constructor for class de.l3s.icrawl.ui.BatchController
 
BatchController.BatchPage - Class in de.l3s.icrawl.ui
 
batchId - Variable in class de.l3s.icrawl.crawlmanager.step.Step
 
BatchIdProducer - Class in de.l3s.icrawl.evaluation.twitterfetcher
 
BatchPage(String, float) - Constructor for class de.l3s.icrawl.ui.BatchController.BatchPage
 
batchQuery(TaskExecutionRecord<?>, int) - Static method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
BatchRecord - Class in de.l3s.icrawl.domain.crawl
 
BatchRecord() - Constructor for class de.l3s.icrawl.domain.crawl.BatchRecord
 
BatchRecord(BatchRecord.BatchRecordKey) - Constructor for class de.l3s.icrawl.domain.crawl.BatchRecord
 
BatchRecord.BatchRecordKey - Class in de.l3s.icrawl.domain.crawl
 
BatchRecordKey(long, int) - Constructor for class de.l3s.icrawl.domain.crawl.BatchRecord.BatchRecordKey
 
BatchRecordRepository - Interface in de.l3s.icrawl.repository
 
BatchRelevance - Class in de.l3s.icrawl.evaluation
 
BatchRelevance() - Constructor for class de.l3s.icrawl.evaluation.BatchRelevance
 
BatchRelevance.BatchRelevanceConfiguration - Class in de.l3s.icrawl.evaluation
 
BatchRelevance.BatchRelevanceMapper - Class in de.l3s.icrawl.evaluation
 
BatchRelevance.BatchRelevanceReducer - Class in de.l3s.icrawl.evaluation
 
BatchRelevanceConfiguration() - Constructor for class de.l3s.icrawl.evaluation.BatchRelevance.BatchRelevanceConfiguration
 
BatchRelevanceMapper() - Constructor for class de.l3s.icrawl.evaluation.BatchRelevance.BatchRelevanceMapper
 
BatchRelevanceReducer() - Constructor for class de.l3s.icrawl.evaluation.BatchRelevance.BatchRelevanceReducer
 
BatchScore - Class in de.l3s.icrawl.evaluation
 
BatchScore() - Constructor for class de.l3s.icrawl.evaluation.BatchScore
 
BatchScore(String, double) - Constructor for class de.l3s.icrawl.evaluation.BatchScore
 
BatchScoreCounter - Class in de.l3s.icrawl.crawlmanager.step
 
BatchScoreCounter(CrawlDataRepositoryTemplate, TaskExecutionService, Configuration) - Constructor for class de.l3s.icrawl.crawlmanager.step.BatchScoreCounter
 
BatchScoreCounter.BatchScoreCounterMapper - Class in de.l3s.icrawl.crawlmanager.step
 
BatchScoreCounter.BatchScoreCounterReducer - Class in de.l3s.icrawl.crawlmanager.step
 
BatchScoreCounterMapper() - Constructor for class de.l3s.icrawl.crawlmanager.step.BatchScoreCounter.BatchScoreCounterMapper
 
BatchScoreCounterReducer() - Constructor for class de.l3s.icrawl.crawlmanager.step.BatchScoreCounter.BatchScoreCounterReducer
 
BingApiSearcher - Class in de.l3s.icrawl.ui.wizard
 
BingApiSearcher(String) - Constructor for class de.l3s.icrawl.ui.wizard.BingApiSearcher
 
BingSearchResult - Class in de.l3s.icrawl.ui.wizard
 
BingSearchResult() - Constructor for class de.l3s.icrawl.ui.wizard.BingSearchResult
 
BingSearchResultSet - Class in de.l3s.icrawl.ui.wizard
 
BingSearchResultSet() - Constructor for class de.l3s.icrawl.ui.wizard.BingSearchResultSet
 
Bootstrap - Class in de.l3s.icrawl.process
 
Bootstrap() - Constructor for class de.l3s.icrawl.process.Bootstrap
 
build() - Method in class de.l3s.icrawl.adblock.FilterSet.Builder
 
build() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Check the set values and create a new ApiFetcherDocument object.
Builder() - Constructor for class de.l3s.icrawl.adblock.FilterSet.Builder
 
builder() - Static method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
Builder() - Constructor for class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
 
buildLanguage(String) - Static method in class com.sharethis.textrank.LanguageModel
Factory method, loads libraries for StanfordCoreNLP based on the given language code.
buildNGram(Graph, Sentence, List<Integer>, double) - Static method in class com.sharethis.textrank.NGram
Factory method.
buildNode(Graph, String, NodeValue) - Static method in class com.sharethis.textrank.Node
Factory method.
ByteBufferBackedInputStream - Class in de.l3s.icrawl.util
 
ByteBufferBackedInputStream(ByteBuffer) - Constructor for class de.l3s.icrawl.util.ByteBufferBackedInputStream
 
ByteBufferUtils - Class in de.l3s.icrawl.domain.support
 

C

calcStats(Graph) - Static method in class com.sharethis.textrank.NGram
Determine a statistical distribution for the n-gram subgraph.
call() - Method in class com.sharethis.textrank.TextRank
Run the TextRank algorithm on the given semi-structured text (e.g., results of parsed HTML from crawled web content) to build a graph of weighted key phrases.
campaign - Variable in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
Campaign - Class in de.l3s.icrawl.domain.specification
A collection of crawls that make up one final archive.
Campaign() - Constructor for class de.l3s.icrawl.domain.specification.Campaign
 
Campaign(String) - Constructor for class de.l3s.icrawl.domain.specification.Campaign
 
Campaign(Long, String, String, DateTime, DateTime, String) - Constructor for class de.l3s.icrawl.domain.specification.Campaign
 
CAMPAIGN_ID_KEY - Static variable in class de.l3s.icrawl.ui.wayback.HBaseResourceIndex
 
CampaignController - Class in de.l3s.icrawl.ui
 
campaignId - Variable in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor.Arguments
 
CampaignRepository - Interface in de.l3s.icrawl.repository
 
CASH - Static variable in class de.l3s.icrawl.FieldNames
 
checkScope(String, String) - Method in interface de.l3s.icrawl.crawlmanager.CrawlScope
Check if the given page is in the scope of the crawl.
cleanURL(String) - Static method in class de.l3s.icrawl.online.KeywordExtractorParseFilter
Remove some crud from an URL
clearGenerateMarks(String) - Method in class de.l3s.icrawl.crawlmanager.step.ClearMarksJob
 
ClearGenerateMarksStep - Class in de.l3s.icrawl.crawlmanager.step
 
ClearGenerateMarksStep() - Constructor for class de.l3s.icrawl.crawlmanager.step.ClearGenerateMarksStep
 
ClearMarksJob - Class in de.l3s.icrawl.crawlmanager.step
 
ClearMarksJob(Configuration) - Constructor for class de.l3s.icrawl.crawlmanager.step.ClearMarksJob
 
CLIUtils - Class in de.l3s.icrawl.evaluation
 
close() - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
close() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherManagerImpl
 
close() - Method in class de.l3s.icrawl.apifetcher.InjectorFactory
 
close() - Method in class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
close() - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
close() - Method in class de.l3s.icrawl.evaluation.twitterfetcher.TwitterFetcher
 
close() - Method in class de.l3s.icrawl.online.EventSender
 
close() - Method in class de.l3s.icrawl.repository.CrawlDataRepository
 
close() - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
close() - Method in class de.l3s.icrawl.ui.wayback.CrawlResourceRequestMapper
 
close() - Method in class de.l3s.icrawl.ui.wayback.HBaseResource
 
close() - Method in class de.l3s.icrawl.ui.wizard.BingApiSearcher
 
close() - Method in class de.l3s.icrawl.ui.wizard.RedditApiSearcher
 
close() - Method in class de.l3s.icrawl.ui.wizard.SeedCandidateAnalyzerImpl
 
Collapse - Annotation Type in de.l3s.icrawl.domain.support
Mark an object property that should be collapsed into a single database field.
collectNGrams(LanguageModel, List<Sentence>, double) - Static method in class com.sharethis.textrank.NGram
Report the n-grams marked in each sentence.
com.sharethis.textrank - package com.sharethis.textrank
 
compareTo(MetricVector) - Method in class com.sharethis.textrank.MetricVector
Compare method for sort ordering.
compareTo(NGram) - Method in class com.sharethis.textrank.NGram
Compare method for sort ordering.
compareTo(Node) - Method in class com.sharethis.textrank.Node
Compare method for sort ordering.
compareTo(BatchScore) - Method in class de.l3s.icrawl.evaluation.BatchScore
 
compareTo(DateTimeWritable) - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
CompositeCrawlStatus - Class in de.l3s.icrawl.domain.status
 
CompositeCrawlStatus(Collection<TaskStatus>) - Constructor for class de.l3s.icrawl.domain.status.CompositeCrawlStatus
 
computeFreshness(long) - Method in class de.l3s.icrawl.evaluation.FreshnessComputation
 
computeScores(long, DocumentVectorSimilarity) - Method in class de.l3s.icrawl.evaluation.BatchRelevance
 
conf - Variable in class de.l3s.icrawl.api.AbstractApiFetcher
 
confForCrawl(Configuration, CrawlExecutionRecord) - Static method in class de.l3s.icrawl.crawlmanager.CrawlJob
 
configuration - Variable in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
configure(AuthenticationManagerBuilder) - Method in class de.l3s.icrawl.ui.WebSecurityConfig
 
configure(HttpSecurity) - Method in class de.l3s.icrawl.ui.WebSecurityConfig
 
configureTasks(ScheduledTaskRegistrar) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerConfig
 
connect(Node) - Method in class com.sharethis.textrank.Node
Connect two nodes with a bi-directional arc in the graph.
connectionFactory() - Method in class de.l3s.icrawl.process.JmsConfig
 
contains(T) - Method in class de.l3s.icrawl.domain.support.CountedSet
 
ContentAnalyser - Class in de.l3s.icrawl.online
 
ContentAnalyser(LanguageDetector, LabelerFactory) - Constructor for class de.l3s.icrawl.online.ContentAnalyser
 
ContentAnalyser.Counts - Class in de.l3s.icrawl.online
 
Context - Class in com.sharethis.textrank
Track the context within a sentence for a selected n-gram.
Context(Sentence, int) - Constructor for class com.sharethis.textrank.Context
Constructor.
contexts - Variable in class com.sharethis.textrank.NGram
 
continueCrawling() - Method in class de.l3s.icrawl.crawlmanager.ContinuousCrawlCondition
 
continueCrawling() - Method in class de.l3s.icrawl.crawlmanager.DepthStoppingCondition
 
continueCrawling() - Method in interface de.l3s.icrawl.crawlmanager.StoppingCondition
Determnines whether a new crawl batch should be started.
ContinuousCrawlCondition - Class in de.l3s.icrawl.crawlmanager
 
ContinuousCrawlCondition() - Constructor for class de.l3s.icrawl.crawlmanager.ContinuousCrawlCondition
 
convertLine(String) - Method in class de.l3s.icrawl.ui.format.CrawlUrlPropertyEditor
 
convertLine(String) - Method in class de.l3s.icrawl.ui.format.EntityPropertyEditor
 
convertLine(String) - Method in class de.l3s.icrawl.ui.format.KeywordPropertyEditor
 
CoreNlpLanguageModel - Class in com.sharethis.textrank
Implementation of English-specific tools for natural language processing.
CoreNlpLanguageModel(WordsToSentencesAnnotator, TokenizerAnnotator, POSTaggerAnnotator, SnowballProgram) - Constructor for class com.sharethis.textrank.CoreNlpLanguageModel
 
cosineSimilarity(DocumentVector) - Method in class de.l3s.icrawl.online.DocumentVector
 
count_rank - Variable in class com.sharethis.textrank.MetricVector
 
CountedSet<T> - Class in de.l3s.icrawl.domain.support
 
CountedSet() - Constructor for class de.l3s.icrawl.domain.support.CountedSet
 
CountedSet(Multiset<T>) - Constructor for class de.l3s.icrawl.domain.support.CountedSet
 
crawl - Variable in class de.l3s.icrawl.crawlmanager.step.Step
 
crawl - Variable in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
Crawl - Class in de.l3s.icrawl.domain.specification
Specify a single crawl.
Crawl() - Constructor for class de.l3s.icrawl.domain.specification.Crawl
 
CRAWL_DB_MANAGER_QUEUE - Static variable in class de.l3s.icrawl.process.JmsConfig
 
CRAWL_MANAGER_MANAGER_QUEUE - Static variable in class de.l3s.icrawl.process.JmsConfig
 
CRAWL_MANAGER_QUEUE - Static variable in class de.l3s.icrawl.process.JmsConfig
 
CRAWL_SPECIFICATION_KEY - Static variable in class de.l3s.icrawl.FieldNames
 
CrawlController - Class in de.l3s.icrawl.ui
 
CrawlDataRepository - Class in de.l3s.icrawl.repository
 
CrawlDataRepository(Configuration) - Constructor for class de.l3s.icrawl.repository.CrawlDataRepository
 
CrawlDataRepository.WebPageInfo - Class in de.l3s.icrawl.repository
 
CrawlDataRepositoryTemplate - Class in de.l3s.icrawl.repository
 
CrawlDataRepositoryTemplate(Configuration) - Constructor for class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
CrawlDataRepositoryTemplate.JobBuilder<MAP_KEY,MAP_VAL,REDUCE_KEY extends org.apache.hadoop.io.Writable,REDUCE_VAL extends org.apache.hadoop.io.Writable> - Class in de.l3s.icrawl.repository
 
CrawlDataRepositoryTemplate.JobSetup - Interface in de.l3s.icrawl.repository
 
CrawlDataRepositoryTemplate.QuerySetup - Interface in de.l3s.icrawl.repository
 
CrawlDataRepositoryTemplate.ResultLinesMapper<KEY,VAL,RESULT> - Interface in de.l3s.icrawl.repository
 
CrawlDataRepositoryTemplate.ResultMapper<T> - Interface in de.l3s.icrawl.repository
 
CrawlDataRepositoryTemplate.StatusFilterQuerySetup - Class in de.l3s.icrawl.repository
 
CrawlDbManager - Interface in de.l3s.icrawl.process
 
CrawlExecutionRecord - Class in de.l3s.icrawl.domain.crawl
 
CrawlExecutionRecord() - Constructor for class de.l3s.icrawl.domain.crawl.CrawlExecutionRecord
 
CrawlExecutionRecord(Crawl) - Constructor for class de.l3s.icrawl.domain.crawl.CrawlExecutionRecord
 
CrawlExecutionRecord(Long, Campaign, Crawl, DateTime, DateTime, CrawlSpecification) - Constructor for class de.l3s.icrawl.domain.crawl.CrawlExecutionRecord
 
CrawlJob - Class in de.l3s.icrawl.crawlmanager
 
CrawlJob(CrawlExecutionRecord, StoppingCondition, Configuration, CrawlDataRepositoryTemplate, long, TaskExecutionService) - Constructor for class de.l3s.icrawl.crawlmanager.CrawlJob
 
crawlKey() - Method in class de.l3s.icrawl.domain.crawl.CrawlExecutionRecord
 
crawlKey(Crawl) - Static method in class de.l3s.icrawl.domain.specification.Crawl
 
crawlKey(Campaign) - Static method in class de.l3s.icrawl.domain.specification.Crawl
 
crawlKey(long) - Static method in class de.l3s.icrawl.domain.specification.Crawl
 
CrawlManager - Interface in de.l3s.icrawl.crawlmanager
Manages the execution of crawls.
CRAWLMANAGER_WS_NAMESPACE - Static variable in class de.l3s.icrawl.util.WebServiceUtils
 
CrawlManagerConfig - Class in de.l3s.icrawl.crawlmanager
 
CrawlManagerConfig() - Constructor for class de.l3s.icrawl.crawlmanager.CrawlManagerConfig
 
CrawlManagerImpl - Class in de.l3s.icrawl.crawlmanager
 
CrawlManagerImpl(CrawlService, TaskExecutionService, CrawlDataRepositoryTemplate, Configuration, ExecutorService, ApiFetcherManager) - Constructor for class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
CrawlManagerManager - Interface in de.l3s.icrawl.process
 
CrawlManagerManagerImpl - Class in de.l3s.icrawl.crawlmanager
 
CrawlManagerManagerImpl() - Constructor for class de.l3s.icrawl.crawlmanager.CrawlManagerManagerImpl
 
CrawlManagerProcessManager - Class in de.l3s.icrawl.process.impl
 
CrawlManagerProcessManager(File, CrawlManagerManager, String) - Constructor for class de.l3s.icrawl.process.impl.CrawlManagerProcessManager
 
CrawlManagerService - Class in de.l3s.icrawl.crawlmanager
 
CrawlManagerService() - Constructor for class de.l3s.icrawl.crawlmanager.CrawlManagerService
 
CrawlRepository - Interface in de.l3s.icrawl.repository
 
CrawlResourceRequestMapper - Class in de.l3s.icrawl.ui.wayback
 
CrawlResourceRequestMapper(HBaseResourceIndexFactory, HBaseResourceStoreFactory, RequestParser, ReplayDispatcher, ContextResultURIConverterFactory, String) - Constructor for class de.l3s.icrawl.ui.wayback.CrawlResourceRequestMapper
 
CrawlSchedule - Class in de.l3s.icrawl.domain.specification
Execute a crawl in a fixed interval, possibly until a given end time.
CrawlSchedule() - Constructor for class de.l3s.icrawl.domain.specification.CrawlSchedule
 
CrawlSchedule(String, DateTime) - Constructor for class de.l3s.icrawl.domain.specification.CrawlSchedule
 
CrawlSchedule(CrawlSchedule.Interval, DateTime) - Constructor for class de.l3s.icrawl.domain.specification.CrawlSchedule
 
CrawlSchedule.Interval - Enum in de.l3s.icrawl.domain.specification
 
CrawlScope - Interface in de.l3s.icrawl.crawlmanager
 
CrawlScope.ScopeResult - Class in de.l3s.icrawl.crawlmanager
 
CrawlService - Interface in de.l3s.icrawl.service
 
CrawlServiceImpl - Class in de.l3s.icrawl.service
 
CrawlServiceImpl(CampaignRepository, CrawlRepository) - Constructor for class de.l3s.icrawl.service.CrawlServiceImpl
 
CrawlSpecification - Class in de.l3s.icrawl.data.specification
Deprecated.
CrawlSpecification() - Constructor for class de.l3s.icrawl.data.specification.CrawlSpecification
Deprecated.
 
CrawlSpecification - Class in de.l3s.icrawl.domain.specification
 
CrawlSpecification() - Constructor for class de.l3s.icrawl.domain.specification.CrawlSpecification
 
CrawlSpecificationUtils - Class in de.l3s.icrawl.domain.specification
 
CrawlStatistic - Class in de.l3s.icrawl.domain.crawl
 
CrawlStatistic(String, Map<String, Long>, String) - Constructor for class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
CrawlStatistics - Class in de.l3s.icrawl.domain.crawl
 
CrawlStatistics(CrawlStatistic...) - Constructor for class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
CrawlStatistics(Collection<CrawlStatistic>) - Constructor for class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
CrawlStatisticsJob - Class in de.l3s.icrawl.crawlmanager
 
CrawlStatisticsJob.CrawlStatisticsMapper - Class in de.l3s.icrawl.crawlmanager
 
CrawlStatisticsJob.CrawlStatisticsReducer - Class in de.l3s.icrawl.crawlmanager
 
CrawlStatisticsMapper() - Constructor for class de.l3s.icrawl.crawlmanager.CrawlStatisticsJob.CrawlStatisticsMapper
 
CrawlStatisticsReducer() - Constructor for class de.l3s.icrawl.crawlmanager.CrawlStatisticsJob.CrawlStatisticsReducer
 
CrawlStatus - Class in de.l3s.icrawl.domain.status
 
CrawlUpdatesFinder - Class in de.l3s.icrawl.crawlmanager
 
CrawlUpdatesFinder() - Constructor for class de.l3s.icrawl.crawlmanager.CrawlUpdatesFinder
 
CrawlUrl - Class in de.l3s.icrawl.domain.specification
 
CrawlUrl(String) - Constructor for class de.l3s.icrawl.domain.specification.CrawlUrl
 
CrawlUrl(String, Map<String, Object>) - Constructor for class de.l3s.icrawl.domain.specification.CrawlUrl
 
CrawlUrl(String, Object...) - Constructor for class de.l3s.icrawl.domain.specification.CrawlUrl
 
CrawlUrl.Type - Enum in de.l3s.icrawl.domain.specification
Distinguishes between URLs for the different fetchers.
CrawlUrlPropertyEditor - Class in de.l3s.icrawl.ui.format
 
CrawlUrlPropertyEditor() - Constructor for class de.l3s.icrawl.ui.format.CrawlUrlPropertyEditor
 
CrawlWizardController - Class in de.l3s.icrawl.ui
 
CrawlWizardController(CrawlService, SuggestionFactory, SeedSearcher) - Constructor for class de.l3s.icrawl.ui.CrawlWizardController
 
create(Campaign) - Method in class de.l3s.icrawl.ui.CampaignController
 
create(Campaign, Crawl, BindingResult) - Method in class de.l3s.icrawl.ui.CrawlController
 
create(Crawl, BindingResult, UriComponentsBuilder) - Method in class de.l3s.icrawl.ui.CrawlWizardController
 
createAccount(Evaluator, BindingResult) - Method in class de.l3s.icrawl.ui.EvaluationController
 
createCrawlReferenceVector(CrawlDataRepositoryTemplate, long, CrawlSpecification, boolean, int, boolean) - Static method in class de.l3s.icrawl.online.DocumentVectorUtils
 
createDataSource() - Static method in class de.l3s.icrawl.evaluation.DBUtils
 
createJob(ApiFetcherExecutionRecord) - Method in interface de.l3s.icrawl.apifetcher.ApiFetcherManager
 
createJob(ApiFetcherExecutionRecord) - Method in class de.l3s.icrawl.apifetcher.ApiFetcherManagerImpl
 
createNutchAndHadoopConf(File) - Static method in class de.l3s.icrawl.util.HadoopUtils
 
createProxy(String, Class<T>, boolean) - Method in class de.l3s.icrawl.process.JmsConfig
 
createServiceExporter(Class<T>, T, String) - Method in class de.l3s.icrawl.process.JmsConfig
 
createSimilarityMeasureForCampaign(long, int, boolean) - Method in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor
 
createUser(Evaluator) - Method in class de.l3s.icrawl.service.EvaluationService
 
createWSProxy(String, String, String, Class<T>) - Static method in class de.l3s.icrawl.util.WebServiceUtils
 
CUTOFF_DATE - Static variable in class de.l3s.icrawl.util.DateUtils
 

D

date - Variable in class de.l3s.icrawl.evaluation.WebPageDateExtractor.WebPageDate
 
dateMetaKey(String) - Static method in class de.l3s.icrawl.util.DateUtils
 
dateSource - Variable in class de.l3s.icrawl.evaluation.WebPageDateExtractor.WebPageDate
 
DateTimeWritable - Class in de.l3s.icrawl.evaluation
 
DateTimeWritable() - Constructor for class de.l3s.icrawl.evaluation.DateTimeWritable
 
DateTimeWritable(String, DateTime) - Constructor for class de.l3s.icrawl.evaluation.DateTimeWritable
 
DateTimeWritable(String, Duration) - Constructor for class de.l3s.icrawl.evaluation.DateTimeWritable
 
DateUtils - Class in de.l3s.icrawl.util
 
DateUtils.DateTimeTruncation - Enum in de.l3s.icrawl.util
 
DateUtils.DurationTruncation - Enum in de.l3s.icrawl.util
 
DbConfig - Class in de.l3s.icrawl
 
DbConfig() - Constructor for class de.l3s.icrawl.DbConfig
 
DbInserter - Class in de.l3s.icrawl.evaluation
 
DbUpdateStep - Class in de.l3s.icrawl.crawlmanager.step
 
DbUpdateStep() - Constructor for class de.l3s.icrawl.crawlmanager.step.DbUpdateStep
 
DBUtils - Class in de.l3s.icrawl.evaluation
 
de.l3s.icrawl - package de.l3s.icrawl
 
de.l3s.icrawl.adblock - package de.l3s.icrawl.adblock
Code to load filter lists for AdBlock Plus and apply them to filter out links to advertisement pages.
de.l3s.icrawl.api - package de.l3s.icrawl.api
Interfaces related to API crawling.
de.l3s.icrawl.apifetcher - package de.l3s.icrawl.apifetcher
Retrieve data through Web platform APIs.
de.l3s.icrawl.crawlmanager - package de.l3s.icrawl.crawlmanager
Crawler control implementation
de.l3s.icrawl.crawlmanager.step - package de.l3s.icrawl.crawlmanager.step
Steps of the crawl execution.
de.l3s.icrawl.data.specification - package de.l3s.icrawl.data.specification
 
de.l3s.icrawl.domain - package de.l3s.icrawl.domain
Domain objects.
de.l3s.icrawl.domain.api - package de.l3s.icrawl.domain.api
Domain classes related to API fetching.
de.l3s.icrawl.domain.crawl - package de.l3s.icrawl.domain.crawl
Crawl record entities.
de.l3s.icrawl.domain.evaluation - package de.l3s.icrawl.domain.evaluation
Evaluation entities
de.l3s.icrawl.domain.event - package de.l3s.icrawl.domain.event
Events occuring during a crawl.
de.l3s.icrawl.domain.specification - package de.l3s.icrawl.domain.specification
Crawk specification entities.
de.l3s.icrawl.domain.status - package de.l3s.icrawl.domain.status
Status representation of different tasks.
de.l3s.icrawl.domain.support - package de.l3s.icrawl.domain.support
Internal support classes for data access.
de.l3s.icrawl.evaluation - package de.l3s.icrawl.evaluation
Evaluation code
de.l3s.icrawl.evaluation.twitterfetcher - package de.l3s.icrawl.evaluation.twitterfetcher
Evaluation baseline that only downloads tweeted URLs.
de.l3s.icrawl.export.warc - package de.l3s.icrawl.export.warc
Export of crawled documents as WARC files.
de.l3s.icrawl.online - package de.l3s.icrawl.online
Analysis of crawled documents
de.l3s.icrawl.online.singlerank - package de.l3s.icrawl.online.singlerank
Implementation of the SingleRank algorithm for keyword extraction.
de.l3s.icrawl.process - package de.l3s.icrawl.process
Management of external processes
de.l3s.icrawl.process.impl - package de.l3s.icrawl.process.impl
Management implementation of external processes
de.l3s.icrawl.repository - package de.l3s.icrawl.repository
Repository interfaces
de.l3s.icrawl.service - package de.l3s.icrawl.service
Domain services
de.l3s.icrawl.ui - package de.l3s.icrawl.ui
Web user interface
de.l3s.icrawl.ui.format - package de.l3s.icrawl.ui.format
 
de.l3s.icrawl.ui.wayback - package de.l3s.icrawl.ui.wayback
Wayback Machine integration with the CrawlDB.
de.l3s.icrawl.ui.wizard - package de.l3s.icrawl.ui.wizard
Server-side code for the Crawl Specification Wizard
de.l3s.icrawl.util - package de.l3s.icrawl.util
Helper classes.
deepCopy(Object) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
DEFAULT_DAMPING_FACTOR - Static variable in class de.l3s.icrawl.online.singlerank.SingleRankKeywordExtractor
 
DEFAULT_DOCUMENT - Static variable in class de.l3s.icrawl.online.KeywordExtractorParseFilter
Regex for the name of the default document in a directory
DEFAULT_WINDOW_SIZE - Static variable in class de.l3s.icrawl.online.singlerank.SingleRankKeywordExtractor
 
defaultFactory() - Static method in class de.l3s.icrawl.online.LabelerFactory
 
defaultSizes() - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
delete(long, long, RedirectAttributes) - Method in class de.l3s.icrawl.ui.CrawlController
 
deleteCrawl(long) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
 
deleteCrawl(long) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
deleteCrawl(long) - Method in interface de.l3s.icrawl.service.CrawlService
 
deleteCrawl(long) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
deleteExecution(TaskExecutionRecord<?>) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
deleteExecution(TaskExecutionRecord<?>) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
DepthStoppingCondition - Class in de.l3s.icrawl.crawlmanager
 
DepthStoppingCondition(int) - Constructor for class de.l3s.icrawl.crawlmanager.DepthStoppingCondition
 
destroy() - Method in class de.l3s.icrawl.ui.SimpleCORSFilter
 
DETECTED_KEYWORDS - Static variable in class de.l3s.icrawl.FieldNames
 
dictatedSizes() - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
disassemble(Object) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
disconnect(Node) - Method in class com.sharethis.textrank.Node
Disconnect two nodes removing their bi-directional arc in the graph.
dist_stats - Variable in class com.sharethis.textrank.Graph
Public members.
distributeScoreToOutlinks(String, WebPage, Collection<ScoreDatum>, int) - Method in class de.l3s.icrawl.online.FocusScoringFilter
Get cash on hand, divide it by the number of outlinks and apply.
distributeWeightUsingDocumentVector(String, WebPage, Collection<ScoreDatum>) - Method in class de.l3s.icrawl.online.FocusScoringFilter
 
distributeWeightUsingKeywords(String, WebPage, Collection<ScoreDatum>) - Method in class de.l3s.icrawl.online.FocusScoringFilter
 
DOC_LENGTH - Static variable in class de.l3s.icrawl.FieldNames
 
DOC_SCORE_WEIGHT - Static variable in class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
DocumentVector - Class in de.l3s.icrawl.online
A sparse representation of a term frequency document vector
DocumentVector(Map<String, Double>) - Constructor for class de.l3s.icrawl.online.DocumentVector
 
DocumentVector(Collection<String>) - Constructor for class de.l3s.icrawl.online.DocumentVector
 
DocumentVectorSimilarity - Class in de.l3s.icrawl.online
Class to compute the distance of a document to a document collection.
DocumentVectorSimilarity(Map<String, Locale>) - Constructor for class de.l3s.icrawl.online.DocumentVectorSimilarity
Create a SpecSimilarity Object that is serializable and stores a reference to the input's document collection.
DocumentVectorSimilarity(Map<String, Locale>, Set<String>, Set<NamedEntity>, int, boolean) - Constructor for class de.l3s.icrawl.online.DocumentVectorSimilarity
 
DocumentVectorSimilarity(Map<Locale, DocumentVector>, Map<Locale, DocumentVectorSimilarity.KeywordMatcher>) - Constructor for class de.l3s.icrawl.online.DocumentVectorSimilarity
 
DocumentVectorUtils - Class in de.l3s.icrawl.online
 
doFilter(ServletRequest, ServletResponse, FilterChain) - Method in class de.l3s.icrawl.ui.SimpleCORSFilter
 
domainClassConverter(FormattingConversionService) - Method in class de.l3s.icrawl.ui.UiConfiguration
 
dotProduct(DocumentVector) - Method in class de.l3s.icrawl.online.DocumentVector
 

E

edges - Variable in class com.sharethis.textrank.Node
Public members.
edit(Campaign, Crawl) - Method in class de.l3s.icrawl.ui.CrawlController
 
edit(Crawl, BindingResult, UriComponentsBuilder, Campaign, long) - Method in class de.l3s.icrawl.ui.CrawlWizardController
 
elapsed_time - Variable in class com.sharethis.textrank.TextRank
 
ElementFilter - Interface in de.l3s.icrawl.adblock
 
endtime - Variable in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
englishModel() - Static method in class com.sharethis.textrank.CoreNlpLanguageModel
 
ensureRunning() - Method in class de.l3s.icrawl.process.impl.HBaseCrawlDbManager
Make sure HBase is running unless it has been explicitly stopped.
ENTITIES - Static variable in class de.l3s.icrawl.FieldNames
 
EntitiesBase - Class in de.l3s.icrawl.domain
Marker class to be used with EntityScan.
EntityPropertyEditor - Class in de.l3s.icrawl.ui.format
 
EntityPropertyEditor() - Constructor for class de.l3s.icrawl.ui.format.EntityPropertyEditor
 
equals(Object) - Method in class com.sharethis.textrank.MetricVector
 
equals(Object) - Method in class com.sharethis.textrank.NGram
 
equals(Object) - Method in class com.sharethis.textrank.Node
 
equals(Object) - Method in interface de.l3s.icrawl.api.ApiFetcherContext
 
equals(Object) - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
equals(Object) - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
equals(Object) - Method in class de.l3s.icrawl.domain.crawl.BatchRecord.BatchRecordKey
 
equals(Object) - Method in class de.l3s.icrawl.domain.crawl.CrawlExecutionRecord
 
equals(Object) - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
equals(Object) - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
equals(Object) - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
equals(Object) - Method in class de.l3s.icrawl.domain.evaluation.EvaluationUrl
 
equals(Object) - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
equals(Object) - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
equals(Object) - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
equals(Object) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
equals(Object) - Method in class de.l3s.icrawl.domain.specification.CrawlSchedule
 
equals(Object) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
equals(Object) - Method in class de.l3s.icrawl.domain.specification.CrawlUrl
 
equals(Object) - Method in class de.l3s.icrawl.domain.specification.NamedEntity
 
equals(Object) - Method in class de.l3s.icrawl.domain.specification.NamedEntity.Label
 
equals(Object) - Method in class de.l3s.icrawl.domain.support.CountedSet
 
equals(Object, Object) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
equals(Object) - Method in class de.l3s.icrawl.evaluation.BatchScore
 
equals(Object) - Method in class de.l3s.icrawl.online.DocumentVector
 
ErrorMessage - Class in de.l3s.icrawl.ui.wizard
 
ErrorMessage(String) - Constructor for class de.l3s.icrawl.ui.wizard.ErrorMessage
 
EvaluationController - Class in de.l3s.icrawl.ui
 
EvaluationController() - Constructor for class de.l3s.icrawl.ui.EvaluationController
 
EvaluationService - Class in de.l3s.icrawl.service
 
EvaluationService(EvaluatorRepository, EvaluationVoteRepository, EvaluationUrlRepository, LabelRepository, PasswordEncoder) - Constructor for class de.l3s.icrawl.service.EvaluationService
 
EvaluationUrl - Class in de.l3s.icrawl.domain.evaluation
 
EvaluationUrl() - Constructor for class de.l3s.icrawl.domain.evaluation.EvaluationUrl
 
EvaluationUrlRepository - Interface in de.l3s.icrawl.repository
 
EvaluationVote - Class in de.l3s.icrawl.domain.evaluation
 
EvaluationVote() - Constructor for class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
EvaluationVoteRepository - Interface in de.l3s.icrawl.repository
 
Evaluator - Class in de.l3s.icrawl.domain.evaluation
 
Evaluator() - Constructor for class de.l3s.icrawl.domain.evaluation.Evaluator
 
EvaluatorRepository - Interface in de.l3s.icrawl.repository
 
EvaluatorScore - Class in de.l3s.icrawl.domain.evaluation
 
EvaluatorScore(Evaluator, long) - Constructor for class de.l3s.icrawl.domain.evaluation.EvaluatorScore
 
EvaluatorUserDetails(Evaluator) - Constructor for class de.l3s.icrawl.service.EvaluatorUserDetailsService.EvaluatorUserDetails
 
EvaluatorUserDetailsService - Class in de.l3s.icrawl.service
 
EvaluatorUserDetailsService(EvaluatorRepository) - Constructor for class de.l3s.icrawl.service.EvaluatorUserDetailsService
 
EvaluatorUserDetailsService.EvaluatorUserDetails - Class in de.l3s.icrawl.service
 
EventSender - Class in de.l3s.icrawl.online
 
EventSender(Configuration) - Constructor for class de.l3s.icrawl.online.EventSender
 
exceptionHandler(Exception) - Method in class de.l3s.icrawl.ui.CrawlWizardController
 
execute(TaskExecutionContext) - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
execute(TaskExecutionContext) - Method in class de.l3s.icrawl.crawlmanager.CrawlJob
 
execute(CrawlExecutionRecord, Configuration, int) - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
execute(TaskExecutionContext) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecution
 
execute(TaskExecutionContext) - Method in class de.l3s.icrawl.export.warc.WarcExporterJob
 
execute() - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
executeAndGetResult(CrawlDataRepositoryTemplate.ResultLinesMapper<REDUCE_KEY, REDUCE_VAL, RESULT>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
executionStatus - Variable in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
executor - Variable in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
export(long, long) - Method in class de.l3s.icrawl.ui.CrawlController
 
exportCampaign(long, String) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
Schedule the export of a campaign for immediate execution.
exportCampaign(long, String) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
ExportConfig() - Constructor for class de.l3s.icrawl.domain.crawl.WarcExporterRecord.ExportConfig
 
ExportConfig(String, String) - Constructor for class de.l3s.icrawl.domain.crawl.WarcExporterRecord.ExportConfig
 
ExportStatus - Class in de.l3s.icrawl.domain.status
Status of an export job.
ExportStatus() - Constructor for class de.l3s.icrawl.domain.status.ExportStatus
 
EXTRACT_ENTITIES_KEY - Static variable in class de.l3s.icrawl.domain.specification.CrawlSpecificationUtils
 
extractDate(String) - Static method in class de.l3s.icrawl.util.DateUtils
 
extractDateFromUrl(String) - Static method in class de.l3s.icrawl.util.DateUtils
 
extractEntities(Labeler, String) - Method in class de.l3s.icrawl.online.ContentAnalyser
 
extractEntities(String) - Method in class de.l3s.icrawl.online.Labeler
 
ExtractionException(String, Throwable) - Constructor for exception de.l3s.icrawl.evaluation.WebPageDateExtractor.ExtractionException
 
ExtractionException(String) - Constructor for exception de.l3s.icrawl.evaluation.WebPageDateExtractor.ExtractionException
 
ExtractionException(Throwable) - Constructor for exception de.l3s.icrawl.evaluation.WebPageDateExtractor.ExtractionException
 
extractKeywords(List<String>, Locale, int) - Method in class de.l3s.icrawl.online.singlerank.SingleRankKeywordExtractor
 
extractKeywords(List<String>, Locale, int, int, double) - Method in class de.l3s.icrawl.online.singlerank.SingleRankKeywordExtractor
 
extractModifiedDate(Document) - Static method in class de.l3s.icrawl.evaluation.WebPageDateExtractor
Extract the likely modification date from a parsed document.
extractModifiedDateFromHtml(InputStream, String) - Static method in class de.l3s.icrawl.evaluation.WebPageDateExtractor
Parse the document and extract its likely modification date.
extractModifiedDateFromUrl(String) - Method in class de.l3s.icrawl.evaluation.WebPageDateExtractor
Retrieve the document and extract its likely modification date.
extractParagraphs(DocumentFragment) - Static method in class de.l3s.icrawl.util.TextExtractor
 
extractText(DocumentFragment) - Static method in class de.l3s.icrawl.util.TextExtractor
 
extractText(Node) - Static method in class de.l3s.icrawl.util.TextExtractor
 
extractTextFromJavascript(Document) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
ExtractUrls - Class in de.l3s.icrawl.evaluation
 
ExtractUrls.ExtractUrlsMapper - Class in de.l3s.icrawl.evaluation
 
ExtractUrls.PageMetadata - Class in de.l3s.icrawl.evaluation
 
ExtractUrlsMapper() - Constructor for class de.l3s.icrawl.evaluation.ExtractUrls.ExtractUrlsMapper
 

F

failed(String, String, String, ApiStatus) - Static method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
failed(Campaign, Crawl, String, double) - Static method in class de.l3s.icrawl.domain.status.CrawlStatus
 
failed(long, String, double) - Static method in class de.l3s.icrawl.domain.status.ExportStatus
 
FAILED - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
The job was stopped because of a problem during processing.
fetchAndParse(String) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
FetchStep - Class in de.l3s.icrawl.crawlmanager.step
 
FetchStep() - Constructor for class de.l3s.icrawl.crawlmanager.step.FetchStep
 
FieldNames - Class in de.l3s.icrawl
 
FieldRegistrationFilter - Class in de.l3s.icrawl.online
Fake protocol implementation to preserve metadata field accross crawls.
FieldRegistrationFilter() - Constructor for class de.l3s.icrawl.online.FieldRegistrationFilter
 
Filter - Interface in de.l3s.icrawl.adblock
 
filter(String, WebPage, Parse, HTMLMetaTags, DocumentFragment) - Method in class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
FilterParser - Class in de.l3s.icrawl.adblock
 
FilterParser() - Constructor for class de.l3s.icrawl.adblock.FilterParser
 
FilterSet - Class in de.l3s.icrawl.adblock
 
FilterSet(List<Filter>, List<Filter>, ImmutableList<ElementFilter>) - Constructor for class de.l3s.icrawl.adblock.FilterSet
 
FilterSet.Builder - Class in de.l3s.icrawl.adblock
 
finalResult(double) - Static method in class de.l3s.icrawl.crawlmanager.CrawlScope.ScopeResult
 
findActiveByOwner(String) - Method in interface de.l3s.icrawl.repository.CampaignRepository
 
findAll(Pageable) - Method in interface de.l3s.icrawl.repository.EvaluationUrlRepository
 
findArchivedByOwner(String) - Method in interface de.l3s.icrawl.repository.CampaignRepository
 
findByCrawl(Crawl) - Method in interface de.l3s.icrawl.repository.TaskExecutionRepository
 
findByCrawl(Long) - Method in interface de.l3s.icrawl.repository.TaskExecutionRepository
 
findByEmail(String) - Method in interface de.l3s.icrawl.repository.EvaluatorRepository
 
findByEvaluatorAndUrl(Evaluator, String) - Method in interface de.l3s.icrawl.repository.LabelRepository
 
findByExecutionId(long) - Method in interface de.l3s.icrawl.repository.BatchRecordRepository
 
findByModifiedAfter(DateTime) - Method in interface de.l3s.icrawl.repository.CrawlRepository
 
findByUrl(String) - Method in interface de.l3s.icrawl.repository.EvaluationUrlRepository
 
findFirstByExecutionOrderByStartTimeDesc(TaskExecutionRecord<?>) - Method in interface de.l3s.icrawl.repository.BatchRecordRepository
 
findNextPart(Long) - Method in interface de.l3s.icrawl.repository.EvaluationUrlRepository
 
findParagraphParent(Element, int) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
findParagraphParent(Element) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
findParagraphParent(Node, int) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
findScheduledTasks() - Method in interface de.l3s.icrawl.repository.TaskExecutionRepository
 
findStartableTasks() - Method in interface de.l3s.icrawl.repository.TaskExecutionRepository
 
findUnscheduledCrawls() - Method in interface de.l3s.icrawl.repository.CrawlRepository
 
findUrlRefs(DocumentFragment, Collection<String>, URL) - Static method in class de.l3s.icrawl.online.KeywordExtractorParseFilter
Find the link elements referring to the given URLs
finishBatch(BatchRecord) - Method in class de.l3s.icrawl.crawlmanager.TaskExecutionContext
 
finishBatch(BatchRecord) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
finishBatch(BatchRecord) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
finished(String, String, String, ApiStatus) - Static method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
finished(Campaign, Crawl) - Static method in class de.l3s.icrawl.domain.status.CrawlStatus
 
finished(long) - Static method in class de.l3s.icrawl.domain.status.ExportStatus
 
FINISHED - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
The job has completed successfully.
finishStep(StepExecutionRecord) - Method in class de.l3s.icrawl.crawlmanager.TaskExecutionContext
 
finishStep(StepExecutionRecord) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
finishStep(StepExecutionRecord) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
finishTaskExecution(TaskExecutionRecord<T>) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
finishTaskExecution(TaskExecutionRecord<T>) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
FocusingPlugin - Class in de.l3s.icrawl.online
 
FocusingPlugin(PluginDescriptor, Configuration) - Constructor for class de.l3s.icrawl.online.FocusingPlugin
 
FocusScoringFilter - Class in de.l3s.icrawl.online
Based on org.apache.nutch.scoring.opic.OPICScoringFilter.
FocusScoringFilter() - Constructor for class de.l3s.icrawl.online.FocusScoringFilter
 
follow(ApiRequest) - Method in class de.l3s.icrawl.evaluation.twitterfetcher.TwitterFetcher
Start tracking the given topics.
forCrawl(CrawlExecutionRecord, String) - Static method in class de.l3s.icrawl.domain.crawl.ApiFetcherExecutionRecord
 
FormError - Class in de.l3s.icrawl.ui.wizard
 
FormError(BindingResult) - Constructor for class de.l3s.icrawl.ui.wizard.FormError
 
FormResponse - Interface in de.l3s.icrawl.ui.wizard
 
FormSuccess - Class in de.l3s.icrawl.ui.wizard
 
FormSuccess(String) - Constructor for class de.l3s.icrawl.ui.wizard.FormSuccess
 
FRESHNESS_KEY - Static variable in class de.l3s.icrawl.evaluation.FreshnessComputation
 
FreshnessComputation - Class in de.l3s.icrawl.evaluation
 
FreshnessComputation() - Constructor for class de.l3s.icrawl.evaluation.FreshnessComputation
 
FreshnessComputation.FreshnessConfiguration - Class in de.l3s.icrawl.evaluation
 
FreshnessComputation.FreshnessMapper - Class in de.l3s.icrawl.evaluation
 
FreshnessComputation.FreshnessReducer - Class in de.l3s.icrawl.evaluation
 
FreshnessComputation.TimesHistogram - Class in de.l3s.icrawl.evaluation
 
FreshnessConfiguration() - Constructor for class de.l3s.icrawl.evaluation.FreshnessComputation.FreshnessConfiguration
 
FreshnessMapper() - Constructor for class de.l3s.icrawl.evaluation.FreshnessComputation.FreshnessMapper
 
FreshnessReducer() - Constructor for class de.l3s.icrawl.evaluation.FreshnessComputation.FreshnessReducer
 

G

GenerateStep - Class in de.l3s.icrawl.crawlmanager.step
 
GenerateStep(long, boolean, boolean) - Constructor for class de.l3s.icrawl.crawlmanager.step.GenerateStep
 
generatorSortValue(String, WebPage, float) - Method in class de.l3s.icrawl.online.FocusScoringFilter
 
germanModel() - Static method in class com.sharethis.textrank.CoreNlpLanguageModel
 
get(String) - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
get(Configuration) - Static method in class de.l3s.icrawl.domain.specification.CrawlSpecificationUtils
 
get(String) - Method in class de.l3s.icrawl.domain.specification.WeightVector
 
get(T) - Method in class de.l3s.icrawl.domain.support.CountedSet
 
get(LanguageDetector.WeightedLocale) - Method in class de.l3s.icrawl.online.LabelerFactory
 
get(long) - Method in class de.l3s.icrawl.ui.wayback.HBaseResourceIndexFactory
 
get(long) - Method in class de.l3s.icrawl.ui.wayback.HBaseResourceStoreFactory
 
get(Configuration) - Static method in class org.apache.nutch.util.ObjectCache
 
getActiveCampaignsForUser(String) - Method in interface de.l3s.icrawl.service.CrawlService
Retrieve all un-archived campaigns by the given owner.
getActiveCampaignsForUser(String) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
getAllScheduledJobs() - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
getAllScheduledJobs() - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
getAllStartableJobs() - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
getAllStartableJobs() - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
getApi() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
getApi() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
getApi() - Method in class de.l3s.icrawl.domain.specification.ApiFetcherConfig
 
getApi() - Method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
getApiStatus() - Method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
getArchived() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
getArchivedCampaignsForUser(String) - Method in interface de.l3s.icrawl.service.CrawlService
Retrieve all archived campaigns by the given owner.
getArchivedCampaignsForUser(String) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
getAuthorities() - Method in class de.l3s.icrawl.service.EvaluatorUserDetailsService.EvaluatorUserDetails
 
getBatch(long, int) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
getBatch(long, int) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
getBatchesForExecution(long) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
getBatchesForExecution(long) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
getBatchId(WebPage) - Method in class de.l3s.icrawl.evaluation.BatchRelevance.BatchRelevanceMapper
 
getBatchId() - Method in class de.l3s.icrawl.evaluation.BatchScore
 
getBatchId() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
getBatchKey() - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
getBatchSeq() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
getBatchSeq() - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
Return the sequence number of the currently processed batch.
getCampaign() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
getCampaign() - Method in class de.l3s.icrawl.domain.evaluation.Label
 
getCampaign() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
getCampaign() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
getCampaign() - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
getCampaign() - Method in class de.l3s.icrawl.domain.status.ExportStatus
Get the campaign being exported.
getCampaign(long) - Method in interface de.l3s.icrawl.service.CrawlService
 
getCampaign(long) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
getCampaignId() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
getCollocation() - Method in class com.sharethis.textrank.NodeValue
Create a collocation out of the text for lookup in WordNet.
getComment() - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
getComment() - Method in class de.l3s.icrawl.domain.evaluation.Label
 
getConf() - Method in class de.l3s.icrawl.evaluation.BatchRelevance
 
getConf() - Method in class de.l3s.icrawl.evaluation.FreshnessComputation
 
getConf() - Method in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor
 
getConf() - Method in class de.l3s.icrawl.online.FieldRegistrationFilter
 
getConf() - Method in class de.l3s.icrawl.online.FocusScoringFilter
 
getConf() - Method in class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
getConfiguration() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
getContent() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getContentType() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getCount() - Method in class com.sharethis.textrank.NGram
Determine the count, i.e., how often this n-gram recurs within the text.
getCrawl() - Method in class de.l3s.icrawl.crawlmanager.CrawlJob
 
getCrawl() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
getCrawl() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
getCrawl() - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
getCrawl(long) - Method in interface de.l3s.icrawl.service.CrawlService
 
getCrawl(long) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
getCrawlId() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
getCrawlId() - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
getCrawlId() - Method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
getCrawlKey() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
getCrawls() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
getCrawlSchedule() - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
getCrawlStatistics(long, boolean) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
 
getCrawlStatistics(long, boolean) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
getCrawlStatus(long) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
Get the current status of a crawl.
getCrawlStatus(long) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
getCreated() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
getCreated() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
getCreationDate(String, URL, Locale, DateTime) - Static method in class de.l3s.icrawl.online.WebPageDate
method to get the date of the creation of the web page
getCurrentEvaluator(UserDetails) - Method in class de.l3s.icrawl.service.EvaluationService
 
getDate() - Method in class de.l3s.icrawl.domain.evaluation.LogEntry
 
getDateSource() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
getDateTime() - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
getDescription() - Method in class com.sharethis.textrank.KeyWord
Create a description text for this value.
getDescription() - Method in class com.sharethis.textrank.NGram
Create a description text for this value.
getDescription() - Method in class com.sharethis.textrank.NodeValue
Create a description text for this value.
getDescription() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
getDescription() - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
getDescription() - Method in class de.l3s.icrawl.ui.wizard.KeywordSuggestion
Short description of this option
getDescription() - Method in class de.l3s.icrawl.ui.wizard.SeedSearchResult
Web page description or part of page content
getDetectedKeywords() - Method in class de.l3s.icrawl.online.ContentAnalyser.Counts
 
getDisplayUrl() - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
getDocumentLength() - Method in class de.l3s.icrawl.online.ContentAnalyser.Counts
 
getDocuments() - Method in class de.l3s.icrawl.domain.status.ApiStatus
 
getDownloaded() - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
getDuration() - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
getEmail() - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
getEndTime() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
getEndTime() - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
getEndTime() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
getEndTime() - Method in class de.l3s.icrawl.domain.specification.CrawlSchedule
 
getEntities() - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
getEntities() - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
getEntities() - Method in class de.l3s.icrawl.online.ContentAnalyser.Counts
 
getEntities() - Method in class de.l3s.icrawl.ui.wizard.SeedSearchResult
Entities that were detected on this page
getErrors() - Method in class de.l3s.icrawl.domain.status.ApiStatus
 
getErrors() - Method in class de.l3s.icrawl.ui.wizard.FormError
 
getEvaluationUrls(UserDetails) - Method in class de.l3s.icrawl.ui.EvaluationController
 
getEvaluator() - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
getEvaluator() - Method in class de.l3s.icrawl.domain.evaluation.Label
 
getEvaluatorScores() - Method in class de.l3s.icrawl.service.EvaluationService
 
getEventSender() - Method in class de.l3s.icrawl.online.FocusingPlugin
 
getExecution(long) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
getExecution() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
getExecution(long) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
getExecutionId() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord.BatchRecordKey
 
getExecutionId() - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
getExecutionsForCrawl(Crawl) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
getExecutionsForCrawl(Crawl) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
getExecutionStatus() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
getExportStatus(long) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
Retrieve the current status of an export job.
getExportStatus(long) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
getFetchTime() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getFetchTime() - Method in class de.l3s.icrawl.repository.CrawlDataRepository.WebPageInfo
 
getFetchTimestamp() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
getFetchTimeTS() - Method in class de.l3s.icrawl.repository.CrawlDataRepository.WebPageInfo
 
getFields() - Method in class de.l3s.icrawl.online.FieldRegistrationFilter
 
getFields() - Method in class de.l3s.icrawl.online.FocusScoringFilter
 
getFields() - Method in class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
getFilesSystem() - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
getFreshnessDurations() - Method in class de.l3s.icrawl.evaluation.FreshnessComputation.TimesHistogram
 
getGraph() - Method in class com.sharethis.textrank.TextRank
Accessor for the graph.
getHeaders() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getHost() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
getHttpHeaders() - Method in class de.l3s.icrawl.ui.wayback.HBaseResource
 
getId() - Method in class com.sharethis.textrank.Node
Create a unique identifier for this node, returned as a hex string.
getId() - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
getId() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
getId() - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
getId() - Method in class de.l3s.icrawl.domain.evaluation.Label
 
getId() - Method in class de.l3s.icrawl.domain.evaluation.LogEntry
 
getId() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
getId() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
getID() - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
getImage() - Method in class de.l3s.icrawl.ui.wizard.KeywordSuggestion
Image URL for this option
getInstance(String) - Method in class de.l3s.icrawl.apifetcher.InjectorFactory
 
getInterval() - Method in class de.l3s.icrawl.domain.specification.CrawlSchedule
 
getJob() - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
getJobType() - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
getKey() - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
getKey() - Method in class de.l3s.icrawl.repository.CrawlDataRepository.WebPageInfo
 
getKey() - Method in class de.l3s.icrawl.ui.BatchController.BatchPage
 
getKey() - Method in interface de.l3s.icrawl.ui.wizard.ApiSearcher
 
getKey() - Method in class de.l3s.icrawl.ui.wizard.BingApiSearcher
 
getKey() - Method in class de.l3s.icrawl.ui.wizard.RedditApiSearcher
 
getKey() - Method in class de.l3s.icrawl.ui.wizard.TwitterApiSearcher
 
getKeywords() - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
getKeywords() - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
getKeywords() - Method in class de.l3s.icrawl.online.ContentAnalyser.Counts
 
getKeywords() - Method in class de.l3s.icrawl.ui.wizard.SeedSearchResult
Keywords that were detected on this page
getLabels() - Method in class de.l3s.icrawl.domain.specification.NamedEntity
 
getLangCode() - Method in enum de.l3s.icrawl.online.TextRankWrapper.LANG_CODE
 
getLanguage() - Method in class de.l3s.icrawl.domain.specification.NamedEntity.Label
Get the language of the label.
getLanguage() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
getLanguage() - Method in class de.l3s.icrawl.online.ContentAnalyser.Counts
 
getLastExecutionForCrawl(long) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
getLastExecutionForCrawl(long) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
getLocations() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
getLog() - Method in class de.l3s.icrawl.domain.evaluation.SessionLog
 
getMask() - Method in enum de.l3s.icrawl.util.DateUtils.DateTimeTruncation
 
getMessage() - Method in exception de.l3s.icrawl.ui.NotFoundException
 
getMessage() - Method in class de.l3s.icrawl.ui.wizard.ErrorMessage
 
getMetadata() - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
getMetadata() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
getMetadata() - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
getMetadata() - Method in class de.l3s.icrawl.domain.specification.CrawlUrl
 
getMetadata(String) - Method in class de.l3s.icrawl.domain.specification.CrawlUrl
 
getMillis() - Method in enum de.l3s.icrawl.util.DateUtils.DurationTruncation
 
getModified() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
getModifiedCrawls(DateTime) - Method in interface de.l3s.icrawl.service.CrawlService
 
getModifiedCrawls(DateTime) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
getModifiedDate(String, WebPage, Mapper<?, ?, ?, ?>.Context) - Static method in class de.l3s.icrawl.evaluation.WebPageDateExtractor
 
getModifiedDate(String, Document, Long, Mapper<?, ?, ?, ?>.Context) - Static method in class de.l3s.icrawl.evaluation.WebPageDateExtractor
 
getModifiedTime() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getModifiedTimes() - Method in class de.l3s.icrawl.evaluation.FreshnessComputation.TimesHistogram
 
getModifiedTimestamp() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
getMsg() - Method in class de.l3s.icrawl.domain.evaluation.LogEntry
 
getName() - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
getName() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
getName() - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
getName() - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
getName() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
getName() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
getName() - Method in class de.l3s.icrawl.domain.specification.NamedEntity.Label
Get the name of the label
getName() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
getName() - Method in class de.l3s.icrawl.ui.wizard.KeywordSuggestion
Display text for this option
getNames() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
getNextBatchUrls(Evaluator) - Method in class de.l3s.icrawl.service.EvaluationService
 
getNodeKey(String, String) - Method in class com.sharethis.textrank.CoreNlpLanguageModel
 
getNodeKey(String, String) - Method in class com.sharethis.textrank.LanguageModel
Prepare a stable key for a graph node (stemmed, lemmatized) from a token.
getNumHashtags() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
getNumJobs() - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
 
getNumJobs() - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
getNumTokens() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
getObject(String) - Method in class org.apache.nutch.util.ObjectCache
 
getOwner() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
getParams() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
getPassword() - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
getPassword() - Method in class de.l3s.icrawl.service.EvaluatorUserDetailsService.EvaluatorUserDetails
 
getPath() - Method in class de.l3s.icrawl.domain.crawl.WarcExporterRecord.ExportConfig
 
getPayload() - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
getPeriod() - Method in enum de.l3s.icrawl.domain.specification.CrawlSchedule.Interval
 
getPhase() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
getPhase() - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
getPhaseProgress() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
getPhaseProgress() - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
getProgress() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
getProgress() - Method in class de.l3s.icrawl.crawlmanager.CrawlJob
 
getProgress() - Method in interface de.l3s.icrawl.crawlmanager.TaskExecution
Return the job progress in percent.
getProgress() - Method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
getProgress() - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
getProgress() - Method in class de.l3s.icrawl.domain.status.ExportStatus
 
getProgress() - Method in interface de.l3s.icrawl.domain.status.TaskStatus
Get the current progress of the job.
getProgress() - Method in class de.l3s.icrawl.export.warc.WarcExporterJob
 
getProtocolOutput(String, WebPage) - Method in class de.l3s.icrawl.online.FieldRegistrationFilter
 
getQueries() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
getRankThreshold() - Method in class com.sharethis.textrank.Graph
Calculate a threshold for the ranked results.
getRating() - Method in class de.l3s.icrawl.domain.evaluation.Label
 
getRating() - Method in interface de.l3s.icrawl.repository.EvaluatorRepository
 
getReason() - Method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
getReason() - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
getReason() - Method in class de.l3s.icrawl.domain.status.ExportStatus
Get the human-readable reason for the last state change.
getReason() - Method in interface de.l3s.icrawl.domain.status.TaskStatus
 
getRecordLength() - Method in class de.l3s.icrawl.ui.wayback.HBaseResource
 
getRedirects() - Method in class de.l3s.icrawl.domain.status.ApiStatus
 
getRelations() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
getRelevance() - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
getRequestUri() - Method in class de.l3s.icrawl.domain.specification.ApiFetcherConfig
 
getResources() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
getResult() - Method in interface de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.ResultLinesMapper
 
getResults() - Method in class de.l3s.icrawl.ui.wizard.BingSearchResultSet
 
getRobotRules(String, WebPage) - Method in class de.l3s.icrawl.online.FieldRegistrationFilter
 
getRootConfigClasses() - Method in class de.l3s.icrawl.ui.UiConfiguration
 
getRunningCrawls() - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
 
getRunningCrawls() - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
getScore() - Method in class de.l3s.icrawl.domain.evaluation.EvaluatorScore
 
getScore() - Method in class de.l3s.icrawl.evaluation.BatchScore
 
getScore() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
getScore() - Method in class de.l3s.icrawl.ui.BatchController.BatchPage
 
getScoreSum(TaskExecutionRecord<?>, String) - Method in class de.l3s.icrawl.crawlmanager.step.BatchScoreCounter
 
getSeeds() - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
getSeqNumber() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord.BatchRecordKey
 
getSeqNumber() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
getServletConfigClasses() - Method in class de.l3s.icrawl.ui.UiConfiguration
 
getServletFilters() - Method in class de.l3s.icrawl.ui.UiConfiguration
 
getServletMappings() - Method in class de.l3s.icrawl.ui.UiConfiguration
 
getSession() - Method in class de.l3s.icrawl.domain.evaluation.LogEntry
 
getSessionId() - Method in class de.l3s.icrawl.domain.evaluation.SessionLog
 
getSimilarity(String, Locale) - Method in class de.l3s.icrawl.online.DocumentVectorSimilarity
calculate the cosine-similarity of the doc to the specification
getSize() - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
getSourceUrl() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getSpecification() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
getStartTime() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
getStartTime() - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
getStartTime() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
getStartTime() - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
getStartTime() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
getStartTime() - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
getStatistics() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
getStatus() - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
getStatus() - Method in interface de.l3s.icrawl.api.ApiFetcher
Get the current status of the fetcher.
getStatus() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
getStatus() - Method in class de.l3s.icrawl.crawlmanager.CrawlJob
 
getStatus() - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
Get the status of the CrawlManager itself.
getStatus() - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
getStatus() - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerManagerImpl
 
getStatus() - Method in class de.l3s.icrawl.crawlmanager.step.Step
 
getStatus() - Method in interface de.l3s.icrawl.crawlmanager.TaskExecution
 
getStatus() - Method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
getStatus() - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
getStatus() - Method in class de.l3s.icrawl.domain.status.ExportStatus
Returns the current status of the job.
getStatus() - Method in interface de.l3s.icrawl.domain.status.TaskStatus
 
getStatus() - Method in class de.l3s.icrawl.export.warc.WarcExporterJob
 
getStatus() - Method in class de.l3s.icrawl.process.impl.ApolloMessageBusManager
 
getStatus() - Method in class de.l3s.icrawl.process.impl.CrawlManagerProcessManager
 
getStatus() - Method in class de.l3s.icrawl.process.impl.HBaseCrawlDbManager
 
getStatus() - Method in class de.l3s.icrawl.process.impl.HSqlMetadataDbManager
 
getStatus() - Method in interface de.l3s.icrawl.process.ProcessManager
 
getStatus() - Method in class de.l3s.icrawl.repository.CrawlDataRepository.WebPageInfo
 
getStatusCode() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getStatusCode() - Method in class de.l3s.icrawl.ui.wayback.HBaseResource
 
getStatusMessage() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getStep(long) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
getStep(long) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
getSteps() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
getStore(long) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
getTaskExecutionRecord() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
getTitle() - Method in class de.l3s.icrawl.repository.CrawlDataRepository.WebPageInfo
 
getTitle() - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
getTitle() - Method in class de.l3s.icrawl.ui.wizard.SeedSearchResult
Web page title
getTotalBatches() - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
Retrieve the total number of planned batches.
getType() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
getType() - Method in class de.l3s.icrawl.domain.specification.CrawlUrl
 
getType() - Method in class de.l3s.icrawl.domain.specification.NamedEntity
 
getUnscheduledCrawls() - Method in interface de.l3s.icrawl.service.CrawlService
 
getUnscheduledCrawls() - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
getUri() - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument
 
getUriScheme() - Method in interface de.l3s.icrawl.api.ApiFetcher
Return the URI prefix that this fetcher can handle.
getUriScheme() - Method in class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
getUrl() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
getUrl() - Method in class de.l3s.icrawl.domain.evaluation.EvaluationUrl
 
getUrl() - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
getUrl() - Method in class de.l3s.icrawl.domain.evaluation.Label
 
getUrl() - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
getUrl() - Method in class de.l3s.icrawl.domain.specification.CrawlUrl
 
getUrl() - Method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
getUrl() - Method in class de.l3s.icrawl.repository.CrawlDataRepository.WebPageInfo
 
getUrl() - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
getUrl() - Method in class de.l3s.icrawl.ui.wizard.FormSuccess
 
getUrl() - Method in class de.l3s.icrawl.ui.wizard.SeedSearchResult
Web page URL
getUrls() - Method in class de.l3s.icrawl.domain.status.ApiStatus
 
getUser() - Method in class de.l3s.icrawl.domain.crawl.WarcExporterRecord.ExportConfig
 
getUser() - Method in class de.l3s.icrawl.domain.evaluation.EvaluatorScore
 
getUsername() - Method in class de.l3s.icrawl.service.EvaluatorUserDetailsService.EvaluatorUserDetails
 
getUsers() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
getValue() - Method in class de.l3s.icrawl.ui.wizard.KeywordSuggestion
Value that will be inserted to search field when user will choose this option
getValues() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
getVotes() - Method in class de.l3s.icrawl.domain.evaluation.EvaluationUrl
 
getVotes() - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
getWebPage(Campaign, String) - Method in class de.l3s.icrawl.repository.CrawlDataRepository
 
getWebPage(Campaign, String) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
getWebPage(long, String) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
Graph - Class in com.sharethis.textrank
An abstraction for handling the graph as a data object.
Graph() - Constructor for class com.sharethis.textrank.Graph
 
graph - Variable in class com.sharethis.textrank.TextRank
 

H

HadoopUtils - Class in de.l3s.icrawl.util
 
handleRequest(HttpServletRequest, HttpServletResponse, long, String) - Method in class de.l3s.icrawl.ui.wayback.CrawlResourceRequestMapper
 
hashCode() - Method in class com.sharethis.textrank.MetricVector
 
hashCode() - Method in class com.sharethis.textrank.NGram
 
hashCode() - Method in class com.sharethis.textrank.Node
 
hashCode() - Method in interface de.l3s.icrawl.api.ApiFetcherContext
 
hashCode() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
hashCode() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
hashCode() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord.BatchRecordKey
 
hashCode() - Method in class de.l3s.icrawl.domain.crawl.CrawlExecutionRecord
 
hashCode() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
hashCode() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
hashCode() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
hashCode() - Method in class de.l3s.icrawl.domain.evaluation.EvaluationUrl
 
hashCode() - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
hashCode() - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
hashCode() - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
hashCode() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
hashCode() - Method in class de.l3s.icrawl.domain.specification.CrawlSchedule
 
hashCode() - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
hashCode() - Method in class de.l3s.icrawl.domain.specification.CrawlUrl
 
hashCode() - Method in class de.l3s.icrawl.domain.specification.NamedEntity
 
hashCode() - Method in class de.l3s.icrawl.domain.specification.NamedEntity.Label
 
hashCode() - Method in class de.l3s.icrawl.domain.support.CountedSet
 
hashCode(Object) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
hashCode() - Method in class de.l3s.icrawl.evaluation.BatchScore
 
hashCode() - Method in class de.l3s.icrawl.online.DocumentVector
 
HBaseCrawlDbManager - Class in de.l3s.icrawl.process.impl
 
HBaseCrawlDbManager(File) - Constructor for class de.l3s.icrawl.process.impl.HBaseCrawlDbManager
 
HBaseResource - Class in de.l3s.icrawl.ui.wayback
 
HBaseResource(WebPage) - Constructor for class de.l3s.icrawl.ui.wayback.HBaseResource
 
HBaseResourceIndex - Class in de.l3s.icrawl.ui.wayback
 
HBaseResourceIndexFactory - Class in de.l3s.icrawl.ui.wayback
 
HBaseResourceIndexFactory(CrawlDataRepositoryTemplate) - Constructor for class de.l3s.icrawl.ui.wayback.HBaseResourceIndexFactory
 
HBaseResourceStore - Class in de.l3s.icrawl.ui.wayback
 
HBaseResourceStoreFactory - Class in de.l3s.icrawl.ui.wayback
 
HBaseResourceStoreFactory(CrawlDataRepositoryTemplate) - Constructor for class de.l3s.icrawl.ui.wayback.HBaseResourceStoreFactory
 
HSqlMetadataDbManager - Class in de.l3s.icrawl.process.impl
 
HSqlMetadataDbManager(File, int) - Constructor for class de.l3s.icrawl.process.impl.HSqlMetadataDbManager
 
HtmlParseException - Exception in de.l3s.icrawl.util
 
HtmlParseException(String, Throwable) - Constructor for exception de.l3s.icrawl.util.HtmlParseException
 

I

ICRAWL_WS_NAMESPACE - Static variable in class de.l3s.icrawl.util.WebServiceUtils
 
icrawlDirectory - Variable in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor.Arguments
 
id - Variable in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
INCLUSIVE_COEFF - Static variable in class com.sharethis.textrank.Graph
Public definitions.
incrementCount(Mapper<?, ?, ?, ?>.Context, Enum<?>) - Static method in class de.l3s.icrawl.util.HadoopUtils
 
indexerScore(String, NutchDocument, WebPage, float) - Method in class de.l3s.icrawl.online.FocusScoringFilter
Dampen the boost value by scorePower.
init() - Method in class de.l3s.icrawl.ui.MvcConfig
 
init(FilterConfig) - Method in class de.l3s.icrawl.ui.SimpleCORSFilter
 
initialScore(String, WebPage) - Method in class de.l3s.icrawl.online.FocusScoringFilter
Set to 0.0f (unknown value) - inlink contributions will bring it to a correct level.
injectedScore(String, WebPage) - Method in class de.l3s.icrawl.online.FocusScoringFilter
 
InjectorFactory - Class in de.l3s.icrawl.apifetcher
 
InjectorFactory(Configuration) - Constructor for class de.l3s.icrawl.apifetcher.InjectorFactory
 
InjectStep - Class in de.l3s.icrawl.crawlmanager.step
 
InjectStep() - Constructor for class de.l3s.icrawl.crawlmanager.step.InjectStep
 
isAccountNonExpired() - Method in class de.l3s.icrawl.service.EvaluatorUserDetailsService.EvaluatorUserDetails
 
isAccountNonLocked() - Method in class de.l3s.icrawl.service.EvaluatorUserDetailsService.EvaluatorUserDetails
 
isActive() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
isAdjective(String) - Method in class com.sharethis.textrank.CoreNlpLanguageModel
 
isAdjective(String) - Method in class com.sharethis.textrank.LanguageModel
Determine whether the given PoS tag is an adjective.
isCredentialsNonExpired() - Method in class de.l3s.icrawl.service.EvaluatorUserDetailsService.EvaluatorUserDetails
 
isDownloadResources() - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
isEnabled() - Method in class de.l3s.icrawl.service.EvaluatorUserDetailsService.EvaluatorUserDetails
 
isFetched() - Method in class de.l3s.icrawl.repository.CrawlDataRepository.WebPageInfo
 
isMutable() - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
isNoun(String) - Method in class com.sharethis.textrank.CoreNlpLanguageModel
 
isNoun(String) - Method in class com.sharethis.textrank.LanguageModel
Determine whether the given PoS tag is a noun.
isRelevant(String) - Method in class com.sharethis.textrank.LanguageModel
Determine whether the given PoS tag is relevant to add to the graph.
isRunning() - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerManagerImpl
 
isRunning() - Method in class de.l3s.icrawl.process.impl.ApolloMessageBusManager
 
isRunning() - Method in class de.l3s.icrawl.process.impl.CrawlManagerProcessManager
 
isRunning() - Method in class de.l3s.icrawl.process.impl.HBaseCrawlDbManager
 
isRunning() - Method in class de.l3s.icrawl.process.impl.HSqlMetadataDbManager
 
isRunning() - Method in interface de.l3s.icrawl.process.ProcessManager
 
isScheduled() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
isValidDate(DateTime) - Static method in class de.l3s.icrawl.util.DateUtils
 
iterateGraph(int) - Method in class com.sharethis.textrank.Graph
Iterate through the graph, calculating rank.
iterator() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
iterator() - Method in class de.l3s.icrawl.domain.support.CountedSet
 

J

JmsConfig - Class in de.l3s.icrawl.process
 
JmsConfig() - Constructor for class de.l3s.icrawl.process.JmsConfig
 
job - Variable in class de.l3s.icrawl.crawlmanager.step.Step
 
jobBuilder(Campaign, String) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
jobBuilder(long, String) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
JobFailedException - Exception in de.l3s.icrawl.domain.crawl
 
JobFailedException(String) - Constructor for exception de.l3s.icrawl.domain.crawl.JobFailedException
 
jobs - Variable in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
JsonCollapsedUserType - Class in de.l3s.icrawl.domain.support
 
JsonCollapsedUserType() - Constructor for class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
jspViewResolver() - Method in class de.l3s.icrawl.ui.WaybackConfiguration
 

K

key - Variable in class com.sharethis.textrank.Node
 
KeyWord - Class in com.sharethis.textrank
Implements a node value in a TextRank graph denoting a noun or adjective.
KeyWord(String, String) - Constructor for class com.sharethis.textrank.KeyWord
Constructor.
keyword(String) - Method in class de.l3s.icrawl.ui.wizard.SuggestionFactory
 
KEYWORD_REDUCTION_FACTOR - Static variable in class com.sharethis.textrank.Graph
 
KeywordExtractorParseFilter - Class in de.l3s.icrawl.online
 
KeywordExtractorParseFilter() - Constructor for class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
KeywordPropertyEditor - Class in de.l3s.icrawl.ui.format
 
KeywordPropertyEditor() - Constructor for class de.l3s.icrawl.ui.format.KeywordPropertyEditor
 
KEYWORDS - Static variable in class de.l3s.icrawl.FieldNames
 
KeywordSuggestion - Class in de.l3s.icrawl.ui.wizard
 
KeywordSuggestion(String, String, String, String) - Constructor for class de.l3s.icrawl.ui.wizard.KeywordSuggestion
 
kill() - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
kill() - Method in interface de.l3s.icrawl.api.ApiFetcher
Stop the fetcher immediately, interrupting any ongoing transfers.
kill() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
kill() - Method in class de.l3s.icrawl.crawlmanager.CrawlJob
 
kill() - Method in interface de.l3s.icrawl.crawlmanager.TaskExecution
 
kill() - Method in class de.l3s.icrawl.export.warc.WarcExporterJob
 
killCrawl(long) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
Immediately and forcefully stop a crawl.
killCrawl(long) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 

L

Label - Class in de.l3s.icrawl.domain.evaluation
 
Label(Evaluator, String, Integer, String, Campaign) - Constructor for class de.l3s.icrawl.domain.evaluation.Label
 
Label(String, String) - Constructor for class de.l3s.icrawl.domain.specification.NamedEntity.Label
Create a new label with name and language
Labeler - Class in de.l3s.icrawl.online
 
Labeler(CRFClassifier<CoreMap>, String, String, String, String) - Constructor for class de.l3s.icrawl.online.Labeler
 
LabelerFactory - Class in de.l3s.icrawl.online
 
LabelerFactory(Map<String, Labeler>, String, Function<String, Labeler>) - Constructor for class de.l3s.icrawl.online.LabelerFactory
 
LabelRepository - Interface in de.l3s.icrawl.repository
 
lang - Variable in class com.sharethis.textrank.TextRank
Protected members.
LANGUAGE - Static variable in class de.l3s.icrawl.FieldNames
 
LanguageModel - Class in com.sharethis.textrank
Facade for handling language-specific tools in natural language processing.
LanguageModel() - Constructor for class com.sharethis.textrank.LanguageModel
 
length - Variable in class com.sharethis.textrank.NGram
 
liberalParseDate(String) - Static method in class de.l3s.icrawl.util.DateUtils
Try very hard to parse the parameter as a date.
link_rank - Variable in class com.sharethis.textrank.MetricVector
 
list() - Method in class de.l3s.icrawl.ui.CampaignController
 
list(Campaign, Crawl, String, StorageController.PageSelection) - Method in class de.l3s.icrawl.ui.StorageController
 
listFetchedWebpagesForCampaign(Campaign, int, String) - Method in class de.l3s.icrawl.repository.CrawlDataRepository
 
listUnfetchedWebpagesForCampaign(Campaign, int, String) - Method in class de.l3s.icrawl.repository.CrawlDataRepository
 
listWebpagesForCampaign(Campaign, int, String) - Method in class de.l3s.icrawl.repository.CrawlDataRepository
 
loadCrawlUpdates() - Method in class de.l3s.icrawl.crawlmanager.CrawlUpdatesFinder
 
loadUserByUsername(String) - Method in class de.l3s.icrawl.service.EvaluatorUserDetailsService
 
log(SessionLog) - Method in class de.l3s.icrawl.ui.CrawlWizardController
 
LogEntry - Class in de.l3s.icrawl.domain.evaluation
 
LogEntry() - Constructor for class de.l3s.icrawl.domain.evaluation.LogEntry
 

M

main(String[]) - Static method in class de.l3s.icrawl.crawlmanager.CrawlManagerService
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.BatchRelevance
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.DbInserter
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.ExtractUrls
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.FreshnessComputation
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.MetaTagsCounter
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.ScoresDistribution
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.twitterfetcher.BatchIdProducer
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.twitterfetcher.TwitterFetcher
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.UpdateFetchMark
 
main(String[]) - Static method in class de.l3s.icrawl.evaluation.UrlDates
 
main(String[]) - Static method in class de.l3s.icrawl.process.Bootstrap
 
main(String[]) - Static method in class de.l3s.icrawl.ui.UiConfiguration
 
map(String, WebPage, Mapper<String, WebPage, Text, LongWritable>.Context) - Method in class de.l3s.icrawl.crawlmanager.CrawlStatisticsJob.CrawlStatisticsMapper
 
map(String, WebPage, Mapper<String, WebPage, Text, DoubleWritable>.Context) - Method in class de.l3s.icrawl.crawlmanager.step.BatchScoreCounter.BatchScoreCounterMapper
 
map(String, WebPage, Mapper<String, WebPage, Text, DoubleWritable>.Context) - Method in class de.l3s.icrawl.evaluation.BatchRelevance.BatchRelevanceMapper
 
map(String, WebPage, Mapper<String, WebPage, Text, ExtractUrls.PageMetadata>.Context) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.ExtractUrlsMapper
 
map(String, WebPage, Mapper<String, WebPage, DateTimeWritable, LongWritable>.Context) - Method in class de.l3s.icrawl.evaluation.FreshnessComputation.FreshnessMapper
 
map(String, WebPage, Mapper<String, WebPage, Text, LongWritable>.Context) - Method in class de.l3s.icrawl.evaluation.MetaTagsCounter.MetaTagsMapper
 
map(String, WebPage, Mapper<String, WebPage, String, WebPage>.Context) - Method in class de.l3s.icrawl.evaluation.UpdateFetchMark.UpdateFetchMarkMapper
 
map(String) - Method in class de.l3s.icrawl.online.Labeler
 
map(String, WebPage) - Method in interface de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.ResultMapper
 
mapHttpStatus(ProtocolStatus) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
mapTokens(LanguageModel, Graph) - Method in class com.sharethis.textrank.Sentence
Main processing per sentence.
markAsScheduled(Crawl) - Method in interface de.l3s.icrawl.service.CrawlService
 
markAsScheduled(Crawl) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
marked - Variable in class com.sharethis.textrank.Node
 
matches(String, String, String) - Method in class de.l3s.icrawl.adblock.AddressPartFilter
 
matches(Element, String) - Method in interface de.l3s.icrawl.adblock.ElementFilter
 
matches(String, String, String) - Method in interface de.l3s.icrawl.adblock.Filter
 
matches(String, String, String) - Method in class de.l3s.icrawl.adblock.FilterSet
 
MAX_NGRAM_LENGTH - Static variable in class com.sharethis.textrank.TextRank
 
MAX_WORDNET_GRAPH - Static variable in class com.sharethis.textrank.TextRank
 
MAX_WORDNET_TEXT - Static variable in class com.sharethis.textrank.TextRank
 
maxNeighbor(double, double) - Method in class com.sharethis.textrank.Node
Search nearest neighbors in WordNet subgraph to find the maximum rank of any adjacent SYNONYM synset.
maxTerms - Variable in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor.Arguments
 
merge(Collection<DocumentVector>, boolean) - Static method in class de.l3s.icrawl.online.DocumentVector
 
MESSAGE_BUS_MANAGER_QUEUE - Static variable in class de.l3s.icrawl.process.JmsConfig
 
MessageBusManager - Interface in de.l3s.icrawl.process
 
META_ATTRIBUTE_NAMES - Static variable in class de.l3s.icrawl.util.DateUtils
 
META_DATE_KEYS - Static variable in class de.l3s.icrawl.util.DateUtils
 
METADATA_DB_MANAGER_QUEUE - Static variable in class de.l3s.icrawl.process.JmsConfig
 
MetadataDbManager - Interface in de.l3s.icrawl.process
 
MetaTagsCounter - Class in de.l3s.icrawl.evaluation
 
MetaTagsCounter() - Constructor for class de.l3s.icrawl.evaluation.MetaTagsCounter
 
MetaTagsCounter.Counters - Enum in de.l3s.icrawl.evaluation
 
MetaTagsCounter.Dates - Enum in de.l3s.icrawl.evaluation
 
MetaTagsCounter.MetaTagsMapper - Class in de.l3s.icrawl.evaluation
 
MetaTagsCounter.MetaTagsReducer - Class in de.l3s.icrawl.evaluation
 
MetaTagsMapper() - Constructor for class de.l3s.icrawl.evaluation.MetaTagsCounter.MetaTagsMapper
 
MetaTagsReducer() - Constructor for class de.l3s.icrawl.evaluation.MetaTagsCounter.MetaTagsReducer
 
metric - Variable in class com.sharethis.textrank.MetricVector
Public members.
metric_space - Variable in class com.sharethis.textrank.TextRank
 
MetricVector - Class in com.sharethis.textrank
Implements a point in the vector space representing the distance metric.
MetricVector(NodeValue, double, double, double) - Constructor for class com.sharethis.textrank.MetricVector
Constructor.
MIN_NORMALIZED_RANK - Static variable in class com.sharethis.textrank.TextRank
 
MockSeedSearcher - Class in de.l3s.icrawl.ui.wizard
 
MockSeedSearcher() - Constructor for class de.l3s.icrawl.ui.wizard.MockSeedSearcher
 
MODIFIED_KEY - Static variable in class de.l3s.icrawl.evaluation.FreshnessComputation
 
MONTH_MAPPINGS - Static variable in class de.l3s.icrawl.util.DateUtils
 
MvcConfig - Class in de.l3s.icrawl.ui
 
MvcConfig() - Constructor for class de.l3s.icrawl.ui.MvcConfig
 

N

NamedEntity - Class in de.l3s.icrawl.domain.specification
 
NamedEntity(NamedEntity.Type, String) - Constructor for class de.l3s.icrawl.domain.specification.NamedEntity
 
NamedEntity(NamedEntity.Type, Set<NamedEntity.Label>) - Constructor for class de.l3s.icrawl.domain.specification.NamedEntity
 
NamedEntity(NamedEntity.Type, NamedEntity.Label...) - Constructor for class de.l3s.icrawl.domain.specification.NamedEntity
 
NamedEntity.Label - Class in de.l3s.icrawl.domain.specification
An entity label.
NamedEntity.Type - Enum in de.l3s.icrawl.domain.specification
 
newInstance(Class<T>) - Static method in class de.l3s.icrawl.util.ReflectionUtils
 
nextExecution(DateTime, DateTime) - Method in class de.l3s.icrawl.domain.specification.CrawlSchedule
Return the date when the crawl should be executed next.
NGram - Class in com.sharethis.textrank
Implements a wrapper for tallying an n-gram in the text contains of selected keywords.
ngram_subgraph - Variable in class com.sharethis.textrank.TextRank
 
NLP_RESOURCES - Static variable in class com.sharethis.textrank.TextRank
Public definitions.
Node - Class in com.sharethis.textrank
Implements a node in the TextRank graph, denoting some noun or adjective morpheme.
node_list - Variable in class com.sharethis.textrank.Graph
Protected members.
node_list - Variable in class com.sharethis.textrank.Sentence
 
nodes - Variable in class com.sharethis.textrank.NGram
Public members.
NodeValue - Class in com.sharethis.textrank
Implements a node value in a TextRank graph.
NodeValue() - Constructor for class com.sharethis.textrank.NodeValue
 
noResult() - Static method in class de.l3s.icrawl.crawlmanager.CrawlScope.ScopeResult
 
NotFoundException - Exception in de.l3s.icrawl.ui
 
NotFoundException(String) - Constructor for exception de.l3s.icrawl.ui.NotFoundException
 
nullSafeGet(ResultSet, String[], SessionImplementor, Object) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
nullSafeSet(PreparedStatement, Object, int, SessionImplementor) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 

O

ObjectCache - Class in org.apache.nutch.util
Monkey-patch for Nutch's cache, limits the size of the used cache.
org.apache.nutch.util - package org.apache.nutch.util
 
OUTLINK_SCORES - Static variable in class de.l3s.icrawl.FieldNames
 
outputFile - Variable in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor.Arguments
 

P

PageMetadata() - Constructor for class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
PARAGRAPH_SCORE_WEIGHT - Static variable in class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
parse(String) - Method in class de.l3s.icrawl.api.ApiUrlParser
 
parse(Reader) - Static method in class de.l3s.icrawl.domain.specification.CrawlSpecificationUtils
 
parse(String) - Static method in class de.l3s.icrawl.domain.specification.CrawlSpecificationUtils
 
parseArguments(String[], T, String) - Static method in class de.l3s.icrawl.evaluation.CLIUtils
 
parseHtml(ByteBuffer, String) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
parseHtml(InputStream, String) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
parseHtml(String, String) - Static method in class de.l3s.icrawl.util.WebPageUtils
 
parseRules(String) - Static method in class de.l3s.icrawl.adblock.FilterParser
 
parseSeeds(File) - Static method in class de.l3s.icrawl.evaluation.twitterfetcher.TwitterFetcher
Parse a file with Twitter seeds.
ParseStep - Class in de.l3s.icrawl.crawlmanager.step
 
ParseStep() - Constructor for class de.l3s.icrawl.crawlmanager.step.ParseStep
 
parseWeightVector(String) - Static method in class de.l3s.icrawl.domain.specification.CrawlSpecificationUtils
 
pos - Variable in class com.sharethis.textrank.KeyWord
Public members.
prepCall(String, boolean) - Method in class com.sharethis.textrank.TextRank
Prepare to call algorithm with a new text to analyze.
printItem(CrawlUrl) - Method in class de.l3s.icrawl.ui.format.CrawlUrlPropertyEditor
 
printItem(NamedEntity) - Method in class de.l3s.icrawl.ui.format.EntityPropertyEditor
 
printItem(String) - Method in class de.l3s.icrawl.ui.format.KeywordPropertyEditor
 
processLine(KEY, VAL) - Method in interface de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.ResultLinesMapper
 
ProcessManager - Interface in de.l3s.icrawl.process
 
PROP_CLASS - Static variable in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
put(String, double) - Method in class de.l3s.icrawl.domain.specification.WeightVector
 
putAll(Map<String, Double>) - Method in class de.l3s.icrawl.domain.specification.WeightVector
 

Q

query(Campaign, String[], String, int, CrawlDataRepositoryTemplate.ResultMapper<T>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
query(long, String[], String, int, CrawlDataRepositoryTemplate.ResultMapper<T>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
query(Campaign, String[], String, int, CrawlDataRepositoryTemplate.ResultMapper<T>, CrawlDataRepositoryTemplate.QuerySetup) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
query(long, String[], String, int, CrawlDataRepositoryTemplate.ResultMapper<T>, CrawlDataRepositoryTemplate.QuerySetup) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate
 
query(WaybackRequest) - Method in class de.l3s.icrawl.ui.wayback.HBaseResourceIndex
 
queued(Campaign, Crawl, String) - Static method in class de.l3s.icrawl.domain.status.CrawlStatus
 
queued(long, String) - Static method in class de.l3s.icrawl.domain.status.ExportStatus
 
QUEUED - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
The job will be executed at a later point in time.

R

rank - Variable in class com.sharethis.textrank.Node
 
rank(String, Locale, int) - Method in class de.l3s.icrawl.online.TextRankWrapper
get the top k keywords of a text by using the TextRank algorithm
read() - Method in class de.l3s.icrawl.util.ByteBufferBackedInputStream
 
read(byte[], int, int) - Method in class de.l3s.icrawl.util.ByteBufferBackedInputStream
 
readFields(DataInput) - Method in class de.l3s.icrawl.evaluation.BatchScore
 
readFields(DataInput) - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
readFields(DataInput) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
readFromConfiguration(Configuration) - Static method in class de.l3s.icrawl.online.DocumentVectorUtils
 
readFromFile(File) - Static method in class de.l3s.icrawl.online.DocumentVectorSimilarity
 
RedditApiSearcher - Class in de.l3s.icrawl.ui.wizard
 
RedditApiSearcher() - Constructor for class de.l3s.icrawl.ui.wizard.RedditApiSearcher
 
reduce(Text, Iterable<LongWritable>, Reducer<Text, LongWritable, Text, LongWritable>.Context) - Method in class de.l3s.icrawl.crawlmanager.CrawlStatisticsJob.CrawlStatisticsReducer
 
reduce(Text, Iterable<DoubleWritable>, Reducer<Text, DoubleWritable, Text, DoubleWritable>.Context) - Method in class de.l3s.icrawl.crawlmanager.step.BatchScoreCounter.BatchScoreCounterReducer
 
reduce(Text, Iterable<DoubleWritable>, Reducer<Text, DoubleWritable, Text, DoubleWritable>.Context) - Method in class de.l3s.icrawl.evaluation.BatchRelevance.BatchRelevanceReducer
 
reduce(DateTimeWritable, Iterable<LongWritable>, Reducer<DateTimeWritable, LongWritable, DateTimeWritable, LongWritable>.Context) - Method in class de.l3s.icrawl.evaluation.FreshnessComputation.FreshnessReducer
 
ReferenceVectorExtractor - Class in de.l3s.icrawl.evaluation
 
ReferenceVectorExtractor() - Constructor for class de.l3s.icrawl.evaluation.ReferenceVectorExtractor
 
ReferenceVectorExtractor.Arguments - Class in de.l3s.icrawl.evaluation
 
ReferenceVectorExtractor.ReferenceVectorExtractorConfig - Class in de.l3s.icrawl.evaluation
 
ReferenceVectorExtractorConfig() - Constructor for class de.l3s.icrawl.evaluation.ReferenceVectorExtractor.ReferenceVectorExtractorConfig
 
ReflectionUtils - Class in de.l3s.icrawl.util
 
relevance() - Method in class de.l3s.icrawl.crawlmanager.CrawlScope.ScopeResult
Get the relevance of the tested resource.
removeRequest(ApiRequest, ApiFetcherContext) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
removeUri(String, ApiFetcherContext) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
removeUri(String, ApiFetcherContext) - Method in interface de.l3s.icrawl.api.ApiFetcher
Stop following updates for the given URI
render() - Method in class com.sharethis.textrank.MetricVector
Serialize as text.
renderContexts() - Method in class com.sharethis.textrank.NGram
Short-cut replacement for a toString() method.
replace(Object, Object, Object) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
reportError(ApiRequest, ApiStatus.ErrorType, ApiStatus.ErrorBehavior, String, Exception) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
reportError(ApiStatus.ErrorType, ApiStatus.ErrorBehavior, String, Exception) - Method in interface de.l3s.icrawl.api.ApiFetcherContext
Report an error while fetching from the API.
reportError(ApiStatus.ErrorType, ApiStatus.ErrorBehavior, String, Exception) - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
RepositoriesBase - Class in de.l3s.icrawl.repository
Marker class to be used with EnableJpaRepositories.
reset() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
result(double) - Static method in class de.l3s.icrawl.crawlmanager.CrawlScope.ScopeResult
 
retrieveResource(CaptureSearchResult) - Method in class de.l3s.icrawl.ui.wayback.HBaseResourceStore
 
returnedClass() - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
rules() - Method in class de.l3s.icrawl.adblock.FilterSet
 
run(CrawlDataRepositoryTemplate, Campaign) - Static method in class de.l3s.icrawl.crawlmanager.CrawlStatisticsJob
 
run(Map<String, Object>) - Method in class de.l3s.icrawl.crawlmanager.step.BatchScoreCounter
 
run(Map<String, Object>) - Method in class de.l3s.icrawl.crawlmanager.step.ClearMarksJob
 
run(String[]) - Method in class de.l3s.icrawl.evaluation.BatchRelevance
 
run(String[]) - Method in class de.l3s.icrawl.evaluation.FreshnessComputation
 
run(String[]) - Method in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor
 
running(String, String, String, ApiStatus) - Static method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
running(long, double) - Static method in class de.l3s.icrawl.domain.status.ExportStatus
 
RUNNING - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
The job is running currently.
RunningCrawlStatus - Class in de.l3s.icrawl.domain.status
 
RunningCrawlStatus(Campaign, Crawl, long, int, String, double, DateTime, Long, String) - Constructor for class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
runSetupAfterFirstBatch() - Method in class de.l3s.icrawl.crawlmanager.CrawlJob
Additional setup after first batch has been processed.
runTextRank() - Method in class com.sharethis.textrank.Graph
Run through N iterations of the TreeRank algorithm, or until the standard error converges below a given threshold.

S

s - Variable in class com.sharethis.textrank.Context
Public members.
saveLabel(Label) - Method in class de.l3s.icrawl.ui.EvaluationController
 
scheduleNextCrawlExecution(Crawl, CrawlExecutionRecord) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
scheduleNextCrawlExecution(Crawl, CrawlExecutionRecord) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
scheduleTaskExecution(TaskExecutionRecord<T>, DateTime) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
scheduleTaskExecution(TaskExecutionRecord<T>, DateTime) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
SCHEMA_NAME_PROPERTY - Static variable in class de.l3s.icrawl.FieldNames
 
ScoreCountStep - Class in de.l3s.icrawl.crawlmanager.step
 
ScoreCountStep(CrawlDataRepositoryTemplate, TaskExecutionService) - Constructor for class de.l3s.icrawl.crawlmanager.step.ScoreCountStep
 
ScoresDistribution - Class in de.l3s.icrawl.evaluation
 
scrubToken(String) - Method in class com.sharethis.textrank.LanguageModel
Clean the text for a token.
search(String, String) - Method in class de.l3s.icrawl.ui.CrawlWizardController
 
search(String, int, int) - Method in interface de.l3s.icrawl.ui.wizard.ApiSearcher
 
search(String, int, int) - Method in class de.l3s.icrawl.ui.wizard.BingApiSearcher
 
search(String, String) - Method in class de.l3s.icrawl.ui.wizard.MockSeedSearcher
 
search(String, int, int) - Method in class de.l3s.icrawl.ui.wizard.RedditApiSearcher
 
search(String, String) - Method in interface de.l3s.icrawl.ui.wizard.SeedSearcher
Search for a user-specified keyword query using the given source.
search(String, String) - Method in class de.l3s.icrawl.ui.wizard.SeedSearcherImpl
 
search(String) - Method in class de.l3s.icrawl.ui.wizard.SuggestionFactory
 
search(String, int, int) - Method in class de.l3s.icrawl.ui.wizard.TwitterApiSearcher
 
SearchException - Exception in de.l3s.icrawl.ui.wizard
Indicates that a search failed.
SearchException(String) - Constructor for exception de.l3s.icrawl.ui.wizard.SearchException
 
SearchException(Throwable) - Constructor for exception de.l3s.icrawl.ui.wizard.SearchException
 
SearchException(String, Throwable) - Constructor for exception de.l3s.icrawl.ui.wizard.SearchException
 
SeedCandidateAnalyzer - Interface in de.l3s.icrawl.ui.wizard
 
SeedCandidateAnalyzerImpl - Class in de.l3s.icrawl.ui.wizard
 
SeedCandidateAnalyzerImpl(ContentAnalyser) - Constructor for class de.l3s.icrawl.ui.wizard.SeedCandidateAnalyzerImpl
 
SeedSearcher - Interface in de.l3s.icrawl.ui.wizard
Find potential seed URLs using a keyword query.
SeedSearcherImpl - Class in de.l3s.icrawl.ui.wizard
 
SeedSearcherImpl(List<? extends ApiSearcher>, SeedCandidateAnalyzer) - Constructor for class de.l3s.icrawl.ui.wizard.SeedSearcherImpl
 
SeedSearchResult - Class in de.l3s.icrawl.ui.wizard
 
SeedSearchResult(String, String, String) - Constructor for class de.l3s.icrawl.ui.wizard.SeedSearchResult
 
SeedSearchResult(String, Collection<String>, Collection<NamedEntity>, String, String) - Constructor for class de.l3s.icrawl.ui.wizard.SeedSearchResult
 
send(URLCrawlEvent) - Method in class de.l3s.icrawl.online.EventSender
 
Sentence - Class in com.sharethis.textrank
 
Sentence(String) - Constructor for class com.sharethis.textrank.Sentence
Constructor.
serializeGraph(Set<String>) - Method in class com.sharethis.textrank.Node
Traverse the graph, serializing out the nodes and edges.
ServicesConfig - Class in de.l3s.icrawl.ui
 
ServicesConfig() - Constructor for class de.l3s.icrawl.ui.ServicesConfig
 
SessionLog - Class in de.l3s.icrawl.domain.evaluation
 
SessionLog() - Constructor for class de.l3s.icrawl.domain.evaluation.SessionLog
 
set(Configuration, CrawlSpecification) - Static method in class de.l3s.icrawl.domain.specification.CrawlSpecificationUtils
 
setApi(String) - Method in class de.l3s.icrawl.domain.specification.ApiFetcherConfig
 
setArchived(DateTime) - Method in class de.l3s.icrawl.domain.specification.Campaign
 
setBatch(BatchRecord) - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
setBatchId(String) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setBatchSeq(int) - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
setCampaign(Campaign) - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
setCampaign(Campaign) - Method in class de.l3s.icrawl.domain.evaluation.Label
 
setCampaign(Campaign) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
setCampaign(Campaign) - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
setCampaignId(Long) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
setCombiner(Class<? extends Reducer<MAP_KEY, MAP_VAL, REDUCE_KEY, REDUCE_VAL>>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setComment(String) - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
setComment(String) - Method in class de.l3s.icrawl.domain.evaluation.Label
 
setConf(Configuration) - Method in class de.l3s.icrawl.evaluation.BatchRelevance
 
setConf(Configuration) - Method in class de.l3s.icrawl.evaluation.FreshnessComputation
 
setConf(Configuration) - Method in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor
 
setConf(Configuration) - Method in class de.l3s.icrawl.online.FieldRegistrationFilter
 
setConf(Configuration) - Method in class de.l3s.icrawl.online.FocusScoringFilter
 
setConf(Configuration) - Method in class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
setConf(Configuration) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setConfiguration(Configuration) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
setConfiguration(Configuration) - Method in interface de.l3s.icrawl.api.ApiFetcher
Hook for injecting the system configuration.
setConfiguration(Configuration) - Method in class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
setConfiguration(T) - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
setContent(String) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Set the body of the request as a String.
setContent(byte[]) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Set the body of the request as a byte array.
setContentType(String) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Set the MIME type of the content.
setCrawl(Crawl) - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
setCrawl(Crawl) - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
setCrawlSchedule(CrawlSchedule) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
setCrawlSpecification(CrawlSpecification) - Method in class de.l3s.icrawl.online.KeywordExtractorParseFilter
 
setCreated(DateTime) - Method in class de.l3s.icrawl.domain.specification.Campaign
 
setCreated(DateTime) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
setDate(DateTime) - Method in class de.l3s.icrawl.domain.evaluation.LogEntry
 
setDateSource(WebPageDateExtractor.DateSource) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setDateTime(DateTime) - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
setDescription(String) - Method in class de.l3s.icrawl.domain.specification.Campaign
 
setDescription(String) - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
setDisplayUrl(String) - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
setDownloadResources(boolean) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
setDuration(Duration) - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
setEmail(String) - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
setEndTime(DateTime) - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
setEndTime(DateTime) - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
setEndTime(DateTime) - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
setEndTime(DateTime) - Method in class de.l3s.icrawl.domain.specification.CrawlSchedule
 
setEntities(Set<NamedEntity>) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
setEvaluator(Evaluator) - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
setEvaluator(Evaluator) - Method in class de.l3s.icrawl.domain.evaluation.Label
 
setExecution(long) - Method in class de.l3s.icrawl.domain.crawl.BatchRecord.BatchRecordKey
 
setExecutionId(long) - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
setExecutionStatus(TaskExecutionRecord.ExecutionStatus) - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
setFetchTime(long) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Set the timestamp of fetching the document.
setFetchTimestamp(long) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setFields(String[]) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setFields(Collection<WebPage.Field>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setFinished() - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
setHeaders(Map<String, String>) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Set the HTTP headers
setId(long) - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
setId(long) - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
setId(Long) - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
setId(Long) - Method in class de.l3s.icrawl.domain.evaluation.LogEntry
 
setId(Long) - Method in class de.l3s.icrawl.domain.specification.Campaign
 
setId(Long) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
setID(String) - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
setInterval(CrawlSchedule.Interval) - Method in class de.l3s.icrawl.domain.specification.CrawlSchedule
 
setKeywordQuery(FilterQuery, Set<String>) - Method in class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
setKeywords(Set<String>) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
setLanguage(String) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setLog(List<LogEntry>) - Method in class de.l3s.icrawl.domain.evaluation.SessionLog
 
setMapper(Class<? extends GoraMapper<String, WebPage, KEY, VAL>>, Class<KEY>, Class<VAL>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setMetadata(Map<String, Object>) - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
setMetadata(Map<String, Object>) - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
setModified(DateTime) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
setModified(WebPageDateExtractor.WebPageDate) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setModifiedTime(long) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Set the last-modified time of the document (optional).
setModifiedTimestamp(long) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setMsg(Map<String, Object>) - Method in class de.l3s.icrawl.domain.evaluation.LogEntry
 
setName(String) - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
setName(String) - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
setName(String) - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
setName(String) - Method in class de.l3s.icrawl.domain.specification.Campaign
 
setName(String) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
setNumHashtags(int) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setNumReducers(int) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setNumTokens(int) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setObject(String, Object) - Method in class org.apache.nutch.util.ObjectCache
 
setOutputFormat(Class<? extends OutputFormat>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setOwner(String) - Method in class de.l3s.icrawl.domain.specification.Campaign
 
setParameterValues(Properties) - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
setPassword(String) - Method in class de.l3s.icrawl.domain.evaluation.Evaluator
 
setPath(String) - Method in class de.l3s.icrawl.domain.crawl.WarcExporterRecord.ExportConfig
 
setPhase(String) - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
setPhaseProgress(double) - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
setProgress(double) - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
setRating(Integer) - Method in class de.l3s.icrawl.domain.evaluation.Label
 
setReason(String) - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
setReducer(Class<? extends Reducer<MAP_KEY, MAP_VAL, KEY, VAL>>, Class<KEY>, Class<VAL>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setRelevance(Integer) - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
setRequestUri(String) - Method in class de.l3s.icrawl.domain.specification.ApiFetcherConfig
 
setResults(List<BingSearchResult>) - Method in class de.l3s.icrawl.ui.wizard.BingSearchResultSet
 
setScheduled(boolean) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
setScore(double) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
setSeeds(Set<CrawlUrl>) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
setSeqNumber(int) - Method in class de.l3s.icrawl.domain.crawl.BatchRecord.BatchRecordKey
 
setSession(SessionLog) - Method in class de.l3s.icrawl.domain.evaluation.LogEntry
 
setSessionId(String) - Method in class de.l3s.icrawl.domain.evaluation.SessionLog
 
setSourceUrl(String) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
 
setSpecification(CrawlSpecification) - Method in class de.l3s.icrawl.domain.specification.Crawl
 
setStartTime(DateTime) - Method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
setStartTime(DateTime) - Method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
setStartTime(DateTime) - Method in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
setStartTime(DateTime) - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
setStartTime(DateTime) - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
setStatistics(List<CrawlStatistic>) - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
setStatus(String) - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
setStatusCode(int) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Set the status code of the request.
setStatusMessage(String) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Set the status message of the request.
setTitle(String) - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
setTotalBatches(Long) - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
setType(String) - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
setup(Mapper<String, WebPage, Text, DoubleWritable>.Context) - Method in class de.l3s.icrawl.crawlmanager.step.BatchScoreCounter.BatchScoreCounterMapper
 
setup(Mapper<String, WebPage, Text, DoubleWritable>.Context) - Method in class de.l3s.icrawl.evaluation.BatchRelevance.BatchRelevanceMapper
 
setup(Mapper<String, WebPage, Text, ExtractUrls.PageMetadata>.Context) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.ExtractUrlsMapper
 
setup(Mapper<String, WebPage, DateTimeWritable, LongWritable>.Context) - Method in class de.l3s.icrawl.evaluation.FreshnessComputation.FreshnessMapper
 
setup(Mapper<String, WebPage, Text, LongWritable>.Context) - Method in class de.l3s.icrawl.evaluation.MetaTagsCounter.MetaTagsMapper
 
setup(Job) - Method in interface de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobSetup
 
setup(Query<String, WebPage>) - Method in interface de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.QuerySetup
 
setup(Query<String, WebPage>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.StatusFilterQuerySetup
 
setupJob(CrawlDataRepositoryTemplate.JobSetup) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setupQuery(CrawlDataRepositoryTemplate.QuerySetup) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
setUrl(String) - Method in class de.l3s.icrawl.domain.api.ApiFetcherDocument.Builder
Add the URL of the document.
setUrl(String) - Method in class de.l3s.icrawl.domain.evaluation.EvaluationUrl
 
setUrl(EvaluationUrl) - Method in class de.l3s.icrawl.domain.evaluation.EvaluationVote
 
setUrl(String) - Method in class de.l3s.icrawl.domain.evaluation.Label
 
setUrl(String) - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
setUser(String) - Method in class de.l3s.icrawl.domain.crawl.WarcExporterRecord.ExportConfig
 
setUserQuery(FilterQuery, Set<String>) - Method in class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
setValues(Map<String, Long>) - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
show(Campaign) - Method in class de.l3s.icrawl.ui.CampaignController
 
show(Campaign, Crawl) - Method in class de.l3s.icrawl.ui.CrawlController
 
showBatch(Campaign, Crawl, TaskExecutionRecord<?>, int) - Method in class de.l3s.icrawl.ui.BatchController
 
showEvaluationForm() - Method in class de.l3s.icrawl.ui.EvaluationController
 
showExecution(Campaign, Crawl, TaskExecutionRecord<?>) - Method in class de.l3s.icrawl.ui.BatchController
 
showResource(Campaign, Crawl, String) - Method in class de.l3s.icrawl.ui.StorageController
 
shutDown() - Method in class de.l3s.icrawl.online.FocusingPlugin
 
shutdown() - Method in class de.l3s.icrawl.ui.wayback.HBaseResourceIndex
 
shutdown() - Method in class de.l3s.icrawl.ui.wayback.HBaseResourceStore
 
signInForm(Integer) - Method in class de.l3s.icrawl.ui.EvaluationController
 
signUp() - Method in class de.l3s.icrawl.ui.EvaluationController
 
SIMILARITY - Static variable in class de.l3s.icrawl.FieldNames
 
SimpleCORSFilter - Class in de.l3s.icrawl.ui
Sets HTTP headers to allow cross-origin request (needed for Crawl Wizard development)
SimpleCORSFilter() - Constructor for class de.l3s.icrawl.ui.SimpleCORSFilter
 
SingleRankKeywordExtractor - Class in de.l3s.icrawl.online.singlerank
 
SingleRankKeywordExtractor() - Constructor for class de.l3s.icrawl.online.singlerank.SingleRankKeywordExtractor
 
skipFurtherTesting() - Method in class de.l3s.icrawl.crawlmanager.CrawlScope.ScopeResult
Check if this answer is a complete answer.
skipReduce(Class<KEY>, Class<VAL>) - Method in class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.JobBuilder
 
sortResults(long) - Method in class com.sharethis.textrank.Graph
Sort results to identify potential keywords.
splitParagraph(String) - Method in class com.sharethis.textrank.CoreNlpLanguageModel
 
splitParagraph(String) - Method in class com.sharethis.textrank.LanguageModel
Split sentences within the paragraph text.
sqlTypes() - Method in class de.l3s.icrawl.domain.support.JsonCollapsedUserType
 
STANDARD_ERROR_THRESHOLD - Static variable in class com.sharethis.textrank.Graph
 
start - Variable in class com.sharethis.textrank.Context
 
start() - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerManagerImpl
 
start() - Method in class de.l3s.icrawl.process.impl.ApolloMessageBusManager
 
start() - Method in class de.l3s.icrawl.process.impl.CrawlManagerProcessManager
 
start() - Method in class de.l3s.icrawl.process.impl.HBaseCrawlDbManager
 
start() - Method in class de.l3s.icrawl.process.impl.HSqlMetadataDbManager
 
start() - Method in interface de.l3s.icrawl.process.ProcessManager
 
start(long, long) - Method in class de.l3s.icrawl.ui.CrawlController
 
start(Authentication) - Method in class de.l3s.icrawl.ui.EvaluationController
 
start_time - Variable in class com.sharethis.textrank.TextRank
 
startBatch() - Method in class de.l3s.icrawl.crawlmanager.TaskExecutionContext
 
startBatch(TaskExecutionRecord<?>) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
startBatch(TaskExecutionRecord<?>, BatchRecord) - Static method in class de.l3s.icrawl.domain.crawl.BatchRecord
 
startBatch(TaskExecutionRecord<?>) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
startCrawl(long) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
Schedule a crawl for immediate execution.
startCrawl(long) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
startExecution(TaskExecutionRecord<T>) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
startExecution(TaskExecutionRecord<T>) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
startFollowing(ApiRequest) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
startFollowing(ApiRequest) - Method in class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
starting(String, String, String) - Static method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
starting(Campaign, Crawl) - Static method in class de.l3s.icrawl.domain.status.CrawlStatus
 
starting(long, String) - Static method in class de.l3s.icrawl.domain.status.ExportStatus
 
STARTING - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
The job has been submitted to the crawl manager.
startStep(String) - Method in class de.l3s.icrawl.crawlmanager.TaskExecutionContext
 
startStep(BatchRecord, String) - Method in class de.l3s.icrawl.crawlmanager.TaskExecutionContext
 
startStep(BatchRecord, String) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
startStep(TaskExecutionRecord<?>, String) - Method in interface de.l3s.icrawl.crawlmanager.TaskExecutionService
 
startStep(BatchRecord, String) - Static method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
startStep(TaskExecutionRecord<?>, String) - Static method in class de.l3s.icrawl.domain.crawl.StepExecutionRecord
Start a step that belongs to the crawl itself (e.g. inject).
startStep(BatchRecord, String) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
startStep(TaskExecutionRecord<?>, String) - Method in class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
startTime - Variable in class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
startUp() - Method in class de.l3s.icrawl.online.FocusingPlugin
 
status(Campaign, Crawl, boolean) - Method in class de.l3s.icrawl.ui.CrawlController
 
status() - Method in class de.l3s.icrawl.ui.StatusController
 
StatusController - Class in de.l3s.icrawl.ui
 
StatusController() - Constructor for class de.l3s.icrawl.ui.StatusController
 
StatusFilterQuerySetup(byte) - Constructor for class de.l3s.icrawl.repository.CrawlDataRepositoryTemplate.StatusFilterQuerySetup
 
stemToken(String) - Method in class com.sharethis.textrank.CoreNlpLanguageModel
 
stemToken(String) - Method in class com.sharethis.textrank.LanguageModel
Perform stemming on the given token.
Step<T extends org.apache.nutch.util.NutchTool> - Class in de.l3s.icrawl.crawlmanager.step
 
Step(String, Step.StepType) - Constructor for class de.l3s.icrawl.crawlmanager.step.Step
 
Step.StepType - Enum in de.l3s.icrawl.crawlmanager.step
 
StepExecutionRecord - Class in de.l3s.icrawl.domain.crawl
 
StepExecutionRecord() - Constructor for class de.l3s.icrawl.domain.crawl.StepExecutionRecord
 
StepExecutionRecordRepository - Interface in de.l3s.icrawl.repository
 
StepFailedException - Exception in de.l3s.icrawl.crawlmanager.step
 
StepFailedException(String, Exception, Crawl) - Constructor for exception de.l3s.icrawl.crawlmanager.step.StepFailedException
 
stop(ApiFetcherContext) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
stop() - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
stop(ApiFetcherContext) - Method in interface de.l3s.icrawl.api.ApiFetcher
Stop monitoring all URIs for the given context.
stop() - Method in interface de.l3s.icrawl.api.ApiFetcher
Request that the fetcher should finish retrieving data in the near future.
stop() - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
stop() - Method in class de.l3s.icrawl.crawlmanager.CrawlJob
 
stop() - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerManagerImpl
 
stop() - Method in interface de.l3s.icrawl.crawlmanager.TaskExecution
 
stop() - Method in class de.l3s.icrawl.export.warc.WarcExporterJob
 
stop() - Method in class de.l3s.icrawl.process.impl.ApolloMessageBusManager
 
stop() - Method in class de.l3s.icrawl.process.impl.CrawlManagerProcessManager
 
stop() - Method in class de.l3s.icrawl.process.impl.HBaseCrawlDbManager
 
stop() - Method in class de.l3s.icrawl.process.impl.HSqlMetadataDbManager
 
stop() - Method in interface de.l3s.icrawl.process.ProcessManager
 
stop(long, long, RedirectAttributes) - Method in class de.l3s.icrawl.ui.CrawlController
 
stopCrawl(long) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
Schedule a graceful stop of a crawl.
stopCrawl(long) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
stopExport(long, boolean) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
Abort an export job.
stopExport(long, boolean) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
stopFollowing(ApiRequest) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
stopFollowing(ApiRequest) - Method in class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
stopJobsForCampaign(long) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
 
stopJobsForCampaign(long) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
stopped(String, String, String, ApiStatus) - Static method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
stopped(Campaign, Crawl) - Static method in class de.l3s.icrawl.domain.status.CrawlStatus
 
STOPPED - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
 
stopping(String, String, String, ApiStatus) - Static method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
stopping(Campaign, Crawl, double) - Static method in class de.l3s.icrawl.domain.status.CrawlStatus
 
stopping(long, String, double) - Static method in class de.l3s.icrawl.domain.status.ExportStatus
 
STOPPING - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
A stop of the job has been requested and is currently being processed.
StoppingCondition - Interface in de.l3s.icrawl.crawlmanager
 
stopRunningJobs() - Method in interface de.l3s.icrawl.repository.TaskExecutionRepository
Marks all currently running tasks as TaskExecutionRecord.ExecutionStatus.ABORTED
StorageController - Class in de.l3s.icrawl.ui
 
StorageController(CrawlDataRepository) - Constructor for class de.l3s.icrawl.ui.StorageController
 
StorageController.PageSelection - Enum in de.l3s.icrawl.ui
 
storeToConfiguration(Configuration, DocumentVectorSimilarity) - Static method in class de.l3s.icrawl.online.DocumentVectorUtils
 
stringify(Multiset<?>) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
stringify(List<String>) - Static method in class de.l3s.icrawl.domain.support.ByteBufferUtils
 
SuggestionFactory - Class in de.l3s.icrawl.ui.wizard
 
SuggestionFactory(UriComponentsBuilder) - Constructor for class de.l3s.icrawl.ui.wizard.SuggestionFactory
 
suggestions(String) - Method in class de.l3s.icrawl.ui.CrawlWizardController
 
summarize() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
Create statistics without tiny values.
synset_rank - Variable in class com.sharethis.textrank.MetricVector
 

T

tab() - Method in class de.l3s.icrawl.ui.BatchController
 
tagTokens(String[]) - Method in class com.sharethis.textrank.CoreNlpLanguageModel
 
tagTokens(String[]) - Method in class com.sharethis.textrank.LanguageModel
Run a part-of-speech tagger on the sentence token list.
TaskConfiguration - Class in de.l3s.icrawl.domain.specification
 
TaskConfiguration() - Constructor for class de.l3s.icrawl.domain.specification.TaskConfiguration
 
TaskExecution - Interface in de.l3s.icrawl.crawlmanager
 
TaskExecution.State - Enum in de.l3s.icrawl.crawlmanager
 
TaskExecutionContext - Class in de.l3s.icrawl.crawlmanager
 
TaskExecutionContext(TaskExecutionService, TaskExecutionRecord<?>) - Constructor for class de.l3s.icrawl.crawlmanager.TaskExecutionContext
 
TaskExecutionRecord<T extends TaskConfiguration> - Class in de.l3s.icrawl.domain.crawl
 
TaskExecutionRecord() - Constructor for class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
TaskExecutionRecord(Long, Campaign, Crawl, DateTime, DateTime, T) - Constructor for class de.l3s.icrawl.domain.crawl.TaskExecutionRecord
 
TaskExecutionRecord.ExecutionStatus - Enum in de.l3s.icrawl.domain.crawl
 
TaskExecutionRepository - Interface in de.l3s.icrawl.repository
 
TaskExecutionService - Interface in de.l3s.icrawl.crawlmanager
 
TaskExecutionServiceImpl - Class in de.l3s.icrawl.service
 
TaskExecutionServiceImpl(CrawlService, TaskExecutionRepository, BatchRecordRepository, StepExecutionRecordRepository) - Constructor for class de.l3s.icrawl.service.TaskExecutionServiceImpl
 
TaskStatus - Interface in de.l3s.icrawl.domain.status
 
template - Variable in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
text - Variable in class com.sharethis.textrank.NodeValue
Public members.
text - Variable in class com.sharethis.textrank.Sentence
Public members.
text - Variable in class com.sharethis.textrank.TextRank
 
TextExtractor - Class in de.l3s.icrawl.util
 
TextRank - Class in com.sharethis.textrank
Java implementation of the TextRank algorithm by Rada Mihalcea, et al.
TextRank(String, String) - Constructor for class com.sharethis.textrank.TextRank
Constructor.
TEXTRANK_DAMPING_FACTOR - Static variable in class com.sharethis.textrank.Graph
 
TextRankWrapper - Class in de.l3s.icrawl.online
Class wrapping an implementation of the TextRank algorithm for extracting keywords of a text.
TextRankWrapper() - Constructor for class de.l3s.icrawl.online.TextRankWrapper
 
TextRankWrapper.LANG_CODE - Enum in de.l3s.icrawl.online
 
TIME_ZONE_NAMES - Static variable in class de.l3s.icrawl.util.DateUtils
 
TimesHistogram(Map<DateTime, Long>, Map<Duration, Long>) - Constructor for class de.l3s.icrawl.evaluation.FreshnessComputation.TimesHistogram
 
toAbsoluteURL(URL, String) - Static method in class de.l3s.icrawl.online.KeywordExtractorParseFilter
Convert a possibly relative URL to an absolute URL
TOKEN_LENGTH_LIMIT - Static variable in class com.sharethis.textrank.LanguageModel
Public definitions.
token_list - Variable in class com.sharethis.textrank.Sentence
 
tokenizeSentence(String) - Method in class com.sharethis.textrank.CoreNlpLanguageModel
 
tokenizeSentence(String) - Method in class com.sharethis.textrank.LanguageModel
Tokenize the sentence text into an array of tokens.
topComponents(int) - Method in class de.l3s.icrawl.online.DocumentVector
 
TOPIC_ID - Static variable in class de.l3s.icrawl.online.EventSender
 
topK(Multiset<T>, int) - Static method in class de.l3s.icrawl.online.ContentAnalyser.Counts
 
topN(int) - Method in class de.l3s.icrawl.online.DocumentVector
 
toString() - Method in class com.sharethis.textrank.TextRank
Serialize resulting graph to a string.
toString() - Method in class de.l3s.icrawl.adblock.AddressPartFilter
 
toString() - Method in class de.l3s.icrawl.crawlmanager.CrawlScope.ScopeResult
 
toString() - Method in class de.l3s.icrawl.domain.api.ApiRequest
 
toString() - Method in class de.l3s.icrawl.domain.crawl.BatchRecord.BatchRecordKey
 
toString() - Method in class de.l3s.icrawl.domain.crawl.CrawlExecutionRecord
 
toString() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistic
 
toString() - Method in class de.l3s.icrawl.domain.crawl.CrawlStatistics
 
toString() - Method in class de.l3s.icrawl.domain.event.URLCrawlEvent
 
toString() - Method in class de.l3s.icrawl.domain.specification.ApiFetcherConfig
 
toString() - Method in class de.l3s.icrawl.domain.specification.Campaign
 
toString() - Method in class de.l3s.icrawl.domain.specification.Crawl
 
toString() - Method in class de.l3s.icrawl.domain.specification.CrawlSchedule
 
toString() - Method in class de.l3s.icrawl.domain.specification.CrawlSpecification
 
toString(CrawlSpecification) - Static method in class de.l3s.icrawl.domain.specification.CrawlSpecificationUtils
 
toString(WeightVector) - Static method in class de.l3s.icrawl.domain.specification.CrawlSpecificationUtils
 
toString() - Method in class de.l3s.icrawl.domain.specification.CrawlUrl
 
toString() - Method in class de.l3s.icrawl.domain.specification.NamedEntity.Label
 
toString() - Method in class de.l3s.icrawl.domain.specification.NamedEntity
 
toString() - Method in class de.l3s.icrawl.domain.specification.WeightVector
 
toString() - Method in class de.l3s.icrawl.domain.status.ApiFetcherStatus
 
toString() - Method in class de.l3s.icrawl.domain.status.ApiStatus
 
toString() - Method in class de.l3s.icrawl.domain.status.AugmentedCrawlStatus
 
toString() - Method in class de.l3s.icrawl.domain.status.CrawlStatus
 
toString() - Method in class de.l3s.icrawl.domain.status.ExportStatus
 
toString() - Method in class de.l3s.icrawl.domain.status.RunningCrawlStatus
 
toString() - Method in class de.l3s.icrawl.domain.support.CountedSet
 
toString() - Method in class de.l3s.icrawl.evaluation.BatchScore
 
toString() - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
toString() - Method in class de.l3s.icrawl.evaluation.FreshnessComputation.TimesHistogram
 
toString() - Method in class de.l3s.icrawl.evaluation.WebPageDateExtractor.WebPageDate
 
toString() - Method in class de.l3s.icrawl.online.DocumentVector
 
toString() - Method in class de.l3s.icrawl.online.DocumentVectorSimilarity
 
toString() - Method in class de.l3s.icrawl.ui.wizard.BingSearchResult
 
toString() - Method in class de.l3s.icrawl.ui.wizard.BingSearchResultSet
 
toString() - Method in class de.l3s.icrawl.ui.wizard.SeedSearchResult
 
truncateDate(DateTime, DateUtils.DateTimeTruncation) - Static method in class de.l3s.icrawl.util.DateUtils
 
truncateDate(DateTime, ReadablePartial) - Static method in class de.l3s.icrawl.util.DateUtils
 
truncateDuration(Duration, DateUtils.DurationTruncation) - Static method in class de.l3s.icrawl.util.DateUtils
 
truncateDuration(Duration, long) - Static method in class de.l3s.icrawl.util.DateUtils
 
twitter(String) - Method in class de.l3s.icrawl.ui.wizard.SuggestionFactory
 
TWITTER_MIME_TYPE - Static variable in class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
TwitterApiFetcher - Class in de.l3s.icrawl.apifetcher
 
TwitterApiFetcher() - Constructor for class de.l3s.icrawl.apifetcher.TwitterApiFetcher
 
TwitterApiSearcher - Class in de.l3s.icrawl.ui.wizard
 
TwitterApiSearcher(Twitter) - Constructor for class de.l3s.icrawl.ui.wizard.TwitterApiSearcher
 
TwitterFetcher - Class in de.l3s.icrawl.evaluation.twitterfetcher
Download all URLs that are tweeted by certain users or that match certain keywords.
TwitterFetcher(BlockingQueue<String>, Configuration, MetricRegistry) - Constructor for class de.l3s.icrawl.evaluation.twitterfetcher.TwitterFetcher
Create an empty fetcher.

U

UiConfiguration - Class in de.l3s.icrawl.ui
 
UiConfiguration() - Constructor for class de.l3s.icrawl.ui.UiConfiguration
 
uniform(Collection<String>) - Static method in class de.l3s.icrawl.domain.specification.WeightVector
 
unknown(Campaign, Crawl, String) - Static method in class de.l3s.icrawl.domain.status.CrawlStatus
 
UNKNOWN - Static variable in interface de.l3s.icrawl.domain.status.TaskStatus
 
update(Campaign, Crawl, Crawl, BindingResult) - Method in class de.l3s.icrawl.ui.CrawlController
 
updateCampaign(Campaign) - Method in interface de.l3s.icrawl.service.CrawlService
Persist all changes to the campaign to the database.
updateCampaign(Campaign) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
updateCrawl(long) - Method in interface de.l3s.icrawl.crawlmanager.CrawlManager
 
updateCrawl(long) - Method in class de.l3s.icrawl.crawlmanager.CrawlManagerImpl
 
updateCrawl(Crawl) - Method in interface de.l3s.icrawl.service.CrawlService
 
updateCrawl(Crawl) - Method in class de.l3s.icrawl.service.CrawlServiceImpl
 
UpdateFetchMark - Class in de.l3s.icrawl.evaluation
 
UpdateFetchMark.UpdateFetchMarkMapper - Class in de.l3s.icrawl.evaluation
 
UpdateFetchMarkMapper() - Constructor for class de.l3s.icrawl.evaluation.UpdateFetchMark.UpdateFetchMarkMapper
 
updateScore(String, WebPage, List<ScoreDatum>) - Method in class de.l3s.icrawl.online.FocusScoringFilter
Increase the score by a sum of inlinked scores.
updateWith(String, List<String>, List<NamedEntity>, String) - Method in class de.l3s.icrawl.ui.wizard.SeedSearchResult
 
URL_SESSIONID - Static variable in class de.l3s.icrawl.online.KeywordExtractorParseFilter
Regex for typical session id URL parameters
URLCrawlEvent - Class in de.l3s.icrawl.domain.event
Signals that an URL was downloaded and added to the crawl DB.
URLCrawlEvent(long, String, long, CountedSet<String>, CountedSet<NamedEntity>, DateTime) - Constructor for class de.l3s.icrawl.domain.event.URLCrawlEvent
 
UrlDates - Class in de.l3s.icrawl.evaluation
 
use_wordnet - Variable in class com.sharethis.textrank.TextRank
 
useDocumentFrequency - Variable in class de.l3s.icrawl.evaluation.ReferenceVectorExtractor.Arguments
 
userDetailsService() - Method in class de.l3s.icrawl.ui.WebSecurityConfig
 

V

value - Variable in class com.sharethis.textrank.MetricVector
 
value - Variable in class com.sharethis.textrank.Node
 
valueOf(String) - Static method in enum de.l3s.icrawl.api.ApiFetcher.Status
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.crawlmanager.step.Step.StepType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.crawlmanager.TaskExecution.State
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.domain.crawl.TaskExecutionRecord.ExecutionStatus
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.domain.specification.CrawlSchedule.Interval
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.domain.specification.CrawlUrl.Type
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.domain.specification.NamedEntity.Type
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.domain.specification.WeightingMethod
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.domain.status.ApiStatus.ErrorBehavior
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.domain.status.ApiStatus.ErrorType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.evaluation.MetaTagsCounter.Counters
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.evaluation.MetaTagsCounter.Dates
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.evaluation.WebPageDateExtractor.DateSource
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.online.TextRankWrapper.LANG_CODE
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.ui.StorageController.PageSelection
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.util.DateUtils.DateTimeTruncation
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.l3s.icrawl.util.DateUtils.DurationTruncation
Returns the enum constant of this type with the specified name.
values() - Static method in enum de.l3s.icrawl.api.ApiFetcher.Status
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.crawlmanager.step.Step.StepType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.crawlmanager.TaskExecution.State
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.domain.crawl.TaskExecutionRecord.ExecutionStatus
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.domain.specification.CrawlSchedule.Interval
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.domain.specification.CrawlUrl.Type
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.domain.specification.NamedEntity.Type
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.domain.specification.WeightingMethod
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.domain.status.ApiStatus.ErrorBehavior
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.domain.status.ApiStatus.ErrorType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.evaluation.MetaTagsCounter.Counters
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.evaluation.MetaTagsCounter.Dates
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.evaluation.WebPageDateExtractor.DateSource
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.online.TextRankWrapper.LANG_CODE
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.ui.StorageController.PageSelection
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.util.DateUtils.DateTimeTruncation
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.l3s.icrawl.util.DateUtils.DurationTruncation
Returns an array containing the constants of this enum type, in the order they are declared.
voteEvaluationUrl(String, String, int, UserDetails) - Method in class de.l3s.icrawl.ui.EvaluationController
 

W

WarcExporterJob - Class in de.l3s.icrawl.export.warc
 
WarcExporterJob(CrawlDataRepositoryTemplate, WarcExporterRecord) - Constructor for class de.l3s.icrawl.export.warc.WarcExporterJob
 
WarcExporterRecord - Class in de.l3s.icrawl.domain.crawl
 
WarcExporterRecord(Long, Campaign, DateTime, DateTime, String, String) - Constructor for class de.l3s.icrawl.domain.crawl.WarcExporterRecord
 
WarcExporterRecord.ExportConfig - Class in de.l3s.icrawl.domain.crawl
 
wayback(HttpServletRequest, HttpServletResponse, long) - Method in class de.l3s.icrawl.ui.WaybackController
 
WaybackConfiguration - Class in de.l3s.icrawl.ui
 
WaybackConfiguration() - Constructor for class de.l3s.icrawl.ui.WaybackConfiguration
 
WaybackController - Class in de.l3s.icrawl.ui
 
WaybackController() - Constructor for class de.l3s.icrawl.ui.WaybackController
 
waybackJsp() - Method in class de.l3s.icrawl.ui.WaybackController
 
WebPageDate(DateTime, WebPageDateExtractor.DateSource) - Constructor for class de.l3s.icrawl.evaluation.WebPageDateExtractor.WebPageDate
 
WebPageDate - Class in de.l3s.icrawl.online
class to get the date of a web page based on the DCTFinder of Xavier Tannier.
WebPageDateExtractor - Class in de.l3s.icrawl.evaluation
 
WebPageDateExtractor() - Constructor for class de.l3s.icrawl.evaluation.WebPageDateExtractor
 
WebPageDateExtractor.DateSource - Enum in de.l3s.icrawl.evaluation
 
WebPageDateExtractor.ExtractionException - Exception in de.l3s.icrawl.evaluation
 
WebPageDateExtractor.WebPageDate - Class in de.l3s.icrawl.evaluation
 
WebPageInfo(String, WebPage) - Constructor for class de.l3s.icrawl.repository.CrawlDataRepository.WebPageInfo
 
WebPageUtils - Class in de.l3s.icrawl.util
 
WebSecurityConfig - Class in de.l3s.icrawl.ui
 
WebSecurityConfig() - Constructor for class de.l3s.icrawl.ui.WebSecurityConfig
 
WebServiceUtils - Class in de.l3s.icrawl.util
 
weight(Map<String, Double>) - Method in class de.l3s.icrawl.domain.specification.WeightVector
 
WEIGHT - Static variable in class de.l3s.icrawl.FieldNames
 
WEIGHTING_METHOD_KEY - Static variable in class de.l3s.icrawl.FieldNames
 
WeightingMethod - Enum in de.l3s.icrawl.domain.specification
Method to calculate the relevance of a page
WEIGHTS_KEY - Static variable in class de.l3s.icrawl.FieldNames
 
WeightVector - Class in de.l3s.icrawl.domain.specification
 
WeightVector() - Constructor for class de.l3s.icrawl.domain.specification.WeightVector
 
WizardConfiguration - Class in de.l3s.icrawl.ui.wizard
 
WizardConfiguration() - Constructor for class de.l3s.icrawl.ui.wizard.WizardConfiguration
 
write(DataOutput) - Method in class de.l3s.icrawl.evaluation.BatchScore
 
write(DataOutput) - Method in class de.l3s.icrawl.evaluation.DateTimeWritable
 
write(DataOutput) - Method in class de.l3s.icrawl.evaluation.ExtractUrls.PageMetadata
 
writeDocument(ApiRequest, ApiFetcherDocument) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
writeDocument(ApiFetcherDocument) - Method in interface de.l3s.icrawl.api.ApiFetcherContext
Report a fetched document.
writeDocument(ApiFetcherDocument) - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
writeOutlink(ApiRequest, String, Map<String, String>) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
writeOutlink(String, Map<String, String>) - Method in interface de.l3s.icrawl.api.ApiFetcherContext
Report a new link that should be crawled.
writeOutlink(String, Map<String, String>) - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
writeRedirect(ApiRequest, String, String, Map<String, String>) - Method in class de.l3s.icrawl.api.AbstractApiFetcher
 
writeRedirect(String, String, Map<String, String>) - Method in interface de.l3s.icrawl.api.ApiFetcherContext
Report a resolved redirect, e.g. from an URL shortener service.
writeRedirect(String, String, Map<String, String>) - Method in class de.l3s.icrawl.apifetcher.ApiFetcherJob
 
writeScores(List<BatchScore>, PrintStream) - Method in class de.l3s.icrawl.evaluation.BatchRelevance
 
writeToFile(File) - Method in class de.l3s.icrawl.online.DocumentVectorSimilarity
 
A B C D E F G H I J K L M N O P Q R S T U V W 
Skip navigation links

Copyright © 2014–2015 L3S Research Center. All rights reserved.