Uses of Class
org.apache.nutch.metadata.Metadata
Packages that use Metadata
Package
Description
Index content, configure and run indexing and cleaning jobs to
add, update, and delete documents from an index.
A Multi-valued Metadata container, and set
of constant fields for Nutch Metadata.
Helper classes related to the
Protocol
interface, see also org.apache.nutch.protocol.The
Parse interface and related classes.Classes related to the
Protocol interface,
see also org.apache.nutch.net.protocols.Protocol plugin which supports retrieving documents via HTTP/HTTPS using
Selenium and the
HtmlUnitDriver web
driver for the for the
HtmlUnit headless browser.
Protocol plugin which supports retrieving documents via the http protocol.
Protocol plugin which supports retrieving documents via the HTTP andHTTPS
protocols, optionally with Basic, Digest and NTLM authentication schemes for
web server as well as proxy server.
Protocol plugin which supports retrieving documents using and interacting
with Selenium.
Protocol plugin for HTTP/HTTPS based on
okhttp, supports HTTP 1.1
and/or http/2.
Protocol plugin which supports retrieving documents via
Selenium.
A segment stores all data from on generate/fetch/update cycle:
fetch list, protocol status, raw content, parsed content, and extracted outgoing links.
Miscellaneous tools.
Tools to import / export between Nutch segments and
WARC archives.
Sample plugins that parse and index Creative Commons metadata.
-
Uses of Metadata in org.apache.nutch.indexer
Methods in org.apache.nutch.indexer that return Metadata -
Uses of Metadata in org.apache.nutch.metadata
Subclasses of Metadata in org.apache.nutch.metadataModifier and TypeClassDescriptionclassA decorator to Metadata that adds for case-insensitive lookup of keys.classA decorator to Metadata that adds spellchecking capabilities to property names.Methods in org.apache.nutch.metadata that return MetadataMethods in org.apache.nutch.metadata with parameters of type MetadataModifier and TypeMethodDescriptionvoidAdd all name/value mappings (merge two metadata mappings).Constructors in org.apache.nutch.metadata with parameters of type MetadataModifierConstructorDescriptionMetaWrapper(Metadata metadata, Writable instance, Configuration conf) -
Uses of Metadata in org.apache.nutch.net.protocols
Methods in org.apache.nutch.net.protocols that return Metadata -
Uses of Metadata in org.apache.nutch.parse
Methods in org.apache.nutch.parse that return MetadataModifier and TypeMethodDescriptionParseData.getContentMeta()The originalMetadataretrieved from contentHTMLMetaTags.getGeneralTags()ParseData.getParseMeta()Other content properties.Methods in org.apache.nutch.parse with parameters of type MetadataConstructors in org.apache.nutch.parse with parameters of type Metadata -
Uses of Metadata in org.apache.nutch.protocol
Methods in org.apache.nutch.protocol that return MetadataMethods in org.apache.nutch.protocol with parameters of type MetadataModifier and TypeMethodDescriptionvoidContent.setMetadata(Metadata metadata) Other protocol-specific data.Constructors in org.apache.nutch.protocol with parameters of type Metadata -
Uses of Metadata in org.apache.nutch.protocol.htmlunit
Methods in org.apache.nutch.protocol.htmlunit that return Metadata -
Uses of Metadata in org.apache.nutch.protocol.http
Methods in org.apache.nutch.protocol.http that return Metadata -
Uses of Metadata in org.apache.nutch.protocol.httpclient
Methods in org.apache.nutch.protocol.httpclient that return MetadataMethods in org.apache.nutch.protocol.httpclient with parameters of type Metadata -
Uses of Metadata in org.apache.nutch.protocol.interactiveselenium
Methods in org.apache.nutch.protocol.interactiveselenium that return Metadata -
Uses of Metadata in org.apache.nutch.protocol.okhttp
Methods in org.apache.nutch.protocol.okhttp that return Metadata -
Uses of Metadata in org.apache.nutch.protocol.selenium
Methods in org.apache.nutch.protocol.selenium that return Metadata -
Uses of Metadata in org.apache.nutch.scoring.webgraph
Methods in org.apache.nutch.scoring.webgraph that return MetadataMethods in org.apache.nutch.scoring.webgraph with parameters of type Metadata -
Uses of Metadata in org.apache.nutch.segment
Methods in org.apache.nutch.segment with parameters of type MetadataModifier and TypeMethodDescriptionstatic CharsetSegmentReader.getCharset(Metadata parseMeta) Try to get HTML encoding from parse metadata. -
Uses of Metadata in org.apache.nutch.tools
Fields in org.apache.nutch.tools declared as MetadataMethods in org.apache.nutch.tools with parameters of type MetadataModifier and TypeMethodDescriptionstatic CommonCrawlFormatCommonCrawlFormatFactory.getCommonCrawlFormat(String formatType, String url, Content content, Metadata metadata, Configuration nutchConf, CommonCrawlConfig config) Deprecated.AbstractCommonCrawlFormat.getJsonData(String url, Content content, Metadata metadata) AbstractCommonCrawlFormat.getJsonData(String url, Content content, Metadata metadata, ParseData parseData) CommonCrawlFormat.getJsonData(String url, Content content, Metadata metadata) Returns a string representation of the JSON structure of the URL content.CommonCrawlFormat.getJsonData(String url, Content content, Metadata metadata, ParseData parseData) Returns a string representation of the JSON structure of the URL content.CommonCrawlFormatWARC.getJsonData(String url, Content content, Metadata metadata, ParseData parseData) Constructors in org.apache.nutch.tools with parameters of type MetadataModifierConstructorDescriptionAbstractCommonCrawlFormat(String url, Content content, Metadata metadata, Configuration nutchConf, CommonCrawlConfig config) CommonCrawlFormatJackson(String url, Content content, Metadata metadata, Configuration nutchConf, CommonCrawlConfig config) CommonCrawlFormatJettinson(String url, Content content, Metadata metadata, Configuration nutchConf, CommonCrawlConfig config) CommonCrawlFormatSimple(String url, Content content, Metadata metadata, Configuration nutchConf, CommonCrawlConfig config) CommonCrawlFormatWARC(String url, Content content, Metadata metadata, Configuration nutchConf, CommonCrawlConfig config, ParseData parseData) -
Uses of Metadata in org.apache.nutch.tools.warc
Methods in org.apache.nutch.tools.warc with parameters of type MetadataModifier and TypeMethodDescriptionprotected com.google.gson.JsonObjectWARCExporter.WARCMapReduce.WARCReducer.metadataToJson(Metadata meta) Adds keys/values of a Nuta metadata container to a JsonObject. -
Uses of Metadata in org.creativecommons.nutch
Methods in org.creativecommons.nutch with parameters of type MetadataModifier and TypeMethodDescriptionstatic voidCCParseFilter.Walker.walk(Node doc, URL base, Metadata metadata, Configuration conf) Scan the document adding attributes to metadata.