public interface Protocol extends FieldPluggable, Configurable
| Modifier and Type | Field and Description |
|---|---|
static java.lang.String |
CHECK_BLOCKING
Property name.
|
static java.lang.String |
CHECK_ROBOTS
Property name.
|
static java.lang.String |
X_POINT_ID
The name of the extension point.
|
| Modifier and Type | Method and Description |
|---|---|
ProtocolOutput |
getProtocolOutput(java.lang.String url,
WebPage page) |
crawlercommons.robots.BaseRobotRules |
getRobotRules(java.lang.String url,
WebPage page)
Retrieve robot rules applicable for this url.
|
getFieldsgetConf, setConfstatic final java.lang.String X_POINT_ID
static final java.lang.String CHECK_BLOCKING
static final java.lang.String CHECK_ROBOTS
ProtocolOutput getProtocolOutput(java.lang.String url, WebPage page)
crawlercommons.robots.BaseRobotRules getRobotRules(java.lang.String url,
WebPage page)
url - url to checkpage - Copyright © 2019 The Apache Software Foundation