public static class FetcherJob.FetcherMapper extends org.apache.gora.mapreduce.GoraMapper<java.lang.String,WebPage,IntWritable,FetchEntry>
Mapper class for Fetcher.
This class reads the random integer written by GeneratorJob as its
key while outputting the actual key and value arguments through a
FetchEntry instance.
one host has a huge number of URLs in your table while other hosts have
not, FetcherReducer will not be stuck on one host but process URLs
from other hosts as well.
Mapper.Context| Constructor and Description |
|---|
FetcherMapper() |
| Modifier and Type | Method and Description |
|---|---|
protected void |
map(java.lang.String key,
WebPage page,
Mapper.Context context) |
protected void |
setup(Mapper.Context context) |
protected void setup(Mapper.Context context)
setup in class Mapper<java.lang.String,WebPage,IntWritable,FetchEntry>protected void map(java.lang.String key,
WebPage page,
Mapper.Context context)
throws java.io.IOException,
java.lang.InterruptedException
map in class Mapper<java.lang.String,WebPage,IntWritable,FetchEntry>java.io.IOExceptionjava.lang.InterruptedExceptionCopyright © 2019 The Apache Software Foundation