org.duracloud.services.hadoop.replication.retry

Class RetryRepMapper

java.lang.Object

org.apache.hadoop.mapred.MapReduceBase

org.duracloud.services.hadoop.base.ProcessFileMapper

org.duracloud.services.hadoop.replication.RepMapper

org.duracloud.services.hadoop.replication.retry.RetryRepMapper

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.Writable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

public class RetryRepMapper
extends RepMapper

Field Summary

Fields inherited from class org.duracloud.services.hadoop.replication.RepMapper

DATE, REP_ATTEMPTS, REP_RESULT, SRC_SIZE

Fields inherited from class org.duracloud.services.hadoop.base.ProcessFileMapper

ERR_MESSAGE, FAILURE, INPUT_PATH, jobConf, MAX_THREAD_WAIT, pathUtil, RESULT, RESULT_PATH, resultInfo, SUCCESS

Constructor Summary

Constructors

Constructor and Description
RetryRepMapper()

Method Summary

Methods

Modifier and Type	Method and Description
protected String	collectResult() Collects the result of the mapping process.
void	map(org.apache.hadoop.io.Writable key, org.apache.hadoop.io.Text value, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> output, org.apache.hadoop.mapred.Reporter reporter) Performs the actual file processing.

Methods inherited from class org.duracloud.services.hadoop.replication.RepMapper

processFile

Methods inherited from class org.duracloud.services.hadoop.base.ProcessFileMapper

collect, configure, copyFileLocal, getContentStore, getStoreManager, map, moveToOutput, processFile, setStoreManager, waitOnThread

Methods inherited from class org.apache.hadoop.mapred.MapReduceBase

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.io.Closeable

close

Constructor Detail

RetryRepMapper

public RetryRepMapper()

Method Detail

map

public void map(org.apache.hadoop.io.Writable key,
       org.apache.hadoop.io.Text value,
       org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> output,
       org.apache.hadoop.mapred.Reporter reporter)
         throws IOException

Description copied from class: ProcessFileMapper

Performs the actual file processing.

Specified by:

map in interface org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.Writable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Overrides:

map in class ProcessFileMapper

Throws:

IOException

collectResult

protected String collectResult()
                        throws IOException

Description copied from class: ProcessFileMapper

Collects the result of the mapping process. This method may be overridden to provide more specific result info.

Overrides:

collectResult in class RepMapper

Throws:

IOException