org.duracloud.services.hadoop.replication.retry
Class RetryRepJobBuilder

java.lang.Object
  org.duracloud.services.hadoop.base.JobBuilder
      org.duracloud.services.hadoop.replication.RepJobBuilder
          org.duracloud.services.hadoop.replication.retry.RetryRepJobBuilder

public class RetryRepJobBuilder
extends RepJobBuilder

Constructor Summary

RetryRepJobBuilder(Map<String,String> params)
Constructs a Replication Job builder

Method Summary

protected Class	getInputFormat() Retrieves the input format which will be used to determine the input to the mapper functions.
org.apache.hadoop.mapred.JobConf	getJobConf() Constructs the JobConf to be used to run the map reduce job.
protected String	getJobName() Retrieves the name of the hadoop job.
protected Class	getMapper() Retrieves the mapper class which will be used for perform the hadoop mapping tasks.

Methods inherited from class org.duracloud.services.hadoop.replication.RepJobBuilder

getOutputFormat

Methods inherited from class org.duracloud.services.hadoop.base.JobBuilder

getReducer

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RetryRepJobBuilder

public RetryRepJobBuilder(Map<String,String> params)

Constructs a Replication Job builder

Parameters:

params - configuration for the job

Method Detail

getJobConf

public org.apache.hadoop.mapred.JobConf getJobConf()
                                            throws IOException,
                                                   ParseException

Constructs the JobConf to be used to run the map reduce job.

Overrides:

getJobConf in class JobBuilder

Throws:

IOException

ParseException

getJobName

protected String getJobName()

Retrieves the name of the hadoop job.

This method can be overridden to provide an alternate job name.

Overrides:

getJobName in class RepJobBuilder

getMapper

protected Class getMapper()

Retrieves the mapper class which will be used for perform the hadoop mapping tasks. The default mapper performs a simple file processing task.

This method can be overridden to provide an alternate mapper implementation class, possibly a subclass of the default mapper.

Overrides:

getMapper in class RepJobBuilder

getInputFormat

protected Class getInputFormat()

Retrieves the input format which will be used to determine the input to the mapper functions.

This method can be overridden to provide an alternate input format implementation class. Note that the returned class is expected to be a subclass of WholeFileInputFormat

Overrides:

getInputFormat in class JobBuilder