@InterfaceAudience.Public @InterfaceStability.Stable public class LazyOutputFormat<K,V> extends FilterOutputFormat<K,V>
MultipleOutputs documentation for more information.| Modifier and Type | Field and Description |
|---|---|
static String |
OUTPUT_FORMAT |
baseOut| Constructor and Description |
|---|
LazyOutputFormat() |
| Modifier and Type | Method and Description |
|---|---|
void |
checkOutputSpecs(JobContext context)
Check for validity of the output-specification for the job.
|
OutputCommitter |
getOutputCommitter(TaskAttemptContext context)
Get the output committer for this output format.
|
RecordWriter<K,V> |
getRecordWriter(TaskAttemptContext context)
Get the
RecordWriter for the given task. |
static void |
setOutputFormatClass(Job job,
Class<? extends OutputFormat> theClass)
Set the underlying output format for LazyOutputFormat.
|
public static String OUTPUT_FORMAT
public static void setOutputFormatClass(Job job, Class<? extends OutputFormat> theClass)
job - the Job to modifytheClass - the underlying classpublic RecordWriter<K,V> getRecordWriter(TaskAttemptContext context) throws IOException, InterruptedException
OutputFormatRecordWriter for the given task.getRecordWriter in class FilterOutputFormat<K,V>context - the information about the current task.RecordWriter to write the output for the job.IOExceptionInterruptedExceptionpublic void checkOutputSpecs(JobContext context) throws IOException, InterruptedException
OutputFormatThis is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.
Implementations which write to filesystems which support delegation tokens usually collect the tokens for the destination path(s) and attach them to the job context's JobConf.checkOutputSpecs in class FilterOutputFormat<K,V>context - information about the jobIOException - when output should not be attemptedInterruptedExceptionpublic OutputCommitter getOutputCommitter(TaskAttemptContext context) throws IOException, InterruptedException
OutputFormatgetOutputCommitter in class FilterOutputFormat<K,V>context - the task contextIOExceptionInterruptedExceptionCopyright © 2024 Apache Software Foundation. All rights reserved.