Class | Description |
---|---|
FileCommitProtocol |
An interface to define how a single Spark job commits its outputs.
|
FileCommitProtocol.EmptyTaskCommitMessage$ | |
FileCommitProtocol.TaskCommitMessage | |
HadoopMapRedCommitProtocol |
An
FileCommitProtocol implementation backed by an underlying Hadoop OutputCommitter
(from the old mapred API). |
HadoopMapReduceCommitProtocol |
An
FileCommitProtocol implementation backed by an underlying Hadoop OutputCommitter
(from the newer mapreduce API, not the old mapred API). |
HadoopWriteConfigUtil<K,V> |
Interface for create output format/committer/writer used during saving an RDD using a Hadoop
OutputFormat (both from the old mapred API and the new mapreduce API)
|
SparkHadoopWriter |
A helper object that saves an RDD using a Hadoop OutputFormat.
|
SparkHadoopWriterUtils |
A helper object that provide common utils used during saving an RDD using a Hadoop OutputFormat
(both from the old mapred API and the new mapreduce API)
|