Package org.apache.spark.io
package org.apache.spark.io
IO codecs used for compression.
-
ClassDescription:: DeveloperApi :: CompressionCodec allows the customization of choosing different compression implementations to be used in block storage.:: DeveloperApi :: LZ4 implementation of
CompressionCodec
.:: DeveloperApi :: LZF implementation ofCompressionCodec
.InputStream
implementation which uses direct buffer to read a file to avoid extra copy of data between Java and native memory which happens when usingBufferedInputStream
.InputStream
implementation which asynchronously reads ahead from the underlying input stream when specified amount of data has been read from the current buffer.:: DeveloperApi :: Snappy implementation ofCompressionCodec
.:: DeveloperApi :: ZStandard implementation ofCompressionCodec
.