org.apache.hadoop.fs.aliyun.oss

类 AliyunOSSFileSystemStore

java.lang.Object

org.apache.hadoop.fs.aliyun.oss.AliyunOSSFileSystemStore

public class AliyunOSSFileSystemStore
extends Object

Core implementation of Aliyun OSS Filesystem for Hadoop. Provides the bridging logic between Hadoop's abstract filesystem and Aliyun OSS.

字段概要

字段

限定符和类型	字段和说明
static org.slf4j.Logger	LOG

构造器概要

构造器

构造器和说明
AliyunOSSFileSystemStore()

方法概要

限定符和类型	方法和说明
void	close() Close OSS client properly.
boolean	copyFile(String srcKey, String dstKey) Copy an object from source key to destination key.
void	deleteDirs(String key) Delete a directory from Aliyun OSS.
void	deleteObject(String key) Delete an object, and update write operation statistics.
void	deleteObjects(List<String> keysToDelete) Delete a list of keys, and update write operation statistics.
com.aliyun.oss.model.ObjectMetadata	getObjectMetadata(String key) Return metadata of a given object key.
void	initialize(URI uri, org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem.Statistics stat)
com.aliyun.oss.model.ObjectListing	listObjects(String prefix, int maxListingLength, String marker, boolean recursive) list objects.
void	multipartUploadObject(String key, File file) Upload a file as an OSS object, using multipart upload.
void	purge(String prefix) Clean up all objects matching the prefix.
InputStream	retrieve(String key, long byteStart, long byteEnd) Retrieve a part of an object.
void	storeEmptyFile(String key) Upload an empty file as an OSS object, using single upload.
void	uploadObject(String key, File file) Upload a file as an OSS object, using single upload.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

LOG

public static final org.slf4j.Logger LOG

构造器详细资料

AliyunOSSFileSystemStore

public AliyunOSSFileSystemStore()

方法详细资料

initialize

public void initialize(URI uri,
                       org.apache.hadoop.conf.Configuration conf,
                       org.apache.hadoop.fs.FileSystem.Statistics stat)
                throws IOException

抛出:

IOException

deleteObject

public void deleteObject(String key)

Delete an object, and update write operation statistics.

参数:

key - key to blob to delete.

deleteObjects

public void deleteObjects(List<String> keysToDelete)

Delete a list of keys, and update write operation statistics.

参数:

keysToDelete - collection of keys to delete.

deleteDirs

public void deleteDirs(String key)

Delete a directory from Aliyun OSS.

参数:

key - directory key to delete.

getObjectMetadata

public com.aliyun.oss.model.ObjectMetadata getObjectMetadata(String key)

Return metadata of a given object key.

参数:

key - object key.

返回:

return null if key does not exist.

storeEmptyFile

public void storeEmptyFile(String key)
                    throws IOException

Upload an empty file as an OSS object, using single upload.

参数:

key - object key.

抛出:

IOException - if failed to upload object.

copyFile

public boolean copyFile(String srcKey,
                        String dstKey)

Copy an object from source key to destination key.

参数:

srcKey - source key.

dstKey - destination key.

返回:

true if file is successfully copied.

uploadObject

public void uploadObject(String key,
                         File file)
                  throws IOException

Upload a file as an OSS object, using single upload.

参数:

key - object key.

file - local file to upload.

抛出:

IOException - if failed to upload object.

multipartUploadObject

public void multipartUploadObject(String key,
                                  File file)
                           throws IOException

Upload a file as an OSS object, using multipart upload.

参数:

key - object key.

file - local file to upload.

抛出:

IOException - if failed to upload object.

listObjects

public com.aliyun.oss.model.ObjectListing listObjects(String prefix,
                                                      int maxListingLength,
                                                      String marker,
                                                      boolean recursive)

list objects.

参数:

prefix - prefix.

maxListingLength - max no. of entries

marker - last key in any previous search.

recursive - whether to list directory recursively.

返回:

a list of matches.

retrieve

public InputStream retrieve(String key,
                            long byteStart,
                            long byteEnd)

Retrieve a part of an object.

参数:

key - the object name that is being retrieved from the Aliyun OSS.

byteStart - start position.

byteEnd - end position.

返回:

This method returns null if the key is not found.

close

public void close()

Close OSS client properly.

purge

public void purge(String prefix)

Clean up all objects matching the prefix.

参数:

prefix - Aliyun OSS object prefix.