Aliyun Object Storage Service
Last updated
Last updated
This guide describes how to configure as Alluxio's under storage system. Object Storage Service (OSS) is a massive, secure and highly reliable cloud storage service provided by Aliyun.
The Alluxio binaries must be on your machine. You can either , or .
In preparation for using OSS with Alluxio, follow the to sign up for OSS and create an OSS bucket.
To configure Alluxio to use OSS as under storage, you will need to modify the configuration file conf/alluxio-site.properties
. If the file does not exist, create the configuration file from the template.
Edit conf/alluxio-site.properties
file to set the under storage address to the OSS bucket and the OSS directory you want to mount to Alluxio. For example, the under storage address can be oss://alluxio-bucket/
if you want to mount the whole bucket to Alluxio, or oss://alluxio-bucket/alluxio/data
if only the directory /alluxio/data
inside the oss bucket alluxio-bucket
is mapped to Alluxio.
Specify the Aliyun credentials for OSS access. In conf/alluxio-site.properties
, add:
fs.oss.accessKeyId
and fs.oss.accessKeySecret
is the for OSS, which are created and managed in .
fs.oss.endpoint
is the internet endpoint of this bucket, which can be found in the bucket overview page with values like oss-us-west-1.aliyuncs.com
and oss-cn-shanghai.aliyuncs.com
. Available endpoints are listed in the .
Start the Alluxio servers:
Run a simple example program:
Visit your OSS directory oss://<OSS_BUCKET>/<OSS_DIRECTORY>
to verify the files and directories created by Alluxio exist. For this test, you should see files named like <OSS_BUCKET>/<OSS_DIRECTORY>/default_tests_files/BasicFile_CACHE_PROMOTE_MUST_CACHE
.
Stop Alluxio by running:
This will start an Alluxio master and an Alluxio worker. You can see the master UI at .
An OSS location can be mounted at a nested directory in the Alluxio namespace to have unified access to multiple under storage systems. Alluxio's can be used for this purpose. For example, the following command mounts a directory inside an OSS bucket into Alluxio directory /oss
: