Qiniu Kodo
Last updated
Last updated
This guide describes how to configure Alluxio with as the under storage system. Qiniu Object Storage Service (Kodo) is a massive, secure and highly reliable cloud storage service.
To run an Alluxio cluster on a set of machines, you must deploy Alluxio binaries to each of these machines.You can , or .
A Qiniu Kodo bucket is necessary before using Kodo with Alluxio. In this guide, the Qiniu Kodo bucket is called KODO_BUCKET
, and the directory in the bucket is called KODO_DIRECTORY
. In addition, you should provide a domain to identify the specified bucket, which is called KODO_DOWNLOAD_HOST
. Through the KODO_DOWNLOAD_HOST
you can get objects from the bucket.
Alluxio unifies access to different storage systems through the feature. The root of Alluxio namespace or its subdirectories are all available for the mount point of Kodo.
If you want to use Qiniu Kodo as its under storage system in Alluxio, conf/alluxio-site.properties
must be modified. In the beginning, an existing Kodo bucket and its directory should be specified for storage by the following code:
Next, some settings must be added to conf/alluxio-site.properties
:
AccessKey/SecretKey
can be found in
alluxio.underfs.kodo.endpoint
is the endpoint of this bucket, which can be found in the bucket in this table:
East China
z0
iovip.qbox.me
North China
z1
iovip-z1.qbox.me
South China
z2
iovip-z2.qbox.me
North America
na0
iovip-na0.qbox.me
Southeast Asia
as0
iovip-as0.qbox.me
After everything is configured, you can start up Alluxio locally to see that everything works.
Next, you can run a simple example program:
After this succeeds, you can visit your Kodo directory kodo://<KODO_BUCKET>/<KODO_DIRECTORY>
to verify the files and directories mounted by Alluxio exist. For this test, you should see files named like KODO_BUCKET/KODO_DIRECTORY/default_tests_files/BasicFile_CACHE_PROMOTE_MUST_CACHE
.
To stop Alluxio, you can run:
alluxio.underfs.kodo.downloadhost
can be found in
An Kodo location can be mounted at a nested directory in the Alluxio namespace to have unified access to multiple under storage systems. Alluxio's can be used for this purpose. For example, the following command mounts a directory inside an Kodo bucket into Alluxio directory
This should start an Alluxio master and an Alluxio worker. You can see the master UI at .
Qiniu KODO UFS integration is contributed and maintained by the Alluxio community. The source code is located . Feel free submit pull requests to improve the integration and update the documentation if any information is missing or out of date.