Storage Integrations Overview
Last updated
Last updated
This guide will cover general prerequisites and running Alluxio locally with your desired under storage system. To learn how to configure Alluxio with each individual storage system, please look at their respective pages. Refer to configuring mount points to learn about the commands to mount the storages into Alluxio's namespace.
In preparation for using your chosen storage system with Alluxio, please be sure you have all the required location, credentials, and additional properties before you begin configuring Alluxio to your under storage system.
For the purposes of this guide, the following are placeholders.
| Storage System | Location | Credentials | Additional Properties |
|---|---|---|---|
S3_BUCKET, S3_DIRECTORY
S3_ACCESS_KEY_ID, S3_SECRET_KEY
HDFS_NAMENODE, HDFS_PORT
Specify Hadoop version:
HADOOP_VERSION
OSS_BUCKET, OSS_DIRECTORY
OSS_ACCESS_KEY_ID, OSS_ACCESS_KEY_SECRET, OSS_ENDPOINT
COS_BUCKET, COS_DIRECTORY
COS_ACCESS_KEY_ID, COS_ACCESS_KEY_SECRET, COS_REGION, COS_APP_ID
TOS_BUCKET, TOS_DIRECTORY
TOS_ACCESS_KEY_ID, TOS_ACCESS_KEY_SECRET, TOS_REGION, TOS_ENDPOINT
GCS_BUCKET, GCS_DIRECTORY
google_application_credentials
or
GCS_ACCESS_KEY_ID, GCS_SECRET_ACCESS_KEY
alluxio.underfs.gcs.version