Storage Integrations Overview

This guide will cover general prerequisites and running Alluxio locally with your desired under storage system. To learn how to configure Alluxio with each individual storage system, please look at their respective pages. Refer to configuring mount points to learn about the commands to mount the storages into Alluxio's namespace.

Prerequisites

In preparation for using your chosen storage system with Alluxio, please be sure you have all the required location, credentials, and additional properties before you begin configuring Alluxio to your under storage system.

For the purposes of this guide, the following are placeholders.

Storage SystemLocationCredentialsAdditional Properties

S3_BUCKET, S3_DIRECTORY

S3_ACCESS_KEY_ID, S3_SECRET_KEY

HDFS_NAMENODE, HDFS_PORT

Specify Hadoop version: HADOOP_VERSION

OSS_BUCKET, OSS_DIRECTORY

OSS_ACCESS_KEY_ID, OSS_ACCESS_KEY_SECRET, OSS_ENDPOINT

COS_BUCKET, COS_DIRECTORY

COS_ACCESS_KEY_ID, COS_ACCESS_KEY_SECRET, COS_REGION, COS_APP_ID

TOS_BUCKET, TOS_DIRECTORY

TOS_ACCESS_KEY_ID, TOS_ACCESS_KEY_SECRET, TOS_REGION, TOS_ENDPOINT

GCS_BUCKET, GCS_DIRECTORY

google_application_credentials or GCS_ACCESS_KEY_ID, GCS_SECRET_ACCESS_KEY

alluxio.underfs.gcs.version

Last updated