> For the complete documentation index, see [llms.txt](https://documentation.alluxio.io/os-en/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://documentation.alluxio.io/os-en/ufs/cephobjectstorage.md). # CephObjectStorage This guide describes how to configure Alluxio with Ceph Object Storage as the under storage system. Alluxio supports two different clients APIs to connect to [Ceph Object Storage](http://ceph.com/ceph-storage/object-storage/) using [Rados Gateway](http://docs.ceph.com/docs/master/radosgw/): * [S3](http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html) (preferred) * [Swift](http://docs.openstack.org/developer/swift/) ## Prerequisites The Alluxio binaries must be on your machine. You can either [compile Alluxio](/os-en/contributor/building-alluxio-from-source.md), or [download the binaries locally](/os-en/install-alluxio/running-alluxio-locally.md). ## Basic Setup A Ceph bucket can be mounted to Alluxio either at the root of the namespace, or at a nested directory. ### Root Mount Point Configure Alluxio to use under storage systems by modifying `conf/alluxio-site.properties`. If it does not exist, create the configuration file from the template. ```console $ cp conf/alluxio-site.properties.template conf/alluxio-site.properties ``` #### Option 1: S3 Interface (preferred) Modify `conf/alluxio-site.properties` to include: ```properties alluxio.master.mount.table.root.ufs=s3:/// alluxio.master.mount.table.root.option.s3a.accessKeyId= alluxio.master.mount.table.root.option.s3a.secretKey= alluxio.master.mount.table.root.option.alluxio.underfs.s3.endpoint=http://: alluxio.master.mount.table.root.option.alluxio.underfs.s3.disable.dns.buckets=true alluxio.master.mount.table.root.option.alluxio.underfs.s3.inherit.acl= ``` If using a Ceph release such as hammer (or older) specify `alluxio.underfs.s3.signer.algorithm=S3SignerType` to use v2 S3 signatures. To use GET Bucket (List Objects) Version 1 specify `alluxio.underfs.s3.list.objects.v1=true`. #### Option 2: Swift Interface Modify `conf/alluxio-site.properties` to include: ```properties alluxio.master.mount.table.root.ufs=swift:/// alluxio.master.mount.table.root.option.fs.swift.user= alluxio.master.mount.table.root.option.fs.swift.tenant= alluxio.master.mount.table.root.option.fs.swift.password= alluxio.master.mount.table.root.option.fs.swift.auth.url= alluxio.master.mount.table.root.option.fs.swift.auth.method= ``` Replace `/` with an existing Swift container location. Possible values of `` are `true`, `false`. Specify `` as `swiftauth` if using native Ceph RGW authentication and `` as `http://:/auth/1.0`. ### Nested Mount Point An Ceph location can be mounted at a nested directory in the Alluxio namespace to have unified access to multiple under storage systems. Alluxio's [Command Line Interface](/os-en/operation/user-cli.md) can be used for this purpose. Issue the following command to use the S3 interface: ```console $ ./bin/alluxio fs mount \ --option s3a.accessKeyId= \ --option s3a.secretKey= \ --option alluxio.underfs.s3.endpoint= \ --option alluxio.underfs.s3.disable.dns.buckets=true \ --option alluxio.underfs.s3.inherit.acl=false \ /mnt/ceph s3:/// ``` Similarly, to use the Swift interface: ```console $ ./bin/alluxio fs mount \ --option fs.swift.user= \ --option fs.swift.tenant= \ --option fs.swift.password= \ --option fs.swift.auth.url= \ --option fs.swift.auth.method= \ /mnt/ceph swift:/// ``` ## Running Alluxio Locally with Ceph Start up Alluxio locally to see that everything works. ```console $ ./bin/alluxio format $ ./bin/alluxio-start.sh local ``` This should start an Alluxio master and an Alluxio worker. You can see the master UI at . Run a simple example program: ```console $ ./bin/alluxio runTests ``` Visit your bucket to verify the files and directories created by Alluxio exist. You should see files named like: ``` //default_tests_files/Basic_CACHE_THROUGH ``` To stop Alluxio, run: ```console $ ./bin/alluxio-stop.sh local ``` ## Advanced Setup ### Access Control If Alluxio security is enabled, Alluxio enforces the access control inherited from underlying Ceph Object Storage. Depending on the interace used, refer to [S3 Access Control](/os-en/ufs/s3.md#identity-and-access-control-of-s3-objects) or [Swift Access Control](/os-en/ufs/swift.md#swift-access-control) for more information. --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter: ``` GET https://documentation.alluxio.io/os-en/ufs/cephobjectstorage.md?ask=&goal= ``` `ask` is the immediate question: it should be specific, self-contained, and written in natural language. `goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.