FAQ
Last updated
Last updated
, formerly Tachyon, is an open source, memory speed, virtual distributed storage. It enables any application to interact with any data from any storage system at memory speed. Read more about Alluxio .
Alluxio requires JDK 1.8 or JDK 11 to run on various distributions of Linux / MacOS.
Alluxio is open sourced under the Apache 2.0 license.
Some possible reasons to consider:
The job is computation bound and does not spend significant time reading or writing data. Because the bottleneck is not in I/O performance, the benefit from faster Alluxio I/O is small.
The persistent storage is co-located with compute (e.g. Alluxio is connected to a local HDFS) and the input data of the job is in the OS .
Due to misconfiguration, clients are not able to identify their corresponding local Alluxio worker. This results in reading from remote Alluxio workers through the network, resulting in low data-locality.
Input data is not loaded into Alluxio yet or already evicted, causing the job to read from the under storage instead of the Alluxio cache.
It is recommended to deploy Alluxio as a stand-alone system. Orchestration frameworks supported include:
No, rebalancing of data blocks in Alluxio is not currently supported.
No, Alluxio can run on many under storage systems such as Amazon S3 or Swift in addition to HDFS.
Read the Alluxio book to learn Alluxio comprehensively.
Alluxio is primarily developed in Java and exposes Java-like File APIs for other applications to interact with. Alluxio supports other language bindings (experimental currently) including and .
Alluxio can be run as a FUSE mount exposing a . This enables any program which normally accesses a local file system to access data from Alluxio without modification. This is a common way for applications written in non-Java languages or non-Hadoop APIs to access Alluxio data without needing to rewrite the application.
It is not required for the input data set to fit in Alluxio storage space in order for applications to work. Alluxio will transparently load data on demand from the under storage. To help fit more data in Alluxio's storage space, configure Alluxio to leverage other storage resources such as SSD and HDD in addition to memory to extend Alluxio storage capacity. Read more about Alluxio storage setup .
Yes. See instructions about .
Join the to chat with users and developers.
Read the recent and .
Join the meetup group for Alluxio at . Other Alluxio events can be found .
is used to track feature development and issues. To report an issue or propose a feature, post on the Github issue.
For any questions related to installation, contribution or feedback, please join our or send an email to the . We look forward to seeing you there.
Thank you for your interest in contributing. Please read .