Prerequisites

This guide covers the requirements for installing and running a production-ready Alluxio cluster.

High-Level Requirements

Before you begin, ensure your environment meets the following prerequisites.

Hardware

Component
Requirement

CPU Architecture

x86_64, ARM64

Software

Component
Requirement
Notes

Java

JDK 8 or 11

Required on all nodes where Alluxio components will run.

etcd

Version 3.4 or higher

Alluxio requires a running etcd cluster for service discovery and managing the mount table.

libfuse

Version 3.10+

Required on all nodes where you plan to run an Alluxio FUSE client.

Networking

Alluxio components communicate over specific network ports. Ensure your firewall rules and network policies allow connectivity between the Alluxio pods and between your applications and the Alluxio cluster.

Deploying with the Alluxio Kubernetes Operator is the recommended method for most use cases.

Kubernetes Cluster Prerequisites

  • Kubernetes Version: 1.19 or higher.

  • Helm: Version 3.6.0 or higher must be installed.

  • RBAC Permissions: The user or service account deploying Alluxio must have permissions to create CustomResourceDefinition (CRD), ServiceAccount, ClusterRole, and ClusterRoleBinding.

Resource Recommendations

We provide two reference configurations for deploying Alluxio on Kubernetes.

  • Minimum: Suitable for basic functional testing.

  • Preferred: Recommended for Proof of Concept (PoC) deployments and provides a better starting point for performance tuning.

Component
Resource
Minimum
Preferred (Operator Default)

K8s Node

CPU / Memory

8 Cores / 32GB

16 Cores / 64GB

Coordinator

CPU / Memory

1 Core / 4GB

6 Core / 10GB

Worker

CPU / Memory

2 Core / 8GB

8 Core / 20GB

FUSE

CPU / Memory

4 Core / 8GB

8 Core / 20GB

Page Store

Disk per Worker

100GB

100GB+ (Adjust based on your data)

Note: These are starting points. You should adjust the CPU limits, memory, and storage based on your specific workload and performance requirements.

Next Steps

Once you have met these prerequisites, you can proceed with the installation:

Last updated