Alluxio
ProductsLanguageHome
AI-3.6 (stable)
AI-3.6 (stable)
  • Overview
    • Alluxio Namespace and Under File System
    • Worker Management and Consistent Hashing
    • Multi Tenancy and Unified Management
    • I/O Resiliency
  • Getting Started with K8s
    • Resource Prerequisites and Compatibility
    • Installation
      • Install on Kubernetes
      • Handling Images
      • Advanced Configuration
      • License
    • Monitoring and Metrics
    • Management Console
      • Deployment
      • Navigation
      • User Roles & Access Control
    • Cluster Administration
    • System Health Check & Quick Recovery
    • Diagnostic Snapshot
  • Storage Integrations
    • Amazon AWS S3
    • Google Cloud GCS
    • Azure Blob Store
    • Aliyun OSS
    • Tencent COS
    • Volcengine TOS
    • Baidu Object Storage
    • HDFS
    • Network Attached Storage (NAS)
  • Data Access
    • Access via FUSE (POSIX API)
      • Client Writeback
      • Client Virtual Path Mapping
    • Access via S3 API
    • Access via PythonSDK/FSSpec
    • Data Access High Availability
      • Multiple Replicas
      • Multiple Availability Zones (AZ)
    • Performance Optimizations
      • File Reading
      • File Writing
      • Metadata Listing
    • UFS Bandwidth Limiter
  • Cache Management
    • Cache Filter Policy
    • Cache Loading
    • Cache Eviction
      • Manual Eviction by Free Command
      • Auto Eviction by TTL Policy
      • Auto Eviction by Priority Policy
    • Stale Cache Cleaning
    • Cache Quota
  • Performance Benchmarks
    • Fio (POSIX) Benchmark
    • COSBench (S3) Benchmark
    • MLPerf Storage Benchmark
  • Security
    • TLS Support
  • Reference
    • User CLI
    • Metrics
    • S3 API Usage
    • Third Party Licenses
  • Release Notes
Powered by GitBook
On this page
  • Overview
  • UFS Read Rate Limiter
  • Configuration
  1. Data Access

UFS Bandwidth Limiter

Overview

The rate limiter feature in Alluxio is designed to control the flow of requests and data to ensure system stability and optimize resource utilization. It helps in managing workloads by capping the amount of data processed.

UFS Read Rate Limiter

The UFS read rate limiter restricts the maximum bandwidth per second for UFS reads by a single worker. While peak bandwidth may occasionally exceed the limit, the average bandwidth will remain within the enforced boundaries. Currently the UFS which supports the read rate limiter includes HDFS, S3, OSS, COS, GCS.

Configuration

Add the following configuration in alluxio-site.properties:

# Enable ufs read rate limiter
# With this configuration, the bandwidth for reading UFS in the worker will be limited to 100MB per second
alluxio.worker.data.ufs.read.rate.limit.mb=100

Last updated 2 days ago