WEB
Last updated
Last updated
This guide describes the instructions to configure WEB as Alluxio's under storage system.
The Alluxio binaries must be on your machine. You can either , or .
Alluxio unifies access to different storage systems through the feature. An WEB location can be either mounted at the root of the Alluxio namespace or at a nested directory.
Configure Alluxio to use under storage systems by modifying conf/alluxio-site.properties
. If it does not exist, create the configuration file from the template.
the following environment variable assignment needs to be added to conf/alluxio-site.properties
, and we actually support both http:// and https:// protocols.
Specify the settings for parsing a WEB page(Optional):
Here, alluxio.underfs.web.connnection.timeout
is the timeout setting for an http connection (unit: second, default: 60s). alluxio.underfs.web.header.last.modified
represents the format to parse the last modified field for a directory or a file from an http response header (default: "EEE, dd MMM yyyy HH:mm:ss zzz"). alluxio.underfs.web.parent.names
indicates the start row index of the files list, which can be set as multiple flags separated by commas (default: "Parent Directory,..,../"). alluxio.underfs.web.titles
is a flag that can be used to check if a web page is a directory. It can also be set with multiple values separated by commas (default: "Index of ,Directory listing for ").
Run the following command to start Alluxio filesystem.
Visit your WEB volume by running the following command:
After waiting for a while, you can see the following result:
Stop Alluxio by running:
An WEB location can be mounted at a nested directory in the Alluxio namespace to have unified access to multiple under storage systems. Alluxio's can be used for this purpose. For example, the following command mounts a directory inside an WEB directory into Alluxio directory /web
:
To verify that Alluxio is running, you can visit , or see the log in the logs
folder.