Pure Storage FlashBlade is an enterprise object storage platform that
provides S3-compatible APIs. This change adds FlashBlade as a new
provider option in the S3 backend.
Before this change, FlashBlade users had to use the "Other" provider
with manual configuration of various compatibility flags. This often
resulted in suboptimal performance due to conservative default settings.
After this change, users can select the "FlashBlade" S3 provider and
get an optimal configuration:
- ListObjectsV2 enabled for better performance
- AWS-compatible multipart ETags for reliable transfers
- Proper handling of "AlreadyOwnedByYou" bucket creation responses
- Path-style URLs by default (virtual-host style with DNS setup)
- Unsigned payloads to ensure compatibility with all rclone features
FlashBlade supports modern S3 features including trailer checksum
algorithms (SHA256, CRC32, CRC32C), object versioning, and lifecycle
management.
Provider settings were verified by testing against a FlashBlade//E
system running Purity//FB 4.5.7.
Documentation and test configurations are included.
Integration test results:
```
go test -v -fast-list -remote TestS3FlashBlade:
PASS
ok github.com/rclone/rclone/backend/s3 232.444s
```
- use rclone's http Transport
- fix handling of 0 length files
- combine into one file and remove uneeded abstraction
- make `chunk_size` and `upload_concurrency` settable
- make auth the same as azureblob
- set the Features correctly
- implement `--azurefiles-max-stream-size`
- remove arbitrary sleep on Mkdir
- implement `--header-upload`
- implement read and write MimeType for objects
- implement optional methods
- About
- Copy
- DirMove
- Move
- OpenWriterAt
- PutStream
- finish documentation
- disable build on plan9 and js
Fixes#365Fixes#7378
This provider:
- supports the `X-OC-Mtime` header to set the mtime
- calculates SHA1 checksum server side and returns it as a `ME:sha1hex` prop
To differentiate the new hasMESHA1 quirk, the existing hasMD5 and hasSHA1
quirks for Owncloud have been renamed to hasOCMD5 and hasOCSHA1.
Fixes#6837
dougalandNick Craig-Wood
Robin RolfandNick Craig-Wood
albertony
$@M@RTH_andGitHub
kingston125andGitHub
Jeremy DaerandGitHub
yuval-cloudinaryandNick Craig-Wood
lostb1tandNick Craig-Wood
Sam HarrisonandNick Craig-Wood
FornaxandGitHub
Bruno FernandesandGitHub
iotmaestroandGitHub
nielash
Harshit BudhrajaandNick Craig-Wood
viktorandNick Craig-Wood
BenjaminandNick Craig-Wood
BakaWangandGitHub
mac-15andNick Craig-Wood
Ehsan TadayonandNick Craig-Wood
Andrei SmirnovandGitHub
wiserainandGitHub
ArnavionandNick Craig-Wood
MohammadRezaandGitHub
Manoj GhoshandNick Craig-Wood
Bachue ZhouandGitHub
Marco MolteniandNick Craig-Wood
LesmiscoreandGitHub
Dmitry DeniskinandGitHub
Ovidiu Victor TatarandNick Craig-Wood
AnthrazzandNick Craig-Wood
vyloyandNick Craig-Wood