f-denkena/rclone
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9,524 Commits 1 Branch 0 Tags
f0dfe9280c9aa1fc8a41981d1f51f1e26c128ce3
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick Craig-Wood f0dfe9280c b2: add server side copy real time accounting 2026-03-03 14:01:11 +00:00
Nick Craig-Wood b8d2ce8962 s3: add server side copy real time accounting 2026-03-03 14:01:11 +00:00
Nick Craig-Wood f60b09e7ab azureblob: add server side copy real time accounting 2026-03-03 14:01:11 +00:00
Nick Craig-Wood 307f1edaf4 operations: add method to real time account server side copy 
Before this change server side copies would show at 0% until they were
done then show at 100%.

With support from the backend, server side copies can now be accounted
in real time. This will only work for backends which have been
modified and themselves get feedback about how copies are going.

If the transfer fails, the bytes accounted will be reversed.
 2026-03-03 14:01:11 +00:00
Nick Craig-Wood a7a3bee488 Add Duncan F to contributors 2026-03-03 14:01:11 +00:00
Nick Craig-Wood 239dae97db Add razorloves to contributors 2026-03-03 14:01:11 +00:00
Nick Craig-Wood 056adc97d6 build: update to golang.org/x/net v0.51.0 to fix CVE-2026-27141 #9220 
See: https://pkg.go.dev/vuln/GO-2026-4559
 2026-02-27 11:24:16 +00:00
Nick Craig-Wood c2fd08192b Add Bjoern Franke to contributors 2026-02-27 11:22:12 +00:00
Nick Craig-Wood 9e0054983c Add Brian Bockelman to contributors 2026-02-27 11:22:12 +00:00
Nick Craig-Wood 7c336fdb6f Add Romāns Potašovs to contributors 2026-02-27 11:22:12 +00:00
Nick Craig-Wood 5d07f521dc Add Adam Kasztenny to contributors 2026-02-27 11:22:11 +00:00
Nick Craig-Wood 0d759d1280 Add hxnd to contributors 2026-02-27 11:22:11 +00:00
Nick Craig-Wood 93b1c50c14 Add Bjoern Franke to contributors 2026-02-27 11:22:11 +00:00
Nick Craig-Wood d6819d9d46 Add FTCHD to contributors 2026-02-27 11:22:11 +00:00
Nick Craig-Wood 9f9569ad6f docs: note that --use-server-modtime only works on some backends 
Closes #6977
 2026-02-26 12:00:56 +00:00
Nick Craig-Wood 80cdc4dd06 Add a1pcm to contributors 2026-02-26 12:00:56 +00:00
Nick Craig-Wood 216c9de2c4 Add Leon Brocard to contributors 2026-02-26 12:00:56 +00:00
Nick Craig-Wood 7952910e40 Add Dark Dragon to contributors 2026-02-26 12:00:56 +00:00
Nick Craig-Wood 699e4cfb23 docs: update sponsors 2026-02-23 13:05:33 +00:00
Nick Craig-Wood bc5cad8792 Add Jan-Philipp Reßler to contributors 2026-02-23 13:05:25 +00:00
Nick Craig-Wood 9024962fc4 Add Chris to contributors 2026-02-23 13:05:25 +00:00
Nick Craig-Wood aa1f4ace64 Add Shlomi Avihou to contributors 2026-02-23 13:05:25 +00:00
Nick Craig-Wood dd1d750c55 Add Jan-Philipp Reßler to contributors 2026-02-23 13:05:25 +00:00
Nick Craig-Wood 5a2564c6e2 Add Varun Chawla to contributors 2026-02-23 13:05:24 +00:00
Nick Craig-Wood 82cc80cc6f Add Prakhar Chhalotre to contributors 2026-02-23 13:05:24 +00:00
Nick Craig-Wood e06f0b0595 docs: add instructions on how to update Go version 2026-02-18 12:38:50 +00:00
Nick Craig-Wood b2866f0291 build: modernize Go code with go fix for go1.25 2026-02-18 12:11:52 +00:00
Nick Craig-Wood cf97f250df build: update all dependencies 
Could not update github.com/coreos/go-systemd as the new version doesn't build under freebsd

See: https://github.com/coreos/go-systemd/issues/509
 2026-02-18 11:33:48 +00:00
Nick Craig-Wood 627b763d4b lib/rest: remove go1.24 workaround now go1.25 is the minimum 2026-02-18 11:33:48 +00:00
Nick Craig-Wood f14945f9c1 build: update to go1.26 and make go1.25 the minimum required version 2026-02-18 11:33:48 +00:00
Nick Craig-Wood 391661fdb4 Add Jack Kelly to contributors 2026-02-18 11:33:48 +00:00
Nick Craig-Wood faffd0a6f1 Changelog updates from Version v1.73.1 2026-02-17 18:22:21 +00:00
Nick Craig-Wood 6cc3356f8e build: fix build using go 1.26.0 instead of go 1.25.7 
In the actions config use Go ~1.25.7 to pin the go version to 1.25.x,
x >= 7.

Before this it was choosing Go 1.26.0 which isn't what we want.
 2026-02-17 17:05:45 +00:00
Nick Craig-Wood 07e76419c9 fs/march: fix runtime: program exceeds 10000-thread limit 
Before this change when doing a sync with `--no-traverse` and
`--files-from` we could call `NewObject` a total of `--checkers` *
`--checkers` times simultaneously.

With `--checkers 128` this can exceed the 10,000 thread limit and
fails when run on a local to local transfer because `NewObject` calls
`lstat` which is a syscall which needs an OS thread of its own.

This patch uses a weighted semaphore to limit the number of
simultaneous calls to `NewObject` to `--checkers` instead which won't
blow the 10,000 thread limit and is far more sensible use of OS
resources.

Fixes #9073
 2026-02-17 12:27:17 +00:00
Nick Craig-Wood 60c4f35b56 accounting: fix missing server side stats from core/stats rc 
These stats weren't being updated in the global stats read by rc
core/stats:

- transferQueue
- deletesSize
- serverSideCopies
- serverSideCopyBytes
- serverSideMoves
- serverSideMoveBytes
 2026-02-17 12:27:17 +00:00
Nick Craig-Wood 15a9c0fd36 pacer: re-read the sleep time as it may be stale 
Before this change we read sleepTime before acquiring the pacer token
and uses that possibly stale value to schedule the token return. When
many goroutines enter while sleepTime is high (e.g., 10s), each
goroutine caches this 10s value. Even if successful calls rapidly
decay the pacer state to 0, the queued goroutines still schedule 10s
token returns, so the queue drains at 1 req/10s for the entire herd.
This can create multi‑minute delays even after the pacer has dropped
to 0.

After this change we refresh the sleep time after getting the token.

This problem was introduced by the desire to skip reading the pacer
token entirely when sleepTime is 0 in high performance backends (eg
s3, azure blob).
 2026-02-17 12:27:17 +00:00
Nick Craig-Wood 8b85ffbf03 pacer: fix deadlock between pacer token and --max-connections 
It was possible in the presence of --max-connections and recursive
calls to the pacer to deadlock it leaving all connections waiting on
either a max connection token or a pacer token.

This fixes the problem by making sure we return the pacer token on
schedule if we take it.

This also short circuits the pacer token if sleepTime is 0.
 2026-02-17 12:27:17 +00:00
Nick Craig-Wood 26fb659fe4 test_all: increase retries for Internxt eventual consistency 2026-02-17 12:27:17 +00:00
Nick Craig-Wood 7aa3d8a32f build: fix CVE-2025-68121 by updating go to 1.25.7 or later - fixes #9167 2026-02-17 12:27:17 +00:00
Nick Craig-Wood b7ebec865b drime: fix files and directories being created in the default workspace 
Before this change directories and files were created in the default
workspace, not the workspace specified by --drime-workspace-id.
 2026-02-17 12:27:17 +00:00
Nick Craig-Wood a60d09c43d docs: update sponsors 2026-02-17 12:27:04 +00:00
Nick Craig-Wood 14a47937c0 Add kingston125 to contributors 2026-02-17 12:22:11 +00:00
Nick Craig-Wood 4b3aa5aea0 docs: add ExchangeRate-API as a sponsor 2026-02-12 14:08:20 +00:00
Nick Craig-Wood 349487bb7f Add Cohinem to contributors 2026-02-12 14:08:20 +00:00
Nick Craig-Wood b70b2fff16 Add Leon Brocard to contributors 2026-02-12 14:08:20 +00:00
Nick Craig-Wood 673e24a60f docs: update sponsor logos 2026-02-05 12:27:51 +00:00
Nick Craig-Wood 9abf9d38c0 Start v1.74.0-DEV development 2026-01-30 22:19:04 +00:00
Nick Craig-Wood f42aa5a586 Version v1.73.0 2026-01-30 20:53:56 +00:00
Nick Craig-Wood 40f2e847a3 drive: fix crash when trying to creating shortcut to a Google doc 
Before this change, we uses an unguarded type assertion which failed
when NewObject returned a google document instead of an Object.

This change uses the ID() method to read the id which works for all
types of file instead and returns a sensible error if one isn't found.

Fixes #8990
 2026-01-30 18:17:56 +00:00
Nick Craig-Wood 846f193806 azureblob,azurefiles: factor the common auth into a library 2026-01-30 17:50:18 +00:00
Nick Craig-Wood 116d0f3708 test: allow backends to return fs.ErrorCantListRoot to skip Root tests 2026-01-30 17:50:18 +00:00
Nick Craig-Wood 140ec62683 build: add privatebeta Makefile target 2026-01-30 17:50:18 +00:00
Nick Craig-Wood 8c746f36dd docs: add Internxt as a sponsor 2026-01-30 17:38:13 +00:00
Nick Craig-Wood fac7ba4bd0 internxt: remove use of CVE laden github.com/disintegration/imaging 2026-01-30 17:28:52 +00:00
Nick Craig-Wood e3be333c29 docs: fix Internxt docs after merge 2026-01-30 17:08:44 +00:00
Nick Craig-Wood 67013ccf35 docs: update making a new backend docs 2026-01-30 17:08:44 +00:00
Nick Craig-Wood a1522468db docs: build overview page from the backend data 2026-01-30 17:08:44 +00:00
Nick Craig-Wood 58f30ab538 docs: add tiering to the documentation - fixes #8873 2026-01-30 17:08:44 +00:00
Nick Craig-Wood 7539b2c5e1 docs: add data about each backend in YAML format 2026-01-30 17:08:44 +00:00
Nick Craig-Wood 6d39c63983 docs: add bin/manage_backends.py for managing the backend data files 2026-01-30 16:54:28 +00:00
Nick Craig-Wood 1bf73d862a internxt: use rclone's http.Client to enable more features 
e.g. --bwlimit, HTTP proxies, connection timeouts, --dump headers/bodies etc
 2026-01-30 16:33:03 +00:00
Nick Craig-Wood e2a079d73f internxt: fix lint problems 2026-01-30 16:06:32 +00:00
Nick Craig-Wood 7d7f82854f Add StarHack to contributors 2026-01-30 16:06:32 +00:00
Nick Craig-Wood b6113a505f Add lullius to contributors 2026-01-30 16:06:32 +00:00
Nick Craig-Wood 2a754ef2fa Add jzunigax2 to contributors 2026-01-30 16:06:32 +00:00
Nick Craig-Wood 49b4ca3412 drive: add --drive-metadata-force-expansive-access flag - Fixes #8980 
This allows the permissions changes happening in Feb 2026 to be tested
in advance.
 2026-01-30 12:38:59 +00:00
Nick Craig-Wood 315a148820 test_all: allow drime more time to complete 2026-01-30 11:51:56 +00:00
Nick Craig-Wood b873f838db onedrive: fix permissions on onedrive Personal 2026-01-29 21:31:51 +00:00
Nick Craig-Wood 1d6f86900b onedrive: fix require sign in for Onedrive Personal 
require_sign_in and regain_inherited_permissions in Onedrive Personal
have been brought into line with Onedrive Business.
 2026-01-29 21:31:51 +00:00
Nick Craig-Wood 8a31921fb0 onedrive: Onedrive Personal no longer supports description 
Uploading files with description set is no longer allowed with
Onedrive personal. This brings it into line with Onedrive business.
 2026-01-29 21:31:51 +00:00
Nick Craig-Wood c64161822d onedrive: fix setting modification time on directories for onedrive Personal 
Onedrive Personal started ignoring the time parameters given to create
directory in the same way as onedrive Business.
 2026-01-29 21:31:51 +00:00
Nick Craig-Wood d660960775 onedrive: fix cancelling multipart upload 
Before this change it was giving back "401 Unauthorized" however
removing the "Authorization: XXXX" from the request fixes the problem
as the auth is in the URL already.
 2026-01-29 21:31:51 +00:00
Nick Craig-Wood cc9abcad06 cmount: make work under OpenBSD - fixes #1727 2026-01-29 10:24:33 +00:00
Nick Craig-Wood 5c4af237e4 vfs: make mount tests run on OpenBSD 2026-01-29 10:24:33 +00:00
Nick Craig-Wood 824257583c protondrive: update to use forks of upstream modules 
This updates rclone to use forks of the upstream proton drive modules
in preparation for making changes.

The go-proton-api modules has had changes from master merged so rclone
and Proton-API-Bridge are using the same version.
 2026-01-28 11:38:38 +00:00
Nick Craig-Wood cd857754c7 Add hyusap to contributors 2026-01-28 11:38:31 +00:00
Nick Craig-Wood 017d930dfc Add Nick Owens to contributors 2026-01-28 11:38:31 +00:00
Nick Craig-Wood 6ed68883fe Add Mikel Olasagasti Uranga to contributors 2026-01-28 11:38:31 +00:00
Nick Craig-Wood 6b9f77459a docs: fix formatting 2026-01-23 16:55:52 +00:00
Nick Craig-Wood 4b2c39c585 docs: add faq entry about re-enabling old TLS ciphers 2026-01-23 15:40:06 +00:00
Nick Craig-Wood dbf2499d85 Add Marc-Philip to contributors 2026-01-23 15:40:06 +00:00
Nick Craig-Wood 760a134c95 Add yy to contributors 2026-01-23 15:40:06 +00:00
Nick Craig-Wood 9ec918f137 docs: fix use of removed rem macro 2026-01-14 18:37:19 +00:00
Nick Craig-Wood 3a9c7ceeb1 uptobox: remove backend as service is no longer available 
Uptobox was shutdown in September 2023 and does not appear to be
returning.
 2026-01-14 15:31:46 +00:00
Nick Craig-Wood 5502c0f8ae rc: add operations/hashsumfile to sum a single file only 2026-01-14 12:29:48 +00:00
Nick Craig-Wood d707ae7cf4 docs: update sponsor link 2026-01-14 12:29:48 +00:00
Nick Craig-Wood 933bbf3ac8 sftp: fix proxy initialisation 
This was being done in NewFs instead of NewFsWithConnection like it
should have been which meant calls to NewFsWithConnection were not
initialising the proxy correctly.
 2026-01-13 12:40:17 +00:00
Nick Craig-Wood ecc5972d6f fstest: skip Copy mutation test with --sftp-copy-is-hardlink 2026-01-13 12:40:17 +00:00
Nick Craig-Wood 07805796ab fstest: Make Copy mutation test work properly 
Before this change it could miss a mutation if the Modtime was cached
 2026-01-13 12:40:17 +00:00
Nick Craig-Wood 189e6dbf6a Add Qingwei Li to contributors 2026-01-13 12:40:12 +00:00
Nick Craig-Wood d47e289165 Add Nicolas Dessart to contributors 2026-01-13 12:40:12 +00:00
Nick Craig-Wood d9895fef9d lib/rest: add opts.MultipartContentType to explicitly set Content-Type of attachements 
Before this the standard library set it to application/octet-stream for some reason
 2026-01-08 12:05:37 +00:00
Nick Craig-Wood f814498561 docs: update sponsors 2026-01-08 12:05:30 +00:00
Nick Craig-Wood 28c187b9b4 docs: update sponsor logos 2025-12-31 17:04:11 +00:00
Nick Craig-Wood e07afc4645 Add sys6101 to contributors 2025-12-31 17:04:11 +00:00
Nick Craig-Wood 08932ab92a Add darkdragon-001 to contributors 2025-12-31 17:04:11 +00:00
Nick Craig-Wood 356ee57edb Add vupn0712 to contributors 2025-12-31 17:04:11 +00:00
Nick Craig-Wood f81cd7d279 serve s3: make errors in --s3-auth-key fatal - fixes #9044 
Previously if auth keys were provided without a comma then rclone
would only log an INFO message which could mean it went on to serve
without any auth.

The parsing for environment variables was changed in v1.70.0 to make
them work properly with multiple inputs. This means the input is
treated like a mini CSV file which works well except in this case when
the input has commas. This meant `user,auth` without quotes is treated
as two key pairs `user` and `quote`. The correct syntax is
`"user,auth"`. This updates the documentation accordingly.
 2025-12-18 10:17:41 +00:00
Nick Craig-Wood 1a0a4628d7 Add masrlinu to contributors 2025-12-18 10:17:41 +00:00
Nick Craig-Wood 3a6e07a613 memory: add --memory-discard flag for speed testing - fixes #9037 2025-12-17 10:21:12 +00:00