f-denkena/rclone
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
965 Commits 1 Branch 0 Tags
3b0f944e23460affaa6f8b13594673953add0db7
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick Craig-Wood aaeab58ce6 Add Lukas Loesche to contributors 2017-01-03 20:49:04 +00:00
Nick Craig-Wood f1221b510b Change --track-renames to use the length,hash pair stored in a map 
This makes it much faster in the case of many files and use less
memory.

This also detects use of --no-traverse and disables it.
 2017-01-03 20:37:06 +00:00
Nick Craig-Wood 274ab349f4 sync: Only allow --track-renames if have a common hash 2017-01-03 20:35:05 +00:00
Nick Craig-Wood 86392fb800 Add Bjørn Erik Pedersen to contributors 2017-01-03 20:35:05 +00:00
Nick Craig-Wood 5c89fd679d Fix incorrect vendoring for swift library 
(vendored a feature branch by accident)
 2017-01-03 17:39:56 +00:00
Nick Craig-Wood 1cad759306 Update vendor directory 2017-01-02 16:12:05 +00:00
Nick Craig-Wood 5b8b379feb Version v1.35 2017-01-02 15:33:06 +00:00
Nick Craig-Wood f538fd8eb4 Update RELEASE procedure 2017-01-02 14:38:14 +00:00
Nick Craig-Wood 4dd5428b13 Fix rmdirs test and integration tests which depend on each other 2017-01-02 14:15:07 +00:00
Nick Craig-Wood 64ec220d5d Fix --no-update-modtime test on remotes which don't support hashes 2016-12-31 15:19:26 +00:00
Nick Craig-Wood cbfec0d281 Fix tests for missing config file 2016-12-20 15:05:08 +00:00
Nick Craig-Wood 80c044f2d3 Stop overwriting global remote in tests 2016-12-20 14:15:11 +00:00
Nick Craig-Wood 1b2dda8c4c oauthutil: Reload config file off disk before updating token 
This fixes the config file being overwritten when two rclones are running.

Fixes #682
 2016-12-19 15:04:07 +00:00
Nick Craig-Wood 473bdad00b crypt: Prevent the user pointing crypt at itself - fixes #927 
This would hopefully have stopped the issues reported in #784 & #929
 2016-12-19 14:09:59 +00:00
Nick Craig-Wood 4482e75f38 Fix golint 2016-12-15 21:02:41 +00:00
Nick Craig-Wood 43c530922a Restore ability for any command to show stats by adding --stats flag 
Make default for `mount` command not to show stats - this can be
re-enabled by adding a `--stats` parameter.
 2016-12-15 17:40:17 +00:00
Nick Craig-Wood dd60f088ed mount: retry reads on error #873 2016-12-15 17:16:55 +00:00
Nick Craig-Wood 0117aeafbf mount: this removes the async buffering as it was killing seek performance 2016-12-15 17:08:52 +00:00
Nick Craig-Wood 442861581a Update release process - fixes #855 2016-12-14 17:49:26 +00:00
Nick Craig-Wood 4e809c951d acd: Note that Move and DirMove are now supported - fixes #122 2016-12-14 17:45:20 +00:00
Nick Craig-Wood 215fd2a11d b2: use new prefix and delimiter parameters in directory listings 
This makes --max-depth 1 directory listings much more efficient (it no
longer lists all the files) and simplifies the code, bringing it into
line with s3/swift/gcs

Fixes #944
 2016-12-14 17:37:26 +00:00
Nick Craig-Wood 13b705e227 mount: report the modification times for directories from the remote #940 #950 
This stops the modification times for directories just being the
current time and reads them from the remote instead.  This doesn't
take any extra transactions.
 2016-12-14 15:26:04 +00:00
Nick Craig-Wood 8083804575 Make sure wrapped retry/fatal errors are never nil to avoid panic 2016-12-13 16:02:14 +00:00
Nick Craig-Wood ec0916c59d crypt: return unexpected EOF instead of Failed to authenticate decrypted block #873 
Streams which truncated early with an EOF message would return a
"Failed to authenticate decrypted block" error.  While technically
correct, this isn't a helpful error message as it masks the underlying
problem.  This changes it to return "unexpected EOF" instead.

The rest of rclone knows it should retry such errors.
 2016-12-12 15:20:40 +00:00
Nick Craig-Wood 7392cd1a1a Add section on how to set RCLONE_CONFIG_PASS from a script 2016-12-12 12:33:43 +00:00
Nick Craig-Wood 2656a0e070 Update go to 1.7.4 and 1.6.4 in CI 2016-12-09 17:12:11 +00:00
Nick Craig-Wood 5b5df9ae8e acd: fix the corner cases in Move and DirMove and refactor 2016-12-09 16:57:07 +00:00
Nick Craig-Wood fafbcc8e2f Make server side move more obvious in debug 2016-12-09 16:57:07 +00:00
Nick Craig-Wood c55402caa2 drive: create destination directory on Move() 2016-12-09 16:57:07 +00:00
Nick Craig-Wood d132dc7640 drive: make DirMove more efficient and complain about moving the root 2016-12-09 16:57:07 +00:00
Nick Craig-Wood 48a2e3844d Add optional interface DirCacheFlush for making the tests more reliable 
This is defined for the users of dircache drive, onedrive, and acd.

This helps fix the DirMove tests on acd.
 2016-12-09 16:57:07 +00:00
Nick Craig-Wood d911bf3889 Add links to the forum in the main pages 2016-12-08 10:42:42 +00:00
Nick Craig-Wood dcf53a1d12 Allows multiple --include/--exclude/--filter options - fixes #875 2016-12-07 13:37:40 +00:00
Nick Craig-Wood 3bdfa284a9 Make rclone lsd obey the filters properly 2016-12-07 11:16:36 +00:00
Nick Craig-Wood cb9f1eefd2 crypt: fix Mkdir/Rmdir with a dir parameter - fixes rmdirs command 2016-12-06 15:14:41 +00:00
Nick Craig-Wood dd99a4b3dc Update golang.org/x/sys to enable mips compile #849 2016-12-06 15:12:29 +00:00
Nick Craig-Wood e79a5de7df local: fix Mkdir/Rmdir with a dir on Windows 2016-12-05 18:09:45 +00:00
Nick Craig-Wood c24da0b886 fuse: add stats printing and note which files are transferring 2016-12-04 16:59:46 +00:00
Nick Craig-Wood be4fd51289 fuse: Add bandwidth accounting and buffering 
This fixes rclone mount ignoring bwlimit and increases buffering which
should speed up transfers greatly.

Fixes #796
Fixes #690
 2016-12-04 16:57:47 +00:00
Nick Craig-Wood 2cbdb95ce5 Only show transfer stats on commands which transfer stuff - fixes #849 2016-12-04 16:52:24 +00:00
Nick Craig-Wood 716ce49ce9 Patch vendored version of stretchr to use latest go-spew 2016-12-04 16:28:27 +00:00
Nick Craig-Wood 34b9ac8a5d Update vendor directory 2016-12-04 16:25:30 +00:00
Nick Craig-Wood c265f451f2 Implement moveto and copyto commands for choosing a destination name on copy/move 
Fixes #227
Fixes #476
 2016-12-03 23:43:52 +00:00
Nick Craig-Wood 2058652fa4 Allow overlapping remotes in move when DirMove is supported 2016-12-03 09:08:40 +00:00
Nick Craig-Wood 50b3cfccb1 Factor Move out of sync.go and add remote parameter to Move and Copy 2016-12-03 09:08:40 +00:00
Nick Craig-Wood 5e35aeca9e Regularize the command definition names 2016-12-03 09:08:40 +00:00
Nick Craig-Wood 05798672c8 acd: Fix nil pointer deref - fixes #916 2016-11-30 21:05:35 +00:00
Nick Craig-Wood 7929b6e756 fuse: support R/W files only if truncate is set. 
Any reads on the file handle will return an error.  This is to support
windows/samba writes.
 2016-11-28 17:56:54 +00:00
Nick Craig-Wood 2756900749 Fix not transferring files that don't differ in size - fixes #911 
Due to a logic error files stored on remotes which support modtime but
not hashes weren't being transferred when updating with a file of the
same size but different modtime.  Instead the modtime of the remote
file was being set to that of the local file.

In practice this affected crypt with all remotes except Amazon Drive
and Dropbox.
 2016-11-28 17:08:15 +00:00
Nick Craig-Wood 539853df36 Fix rmdirs test 2016-11-28 12:23:24 +00:00
Nick Craig-Wood 651db36674 Add Scott McGillivray to authors 2016-11-28 12:18:30 +00:00
Nick Craig-Wood 7f41c9a015 Add Thibault Molleman to contributors 2016-11-27 18:54:24 +00:00
Nick Craig-Wood 943a0938e7 Add 0xJAKE to contributors 2016-11-27 18:42:11 +00:00
Nick Craig-Wood 8aae166a5b Add missing rmdirs command 2016-11-27 18:36:13 +00:00
Nick Craig-Wood aaad0354e6 Clarify match rules in filter docs 2016-11-27 12:10:52 +00:00
Nick Craig-Wood f3365dd251 Make rclone rmdirs command to delete empty directories - fixes #831 2016-11-27 11:49:31 +00:00
Nick Craig-Wood aaa1370a36 Add directory parameter to Rmdir and Mkdir #100 #831 
This will enable rclone to manage directories properly in the future.
 2016-11-26 12:02:53 +00:00
Nick Craig-Wood c41b67ea08 mount: Implement statfs interface so df works - fixes #894 
The data returned is not related to the files on the remote, but
apparently samba needs it.
 2016-11-20 22:54:03 +00:00
Nick Craig-Wood 0b562bcabc mount: Note that write is now supported on ACD 2016-11-19 10:54:37 +00:00
Nick Craig-Wood 8b82cc7073 Patch vendored version of stretchr to use latest go-spew 2016-11-19 10:35:00 +00:00
Nick Craig-Wood e19b30bd26 Add test dependencies back to vendor directory 2016-11-19 10:22:36 +00:00
Nick Craig-Wood 09897c8d0d Save test dependencies too on make update 2016-11-19 10:22:23 +00:00
Nick Craig-Wood d4ddbcea96 Notes on the vendor directory 2016-11-19 10:09:50 +00:00
Nick Craig-Wood 00af021abb Update vendor dependencies 2016-11-19 10:05:20 +00:00
Nick Craig-Wood 8118623680 Rebuild the godeps from scratch on update and include godep as a build_dep 2016-11-19 10:05:20 +00:00
Nick Craig-Wood 2c594dd996 acd: fix docs for --max-size 2016-11-17 17:30:49 +00:00
Nick Craig-Wood d8b7156b5c Add Alishan Ladhani to contributors 2016-11-15 16:22:40 +00:00
Nick Craig-Wood 3ce82facac Add Stefan Breunig to contributors 2016-11-11 18:06:27 +00:00
Nick Craig-Wood 4105da206a b2: reauth the account while doing uploads too #825 
Originally it was thought the upload URL expiring would provide 401
errors so it was excluded from reauth when doing uploads, but on
re-reading the docs and looking at this issue it seems that 401 errors
are only caused by the account token expiring and not the upload token
expiring.

We will refresh both the upload token and account token on a 401 error
while uploading, and just the account token when we get a 401 at any
other time.
 2016-11-07 13:30:51 +00:00
Nick Craig-Wood 34e7ca90fc Update go-acd vendor to fix error message - fixes #860 2016-11-07 10:20:26 +00:00
Nick Craig-Wood 687abe7803 Fix godep update 2016-11-06 14:50:52 +00:00
Nick Craig-Wood 9b1820a7ad Update go-acd dependency 2016-11-06 14:26:12 +00:00
Nick Craig-Wood 5f320cc540 Add missing vendor files 2016-11-06 10:40:40 +00:00
Nick Craig-Wood 23b8f008e0 Add missing docs changes 2016-11-06 10:40:11 +00:00
Nick Craig-Wood d95288175f Version v1.34 2016-11-06 10:18:30 +00:00
Nick Craig-Wood b83f7ac06b Update dependencies pre release 2016-11-05 18:35:34 +00:00
Nick Craig-Wood f7af730b50 Use a vendor directory for repeatable builds - fixes #816 
This is using godep to manage the vendor directory.
 2016-11-05 18:18:08 +00:00
Nick Craig-Wood 01be5bff02 Fix ogier/pflag vs spf13/pflag 2016-11-05 18:18:08 +00:00
Nick Craig-Wood e825df6448 Fix Check on crypted file systems 2016-11-05 18:17:21 +00:00
Nick Craig-Wood ff41b0d435 Improve error message when source remote isn't found in sync #848 2016-11-05 18:03:55 +00:00
Nick Craig-Wood e162377ca3 acd: Simplify the wait options into a single --acd-upload-wait-per-gb - fixes #262 
This means the feature can be disabled by setting the time to 0.

This also logs the HTTP status for analysis purposes.

Thanks Felix Bünemann for extensive testing and data collection.
 2016-11-05 13:57:03 +00:00
Nick Craig-Wood d1080d5456 crypt: fix panic on close after failed seek 2016-11-05 10:01:33 +00:00
Nick Craig-Wood 64b5a76bec mount: detect and deal with seeking beyond end of file - fixes #828 2016-11-05 09:59:36 +00:00
Nick Craig-Wood 7cfb1bdc70 fuse: tests: create the directory before starting tests 2016-11-05 09:57:45 +00:00
Nick Craig-Wood 441951a93b Stop removing failed upload to cloud storage remotes - fixes #559 
We do remove a partially written file on local so we don't have
corrupted files lying around.
 2016-11-04 21:34:25 +00:00
Nick Craig-Wood 154e91bb23 crypt: Fix data corruption caused by seeking - #828 
The corruption was caused when the file was read to the end thus
setting io.EOF and returning the buffers to the pool.  Seek reset the
EOF and carried on using the buffers that had been returned to the
pool thus causing corruption when other goroutines claimed the buffers
simultaneously.

Fix by resetting the buffer pointers to nil when released and claiming
new ones when seek resets EOF.  Also added locking for Read and Seek
which shouldn't be run concurrently.
 2016-11-03 22:55:05 +00:00
Nick Craig-Wood cb40511807 s3: Allow command line to override acl (Thanks Radek Senfeld) 2016-11-03 21:05:30 +00:00
Nick Craig-Wood 452c68115f acd: Add 502 Bad Gateway to list of errors we retry 2016-11-03 18:56:21 +00:00
Nick Craig-Wood b35123ba48 Make -x/--one-file-system compile under Windows and add docs 2016-11-03 11:53:49 +00:00
Nick Craig-Wood 978e06a623 Add Durval Menezes to contributors 2016-11-03 11:53:49 +00:00
Nick Craig-Wood 2302179237 acd: Fix overwriting a file with a zero length file 2016-11-02 16:39:55 +00:00
Nick Craig-Wood 318e335137 Remove Authorization: headers from --dump-headers output 
Add in `--dump-auth` flag to put it back.
 2016-11-02 15:53:43 +00:00
Nick Craig-Wood 11301a64fb Add Felix Bünemann to contributors 2016-11-02 13:18:26 +00:00
Nick Craig-Wood d1759fdfa9 Add request ID to HTTP debugging to make it easier to trace concurrent flows 2016-10-31 12:01:28 +00:00
Nick Craig-Wood c102bf28e3 Add Marco Paganini to contributors 2016-10-31 12:01:03 +00:00
Nick Craig-Wood e65059e431 Fix non-windows/non-unix builds for bwlimit/SIGUSR2 feature and add a mutex 
The race detector complained whenever SIGUSR2 was sent to rclone so
this adds a mutex to prevent concurrent access.
 2016-10-30 19:20:16 +00:00
Nick Craig-Wood 5454f2abd0 Fix race in checkServerTime 2016-10-30 19:16:27 +00:00
Nick Craig-Wood 062616e4dd mount: update code comments 2016-10-30 17:46:00 +00:00
Nick Craig-Wood 6846a1cc11 Add Tomasz Mazur to contributors 2016-10-27 12:14:33 +01:00
Nick Craig-Wood 87107413f5 fuse: add missing locking on filehandle read #823 #802 2016-10-27 09:57:52 +01:00