f-denkena/rclone
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
516 Commits 1 Branch 0 Tags
1cd0d9a1f27b9d21ad380699d6a86f2f9c297ab5
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick Craig-Wood 1cd0d9a1f2 Fix listing drive docs at root - fixes #336 
* Remove full drive list code
    * it is slower and uses more data
    * having two directory listing routines is causing problems (including this one)
    * less code is more
  * Make sure we don't recurse into directories we don't own
  * Fix export extension handling and add tests
 2016-02-15 16:46:43 +00:00
Nick Craig-Wood a6320bbad3 Fix delete command to wait until all finished - fixes missing deletes. 
This also could affect deletes at the end of the sync command.
 2016-02-15 16:43:59 +00:00
Nick Craig-Wood b1dd8e998b Yandex Disk: Use http.Client passed in for all operations - fixes logging. 2016-02-15 16:43:18 +00:00
Nick Craig-Wood 08a8f7174a Add Brian Stengaard to contributors 2016-02-09 21:45:51 +00:00
Nick Craig-Wood ce4c1d4f35 s3: Fix empty checks in auth 2016-02-09 17:19:33 +00:00
Nick Craig-Wood a0b9bd527e Add both forms of env var to the docs 2016-02-09 17:19:13 +00:00
Nick Craig-Wood 85d99de26b Fix typo in error strings 2016-02-09 16:15:50 +00:00
Nick Craig-Wood 4a82251c62 Add man page to repository too (missed from #256) 2016-02-07 20:26:10 +00:00
Nick Craig-Wood e62c0a58a7 Version 1.27 2016-01-31 17:50:13 +00:00
Nick Craig-Wood 1f3e48f18f Add manuals to repository - fixes #256 2016-01-31 16:34:30 +00:00
Nick Craig-Wood bbbe11790b Update docs to make syncing from a directory more obvious - fixes #302 2016-01-31 16:27:19 +00:00
Nick Craig-Wood 13edf62824 Document rclone return codes - fixes #308 2016-01-31 16:15:25 +00:00
Nick Craig-Wood 558bc2e132 drive: Export Google documents - fixes #49 
Rclone will download one format of a google doc. The choice of which
export format is controlled by the `--drive-formats` flag.
 2016-01-31 16:10:43 +00:00
Nick Craig-Wood 0f73129ab7 dedupe command to deduplicate a remote. Useful with google drive - fixes #41 2016-01-31 16:09:42 +00:00
Nick Craig-Wood 1373efaa39 Delete command which does obey the filters - fixes #327 2016-01-31 16:06:04 +00:00
Nick Craig-Wood 5c37b777fc Make the --dry-run warnings into logs so they appear without the -v flag 2016-01-31 16:06:04 +00:00
Nick Craig-Wood d4df3f2154 acd: Download files >= 9GB with their tempLink direct from s3 
This files the problem downloading files > 10GB.

Fixes #204 Fixes #313
 2016-01-30 18:08:44 +00:00
Nick Craig-Wood 8ae424c5a3 Emphasize testing sync with --dry-run and -v 2016-01-29 07:59:33 +00:00
Nick Craig-Wood cae19df058 s3: URL escape CopySource 
This fixes metadata update and copy for files with `+` in

Fixes #315
 2016-01-27 17:39:33 +00:00
Nick Craig-Wood 8c211fc8df Warn the user about files with same name but different case 
Relates to #107 & #119.
 2016-01-26 16:57:09 +00:00
Nick Craig-Wood 74a71f7824 Add tests for --delete-before, --delete-during and --delete-after 2016-01-26 16:57:09 +00:00
Nick Craig-Wood 12b51c5eb8 Remove duplicate check for filter IncludeObject 2016-01-26 16:57:09 +00:00
Nick Craig-Wood cd62f41606 Reduce number of logs and show hash type where appropriate 2016-01-24 18:06:57 +00:00
Nick Craig-Wood 109d4ee490 Prefix all test remotes with rclone-test- and make names more pronouncable 2016-01-24 12:37:46 +00:00
Nick Craig-Wood 18ebec8276 Check remote is empty between integration tests 2016-01-24 12:37:19 +00:00
Nick Craig-Wood c47b4f828f acd: Fix deadlock in directory traversal code 2016-01-24 11:20:55 +00:00
Nick Craig-Wood c3a0c0c451 swift: Fix upload from unprivileged user - fixes #273 2016-01-23 20:32:53 +00:00
Nick Craig-Wood 6cb0de43ce Deprecate compiling with go1.3 2016-01-23 17:27:00 +00:00
Nick Craig-Wood 83f0d3e03d acd: remove 409 conflict from error codes we will retry 
This should fix the very long pauses or getting stuck people have seen
in uploads.
 2016-01-23 17:02:09 +00:00
Nick Craig-Wood eda4130703 Fix integration tests so they can be run independently and out of order - fixes #291 
* Make all integration tests start with an empty remote
  * Add an -individual flag so this can be a different bucket/container/directory
  * Fix up tests after changing the hashers
  * Add sha1sum test
  * Make directory checking in tests sleep more to fix acd inconsistencies
  * Factor integration tests to make more maintainable
  * Ensure remote writes have a fstest.CheckItems() before use
    * this fixes eventual consistency on the directory listings later
  * Call fs.Stats.ResetCounters() before every fs.Sync()

Note that the tests shouldn't be run concurrently as fs.Config is global state.
 2016-01-23 17:02:09 +00:00
Nick Craig-Wood ccba859812 Test all available hashes for each remote 2016-01-23 09:10:36 +00:00
Nick Craig-Wood de3cf5e8d7 Add -verbose flag to unit tests and add some more eventual consistency retries 2016-01-20 20:06:05 +00:00
Nick Craig-Wood ce305321b6 amazon cloud drive: Fix "Next token is expired" - Fixes #289 Fixes #263 
This should also fix the consequent "409 Conflict" name already exists errors.
 2016-01-20 20:05:52 +00:00
Nick Craig-Wood e6117e978e Add Werner Beroux to contributors 2016-01-20 16:33:28 +00:00
Nick Craig-Wood ae3a0ec27e b2: Don't re-read the SHA1 if we already have it 2016-01-19 08:21:20 +00:00
Nick Craig-Wood d9458fb4ee b2: return error in Hash from readFileMetadata operation 2016-01-19 08:21:10 +00:00
Nick Craig-Wood 27f67edb1a Fix formatting problem in sha1sum 2016-01-17 13:56:42 +00:00
Nick Craig-Wood 3ffea738e6 Make hash constants start from 1 not 2 2016-01-17 10:47:24 +00:00
Nick Craig-Wood a63dd6020c onedrive: fix incorrectly decoded SHA-1 2016-01-17 10:46:36 +00:00
Nick Craig-Wood d0678bc3e5 local: report error on stat in Hash in case file disappeared 2016-01-17 10:46:19 +00:00
Nick Craig-Wood c337a367f3 Make make serve fail if make website would fail 2016-01-16 14:10:57 +00:00
Nick Craig-Wood e8daab7971 Fix integration tests for remotes with unsupported hash schemes 2016-01-16 09:45:15 +00:00
Nick Craig-Wood 2142c75846 Add missing docs for options - fixes #278 2016-01-10 12:04:20 +00:00
Nick Craig-Wood c724d8f614 dropbox: Make file exclusion error controllable with -q #287 2016-01-10 11:49:04 +00:00
Nick Craig-Wood af5f4ee724 Make --include rules add their implict exclude * at the end of the filter list 
This means you can mix `--include` and `--include-from` with the
other filters (eg `--exclude`) but you must include all the files you
want in the include statement.

Fixes #280
 2016-01-10 11:42:53 +00:00
Nick Craig-Wood 01aa4394a6 Explain that errored sync doesn't delete files - fixes #285 2016-01-10 10:44:33 +00:00
Nick Craig-Wood 2646519712 Add --memprofile flag 2016-01-09 15:25:48 +00:00
Nick Craig-Wood 5b2efd563a Add Xavier Lucas to contributors 2016-01-08 08:32:52 +00:00
Nick Craig-Wood ea2ef4443b Remove -verbose from errcheck 2016-01-08 08:20:04 +00:00
Nick Craig-Wood 5189231a34 Tweaks to rclone authorize 
* Document the headless / remote setup procedure
  * Move Config constants into fs
  * Parse arguments in main for Authorize
 2016-01-07 20:31:23 +00:00
Nick Craig-Wood c245183101 Stop errcheck running for go < 1.5 2016-01-07 16:37:51 +00:00
Nick Craig-Wood 3f5d8390ba Add Björn Harrtell to contributors 2016-01-05 17:05:31 +00:00
Nick Craig-Wood 1ce3673006 Add -clean flag to test_all.go to clean left over test directories 2016-01-03 21:49:26 +00:00
Nick Craig-Wood 3423de65fa Make canonical place for all fs in fs/all/all.go 2016-01-03 14:12:45 +00:00
Nick Craig-Wood 0c81439bc3 Fix upload_github target 2016-01-02 12:18:32 +00:00
Nick Craig-Wood 77fb8ac240 Version 1.26 2016-01-02 12:04:32 +00:00
Nick Craig-Wood 979dfb8cc6 Add Joseph Spurrier to contributors 2016-01-02 11:50:49 +00:00
Nick Craig-Wood 6a64567dd7 Add Dmitry Burdeev (dibu) to contributors 2016-01-02 11:45:30 +00:00
Nick Craig-Wood 8de8cd62ca yandex: stop create folder error being fatal 2015-12-30 21:07:42 +00:00
Nick Craig-Wood cba27d2920 yandex: correct precision to 1ns 2015-12-30 20:47:44 +00:00
Nick Craig-Wood 9ade179407 yandex: Fix socket leaks 2015-12-30 14:30:16 +00:00
Nick Craig-Wood 82b85431bd yandex: Make it use our http client so logging, bwlimit etc works properly 2015-12-30 14:30:16 +00:00
Nick Craig-Wood 98778b1870 Docs for Yandex 2015-12-30 14:30:16 +00:00
Nick Craig-Wood dfd46c23f9 Fix forgotten update for test_all.go 2015-12-30 12:12:24 +00:00
Nick Craig-Wood 8ea0d5212f Add -verbose flag to test_all and fix tries count 2015-12-30 11:34:22 +00:00
Nick Craig-Wood acd350d833 Add retry for eventual consistency in findObject test 2015-12-30 10:46:04 +00:00
Nick Craig-Wood 2f4b9f619d Add C. Bess to contributors 2015-12-30 10:13:11 +00:00
Nick Craig-Wood 33b3eea6ec Implement Backblaze B2 - fixes #224 2015-12-30 10:05:07 +00:00
Nick Craig-Wood 113624691a Add -dump-headers and -dump-bodies flags for operations test debugging 2015-12-30 09:35:35 +00:00
Nick Craig-Wood afaec1a2e9 Use test logger instead of log for test output 2015-12-30 09:35:25 +00:00
Nick Craig-Wood ddf39f2d57 Replace test_all.sh with test_all.go which is cross platform and parallel 2015-12-30 09:26:34 +00:00
Nick Craig-Wood 2df5d95d70 Documentation for --min-age and --max-age 2015-12-29 19:34:10 +00:00
Nick Craig-Wood 64a808ac76 Add CONTRIBUTING file 2015-12-29 19:23:20 +00:00
Nick Craig-Wood 05dc7183cb onedrive: Don't mask HTTP error codes with JSON decode error 2015-12-28 15:15:12 +00:00
Nick Craig-Wood e69e181090 Fix --min-age and --max-age when only one is present 2015-12-17 14:22:43 +00:00
Nick Craig-Wood a1269fa669 Make sure we use bash as our shell 2015-12-17 13:30:58 +00:00
Nick Craig-Wood 8369b5209f swift: Make sure we read the size for 0 length files - Fixes #237 
This was causing a problem with sync for chunked files.  The directory
listing would read their size back as 0 and see that the size had
changed and immediately resync it.
 2015-12-17 13:30:58 +00:00
Nick Craig-Wood 2aa3c0a2af make beta announces destination URL 2015-12-17 13:30:58 +00:00
Nick Craig-Wood ac65d8369e Make fs.CheckClose public to stop duplication 2015-12-17 13:30:58 +00:00
Nick Craig-Wood 7a24532224 Factor REST library out of onedrive 2015-12-17 13:30:58 +00:00
Nick Craig-Wood 8057d668bb Fix crash in http logging - fixes #223 
A nil-pointer exception was caused if the http transaction ever
resulted in a go error while using `--dump-bodies`.  Now don't ignore
the error and log it instead of the http body.
 2015-12-17 13:30:58 +00:00
Nick Craig-Wood 36f1bc4a8a Make ls/lsl/md5sum/size/check obey includes and excludes - fixes #169 
* run check directory listings concurrently
 2015-12-17 13:30:58 +00:00
Nick Craig-Wood beb8098b0a Ignore current builds when uploading to github 2015-12-17 13:28:12 +00:00
Nick Craig-Wood 6e64a71382 Add Adriano Aurélio Meirelles to contributors 2015-12-17 13:28:12 +00:00
Nick Craig-Wood 4f50b26af0 Add missing cloud storage systems 2015-11-23 22:19:50 +00:00
Nick Craig-Wood cb651b5866 Upload releases to github too - fixes #225 2015-11-23 22:18:21 +00:00
Nick Craig-Wood 3c1069c815 onedrive: re-enable server side copy 2015-11-22 11:04:16 +00:00
Nick Craig-Wood 7f0020a407 Version v1.25 2015-11-14 13:06:39 +00:00
Nick Craig-Wood c270c1c80c Increase retries for eventual consistency in tests 2015-11-14 12:57:17 +00:00
Nick Craig-Wood 29ecc2d8bb onedrive: disable server side copy as it seems to be broken 2015-11-14 12:11:38 +00:00
Nick Craig-Wood 13da1b8d28 Add docs for fs specific options - fixes #210 2015-11-14 11:38:35 +00:00
Nick Craig-Wood 0b338eaa28 Fix up sensitive vs insensitive in the docs and some formatting - fixes #214 2015-11-14 11:20:04 +00:00
Nick Craig-Wood 46696865fd Ignore golint errors that can't be fixed 
Stop duplicating checkers in .travis.yml - use Makefile as definitive source
 2015-11-14 10:08:52 +00:00
Nick Craig-Wood fcea3777c0 Implement Hubic storage system - fixes #200 2015-11-14 08:08:52 +00:00
Nick Craig-Wood 5023050d95 Add RedirectLocalhostURL for another form of redirect URL 2015-11-14 08:08:51 +00:00
Nick Craig-Wood bed01a303f Add UnWrapper interface and implement in LimitedFs 2015-11-14 08:08:51 +00:00
Nick Craig-Wood 2c2cb84ca7 Make it so optional interface Purge can fail so it can be wrapped 2015-11-14 08:08:51 +00:00
Nick Craig-Wood e9dda25c60 Implement Move in limited fs 2015-11-14 08:08:51 +00:00
Nick Craig-Wood 80ffbade22 Fix deletion of some excluded files without --delete-excluded #205 
This only happened if the destination file was present but the source
file was missing.
 2015-11-12 11:46:04 +00:00
Nick Craig-Wood 7beb50caa7 Remove go tip for the moment since it seems to be broken 2015-11-11 18:18:04 +00:00