Nick Craig-Wood
05dc7183cb
onedrive: Don't mask HTTP error codes with JSON decode error
2015-12-28 15:15:12 +00:00
Nick Craig-Wood
e69e181090
Fix --min-age and --max-age when only one is present
2015-12-17 14:22:43 +00:00
Nick Craig-Wood
a1269fa669
Make sure we use bash as our shell
2015-12-17 13:30:58 +00:00
Nick Craig-Wood
8369b5209f
swift: Make sure we read the size for 0 length files - Fixes #237
...
This was causing a problem with sync for chunked files. The directory
listing would read their size back as 0 and see that the size had
changed and immediately resync it.
2015-12-17 13:30:58 +00:00
Nick Craig-Wood
2aa3c0a2af
make beta announces destination URL
2015-12-17 13:30:58 +00:00
Nick Craig-Wood
ac65d8369e
Make fs.CheckClose public to stop duplication
2015-12-17 13:30:58 +00:00
Nick Craig-Wood
7a24532224
Factor REST library out of onedrive
2015-12-17 13:30:58 +00:00
Nick Craig-Wood
8057d668bb
Fix crash in http logging - fixes #223
...
A nil-pointer exception was caused if the http transaction ever
resulted in a go error while using `--dump-bodies`. Now don't ignore
the error and log it instead of the http body.
2015-12-17 13:30:58 +00:00
Nick Craig-Wood
36f1bc4a8a
Make ls/lsl/md5sum/size/check obey includes and excludes - fixes #169
...
* run check directory listings concurrently
2015-12-17 13:30:58 +00:00
Nick Craig-Wood
beb8098b0a
Ignore current builds when uploading to github
2015-12-17 13:28:12 +00:00
Nick Craig-Wood
6e64a71382
Add Adriano Aurélio Meirelles to contributors
2015-12-17 13:28:12 +00:00
Nick Craig-Wood
4f50b26af0
Add missing cloud storage systems
2015-11-23 22:19:50 +00:00
Nick Craig-Wood
cb651b5866
Upload releases to github too - fixes #225
2015-11-23 22:18:21 +00:00
Nick Craig-Wood
3c1069c815
onedrive: re-enable server side copy
2015-11-22 11:04:16 +00:00
Nick Craig-Wood
7f0020a407
Version v1.25
2015-11-14 13:06:39 +00:00
Nick Craig-Wood
c270c1c80c
Increase retries for eventual consistency in tests
2015-11-14 12:57:17 +00:00
Nick Craig-Wood
29ecc2d8bb
onedrive: disable server side copy as it seems to be broken
2015-11-14 12:11:38 +00:00
Nick Craig-Wood
13da1b8d28
Add docs for fs specific options - fixes #210
2015-11-14 11:38:35 +00:00
Nick Craig-Wood
0b338eaa28
Fix up sensitive vs insensitive in the docs and some formatting - fixes #214
2015-11-14 11:20:04 +00:00
Nick Craig-Wood
46696865fd
Ignore golint errors that can't be fixed
...
Stop duplicating checkers in .travis.yml - use Makefile as definitive source
2015-11-14 10:08:52 +00:00
Nick Craig-Wood
fcea3777c0
Implement Hubic storage system - fixes #200
2015-11-14 08:08:52 +00:00
Nick Craig-Wood
5023050d95
Add RedirectLocalhostURL for another form of redirect URL
2015-11-14 08:08:51 +00:00
Nick Craig-Wood
bed01a303f
Add UnWrapper interface and implement in LimitedFs
2015-11-14 08:08:51 +00:00
Nick Craig-Wood
2c2cb84ca7
Make it so optional interface Purge can fail so it can be wrapped
2015-11-14 08:08:51 +00:00
Nick Craig-Wood
e9dda25c60
Implement Move in limited fs
2015-11-14 08:08:51 +00:00
Nick Craig-Wood
80ffbade22
Fix deletion of some excluded files without --delete-excluded #205
...
This only happened if the destination file was present but the source
file was missing.
2015-11-12 11:46:04 +00:00
Nick Craig-Wood
7beb50caa7
Remove go tip for the moment since it seems to be broken
2015-11-11 18:18:04 +00:00
Nick Craig-Wood
e8ba43c479
swift: Use ContentType from Object to avoid lookups in listings - fixes #208
2015-11-11 17:19:57 +00:00
Nick Craig-Wood
dcd6bedc27
make beta to compile and upload a beta release
2015-11-11 17:00:08 +00:00
Nick Craig-Wood
5bb76cc35c
Stop SetModTime losing metadata (eg X-Object-Manifest) - fixes #203
2015-11-11 17:00:08 +00:00
Nick Craig-Wood
3e68d485f2
Use svg for build status like the other badges
2015-11-08 17:46:19 +00:00
Nick Craig-Wood
1945f09d06
Drop back to testing with go 1.4.2 as it includes go vet
2015-11-08 10:52:35 +00:00
Nick Craig-Wood
2c66bdd6bb
Remove Go 1.5-ism to make compilable by go 1.3 & 1.4 - fixes #201
2015-11-08 10:42:50 +00:00
Nick Craig-Wood
a4f3548bbf
Remove OS X build until #194 is fixed and update go versions
2015-11-08 10:31:40 +00:00
Nick Craig-Wood
4276abc58b
Version v1.24
2015-11-07 16:23:12 +00:00
Nick Craig-Wood
a795d93bc3
swift, s3, googlecloudstorage: Don't delete the container/bucket if fs wasn't at root - fixes #172
2015-11-07 15:32:40 +00:00
Nick Craig-Wood
5df04cb763
swift: ignore directory marker objects where appropriate - fixes #190
...
* When creating a LimitedFs
* When calling List() to list files
* In the Storable() method
* Add a Purge() method to delete the directory marker objects too
This is a partial fix for #172
2015-11-07 15:32:11 +00:00
Nick Craig-Wood
ef54167a4a
Add goimports check to make check
2015-11-07 12:16:33 +00:00
Nick Craig-Wood
d42cb11b84
Fix tests to run all tests again and add onedrive
2015-11-07 11:21:15 +00:00
Nick Craig-Wood
b257de4aba
Be more constistent with naming in remotes
...
* External objects are called Fs and Object
* Object.fs always points to the Fs
2015-11-07 11:14:46 +00:00
Nick Craig-Wood
365b4babae
Make filter test files pass errcheck
2015-11-07 10:27:47 +00:00
Nick Craig-Wood
6d48dffa2f
Add -dump-headers and -dump-bodies flags for remote tests
2015-11-07 10:27:47 +00:00
Nick Craig-Wood
8f2999b6af
onedrive: implement Copy
2015-11-07 10:27:47 +00:00
Nick Craig-Wood
be6115fbfa
Fix nil pointer exception on test failure
2015-11-07 10:19:10 +00:00
Nick Craig-Wood
2fcb8f5db7
Add support for Microsoft One Drive - fixes #10
...
* Still to do
* Copy
* Move
* MoveDir
2015-11-07 10:19:10 +00:00
Nick Craig-Wood
0ab3f020ab
Fix Amazon icon in the docs
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
64c23c2f5b
Update font awesome to 4.4.0
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
ff16e0f6df
Factor common error handling into fs module
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
1a82ba196b
dircache: expose FoundRoot flag
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
ed72c678f8
Protect accounting from being closed twice
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
4ed8836a71
oauthutil: add RedirectPublicURL
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
5529978fa7
dircache: make separate mutex for the cache
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
66d84c9914
Document where to install root certificates - fixes #196
2015-11-05 18:09:56 +00:00
Nick Craig-Wood
1b95718460
Fix typos in filter docs and unit test assertions
2015-10-20 09:16:47 +01:00
Nick Craig-Wood
4e952af614
Allow spaces in remotes and check remote names for validity at creation time - fixes #171
2015-10-12 17:54:09 +01:00
Nick Craig-Wood
3a900e5bb7
Version v1.23
2015-10-03 16:24:07 +01:00
Nick Craig-Wood
b4d7741611
Improve output of --dump-headers
2015-10-03 16:04:51 +01:00
Nick Craig-Wood
95fd79faf9
swift: use Content-Length on uploads - fixes #125
2015-10-03 16:04:51 +01:00
Nick Craig-Wood
b79dc01016
swift: stop chunked operations logging "Failed to read info: Object Not Found"
2015-10-03 16:04:51 +01:00
Nick Craig-Wood
bf562d7373
Tweak wording on client/secret ids in acd, gcs and drive - fixes #155
2015-10-03 16:04:45 +01:00
Nick Craig-Wood
2e9f2ea3d3
oauthutil: fix headless config for drive and gcs - fixes #158
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
177dbbc29a
Implement rclone size for measuring remotes - fixes #153
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
4712043e26
Fix race condition in pacer tests - fixes #156
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
852acd5e4e
oauthutil: tell the user they should try again if the webserver method failed
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
9f1daabb2c
s3: allow anonymous access to public repositories - fixes #154
...
When setting up the remote, leave both the access key and secret key
blank.
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
938dd24cc9
Fix typo
2015-09-28 22:51:33 +01:00
Nick Craig-Wood
57aad81b68
Version v1.22
2015-09-28 19:38:20 +01:00
Nick Craig-Wood
a91bcaaeb0
Implement rsync like include and exclude - fixes #27
...
* Implement include/exclude
* Implement rsync compatible file globbing
* Implement command line filtering flags
* --delete-excluded - Delete files on dest excluded from sync
* --filter - Add a file-filtering rule
* --filter-from - Read filtering patterns from a file
* --exclude - Exclude files matching pattern
* --exclude-from - Read exclude patterns from file
* --include - Include files matching pattern
* --include-from - Read include patterns from file
* --files-from - Read list of source-file nam
* --min-size - Don't transfer any file smaller than this in k or suffix k|M|G
* --max-size - Don't transfer any file larger than this in k or suffix k|M|G
* Document
2015-09-28 19:18:21 +01:00
Nick Craig-Wood
d04c21b198
Add Sergey Tolmachev to contributors
2015-09-28 19:12:35 +01:00
Nick Craig-Wood
4a0a42c2f1
swift: large file upload fixes
...
* Read metadata in file listing for 0 length files to fix syncs
* Ignore non-existent files in isManifestFile to fix errors on copy
* remove nsToSwiftFloatString - experiments with the swift program
indicate that it puts a variable number of points after the
decimal, so might as well use the one in the swift library.
* Make sure segments get deleted properly when move from segmented
to non segmented and vice versa
* Use internal list routine to detect errors on listing
* Remove the _segments container if possible
* Remove manifest first when deleting
2015-09-26 17:58:04 +01:00
Nick Craig-Wood
68fef49c55
swift: fetch headers as the only source of metadata
2015-09-26 13:03:58 +01:00
Nick Craig-Wood
5d4b149884
Version v1.21
2015-09-22 21:05:11 +01:00
Nick Craig-Wood
5f20ae707d
Make lsl output times in localtime and fix tests - fixes #141
2015-09-22 19:04:12 +01:00
Nick Craig-Wood
e9c915e6fe
Fix golint warnings
2015-09-22 18:47:16 +01:00
Nick Craig-Wood
2ed158aba3
Fixes from go vet and errcheck
2015-09-22 07:31:12 +01:00
Nick Craig-Wood
05050d53ad
Implement compliant pacing scheme for Amazon Cloud Drive
...
* Implement switchable pacing algorithm
* Add tests for pacer
2015-09-21 21:49:54 +01:00
Nick Craig-Wood
e391311512
gofmt
2015-09-17 18:42:39 +01:00
Nick Craig-Wood
0872ec3204
Allow user to override credentials again in drive, gcs and acd - fixes #139
2015-09-16 20:08:40 +01:00
Nick Craig-Wood
34193fd8d9
Version v1.20
2015-09-15 07:42:31 +01:00
Nick Craig-Wood
2203766f77
Retry listing in tests to work around eventual consistency
2015-09-14 21:01:25 +01:00
Nick Craig-Wood
235cbe0e57
amazon cloud drive: retry 409 errors too
2015-09-14 21:00:44 +01:00
Nick Craig-Wood
f1226f19b2
drive, googlecloudstorage: optionally use auto config for the oauth token
2015-09-12 14:17:39 +01:00
Nick Craig-Wood
79f2e95bf9
Add Klaus Post to Contributors
2015-09-11 20:20:28 +01:00
Nick Craig-Wood
073d112204
Factor pacer module from Drive and use it in Amazon Cloud Drive for
...
smooth API pacing and retry logic.
2015-09-11 19:18:41 +01:00
Nick Craig-Wood
14f814b806
acd: Retry on 429 errors with backoff and fix upload of 0 length files
2015-09-09 23:23:37 +01:00
Nick Craig-Wood
a288c2b3a3
Make a retry error wrapper for a plain error
2015-09-09 23:22:41 +01:00
Nick Craig-Wood
fec16b0ac8
acd: Skip test on FS which don't support ModifiedTime
2015-09-09 23:21:50 +01:00
Nick Craig-Wood
dd8717797e
Implement --dump-headers and --dump-bodies debug flags
2015-09-08 21:02:48 +01:00
Nick Craig-Wood
7e7c239f09
Through popular demand add a donations page
2015-09-08 21:02:48 +01:00
Nick Craig-Wood
edd0e8abb1
Add Colin Nicholson to contributors
2015-09-08 21:02:48 +01:00
Nick Craig-Wood
8c3df224ef
Implement Amazon Cloud Drive - fixes #45
...
* Optional interfaces Copier, Mover, DirMover not done
2015-09-08 21:02:48 +01:00
Nick Craig-Wood
967fd2a778
dircache: implement FindRootParent and unify locking
2015-09-06 10:27:15 +01:00
Nick Craig-Wood
ea12e446ca
Factor DirCache from drive into its own module
2015-09-05 11:58:54 +01:00
Nick Craig-Wood
c8cd2b510f
More notes
2015-09-02 19:17:33 +01:00
Nick Craig-Wood
8b05a8322b
FAQ entry about bidirectional sync - see #118
2015-09-02 08:33:53 +01:00
Nick Craig-Wood
c98a51b26c
Lightly obscure secrets
2015-09-01 22:33:34 +01:00
Nick Craig-Wood
e2717a031e
Implement Mover and DirMover interfaces fixes #115
...
* unit tests
* local
* drive
* dropbox
2015-09-01 21:49:13 +01:00
Nick Craig-Wood
8d33ce0154
Check for source and dest being the same in sync/copy/move
2015-09-01 21:49:13 +01:00
Nick Craig-Wood
92745aa950
Add Root() to Fs interface
2015-09-01 21:49:13 +01:00
Nick Craig-Wood
cbc6bf6a89
FAQ entry on partial transfers / binary diffs - fixes #113
2015-08-31 12:47:07 +01:00