915776161f
Use S3 ListObjectsV2 for listing files
...
ListObjects has been deprecated since 2016 and ListObjectsV2 with use of
explicit pagination tokens is more performant for large listings as well.
This also mitigates an issue with iDrive E2 where the StartAfter/Marker
is included in the output, leading to duplicate entries. Right now this
causes an exhaustive prune to delete chunks erroneously flagged as
duplicate, destroying the storage.
2023-09-23 22:17:22 -05:00
Gilbert Chen
43a5ffe011
Fixed a bug where a wrong variable is used as the number of threads
2019-03-13 15:38:26 -04:00
Michael Cook
4b9524bd43
go vet: unreachable code
2018-12-29 13:20:11 +01:00
Mark Feit
8aaca37a2b
Added note about Wasabi dependency.
2018-01-18 08:30:00 -05:00
Gilbert Chen
86767b3df6
Implement new chunk directory structure
2017-11-07 12:05:39 -05:00
Gilbert Chen
923cd0aa63
Run goimports on all source files
2017-09-20 23:07:43 -04:00
Gilbert Chen
8808ad5c28
Retry on XAmzContentSHA256Mismatch
2017-09-08 19:46:27 -04:00
Gilbert Chen
7f04a79111
Replace Fair Source 5 with our own free-for-personal-use license
2017-07-13 23:33:14 -04:00
Gilbert Chen
483ae5e6eb
Add minios:// for minio servers with SSL support
2017-07-12 21:09:19 -04:00
Gilbert Chen
f8764a5a79
Make the S3 backend compatible with minio
2017-07-11 13:45:06 -04:00
Gilbert Chen
2424a2eeed
Switch from goamz to aws-sdk-go for the S3 storage backend
2017-06-13 12:27:01 -04:00
Gilbert Chen
42337d84c3
Move source files into src for a better looking front page
2017-06-07 14:04:11 -04:00
Gilbert Chen
4a1dc01ff4
Reorganize src directory
2017-06-02 16:33:36 -04:00
Gilbert Chen
bdf017e552
Move source files to src/
2017-05-23 10:25:00 -04:00
