Gilbert Chen
8df529dffe
Fixed the type of a test parameter
2022-04-07 23:34:48 -04:00
Gilbert Chen
d9f6545d63
Rewrite the backup procedure to reduce memory usage
...
Main changes:
* Change the listing order of files/directories so that the local and remote
snapshots can be compared on-the-fly.
* Introduce a new struct called EntryList that maintains a list of
files/directories, which are kept in memory when the number is lower, and
serialized into a file when there are too many.
* EntryList can also be turned into an on-disk incomplete snapshot quickly,
to support fast-resume on next run.
* ChunkOperator can now download and upload chunks, thus replacing original
ChunkDownloader and ChunkUploader. The new ChunkDownloader is only used
to prefetch chunks during the restore operation.
2021-10-24 23:34:49 -04:00
Tet Woo Lee
4ae16dec7f
add -persist in check and restore mode (for PR)
2020-05-06 18:39:52 +12:00
Gilbert Chen
e880636502
Fixed test build errors caused by the prototype change in CheckSnapshots()
2020-03-30 17:49:26 -04:00
Michael Cook
0762c448c4
gofmt -s
2018-12-29 13:20:10 +01:00
Gilbert Chen
93cc632021
Record deleted snapshots in the fossil collection and if any deleted snapshot still exist nude the fossil collection
2018-08-04 22:59:25 -04:00
Gilbert Chen
72dfaa8b6b
Fixed a bug causing a new snapshot to be not counted when deciding which fossils can be deleted
2018-07-23 22:08:08 -04:00
Gilbert Chen
6f0166be6d
Add a test for multi-threaded pruning
2018-06-06 13:11:19 -04:00
Gilbert Chen
dd53b4797e
Implement multi-threaded pruning
2018-06-04 21:52:07 -04:00
Gilbert Chen
e03cd2a880
Add unreferenced fossils to the fossil collection instead of deleting them immediately
2018-05-29 12:57:38 -04:00
Gilbert Chen
1ea615fb45
Fix the names of prune tests so they can be run all in once
2018-03-20 15:03:03 -04:00
Gilbert Chen
7d933a2576
Create two identical snapshots in prune test to catch a retrive-after-deletion bug
2018-03-20 14:37:47 -04:00
gilbertchen
13fffc2a11
Merge pull request #329 from pdf/prune_memory
...
Reduce memory consumption for prune operation
2018-03-20 14:32:12 -04:00
Gilbert Chen
e07226bd62
Retention policy erroneously apply to snapshots without the specified tags
2018-02-10 21:33:01 -05:00
Peter Fern
bd5a689b7d
Add keepChunkHashes flag to GetSnapshotChunks, allowing reduced memory
2018-01-21 10:11:59 +11:00
Gilbert Chen
86767b3df6
Implement new chunk directory structure
2017-11-07 12:05:39 -05:00
Gilbert Chen
923cd0aa63
Run goimports on all source files
2017-09-20 23:07:43 -04:00
countextreme
b7f537de3c
Update duplicacy_snapshotmanager_test.go
2017-08-28 13:17:07 -04:00
Gilbert Chen
150ea13a0d
Fixed a build error in SnapshotManager tests caused by changes in CreateFileStorage
2017-08-09 12:12:21 -04:00
Gilbert Chen
823b82060c
Add a storage prefix flat:// that can handle a flat chunk directory
2017-07-27 22:42:48 -04:00
Gilbert Chen
7f04a79111
Replace Fair Source 5 with our own free-for-personal-use license
2017-07-13 23:33:14 -04:00
Gilbert Chen
d0c376f593
Implement fast resume; refactor GetDuplicacyPreferencePath()
2017-06-22 22:53:33 -04:00
Gilbert Chen
42337d84c3
Move source files into src for a better looking front page
2017-06-07 14:04:11 -04:00
Gilbert Chen
4a1dc01ff4
Reorganize src directory
2017-06-02 16:33:36 -04:00
Gilbert Chen
bdf017e552
Move source files to src/
2017-05-23 10:25:00 -04:00
