-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Milestone
Description
Create a download library and a download tool.
http(s)://: Maybe use https://github.com/apache/httpcomponents-client, maybe don't. Perhaps as a plugin.scp://orssh://: Maybe use https://github.com/hierynomus/sshj for ssh +dd.file://: No libraries needed.
Algorithm:
- Parallel (threads = 2):
- Get the Map<byte[], ChunkInfo> from the existing file, if exists.
- Get the header of the remote file.
- Parallel (threads = ?):
- Copy existing chunks (by hash) to
outputfile.chunk.####(where #### = chunk-num). - Parallel (threads = 5):
- Download missing chunks to
outputfile.chunk.####(where #### = chunk num).
- Download missing chunks to
- Copy existing chunks (by hash) to
- Merge (cat) new header + downloaded chunks.
Metadata
Metadata
Assignees
Labels
No labels