Skip to content

Commit

Permalink
storj: performance improvement for large file uploads
Browse files Browse the repository at this point in the history
storj.io/uplink v1.11.0 comes with an improved logic for uploading large
files where file segments are uploaded concurrently instead of serially.
This allows to fully utilize the network connection during the entire
upload process.

This change enable the new upload logic.
  • Loading branch information
kaloyan-raev authored and ncw committed Aug 4, 2023
1 parent 4444037 commit d63fcc6
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions backend/storj/fs.go
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@ import (

"storj.io/uplink"
"storj.io/uplink/edge"
"storj.io/uplink/private/testuplink"
)

const (
Expand Down Expand Up @@ -276,6 +277,8 @@ func (f *Fs) connect(ctx context.Context) (project *uplink.Project, err error) {
UserAgent: "rclone",
}

ctx = testuplink.WithConcurrentSegmentUploadsDefaultConfig(ctx)

project, err = cfg.OpenProject(ctx, f.access)
if err != nil {
return nil, fmt.Errorf("storj: project: %w", err)
Expand Down

0 comments on commit d63fcc6

Please sign in to comment.