BucketClient

The BucketClient class in the multicloudj library provides a comprehensive, cloud-agnostic interface to interact with individual buckets in object storage services like AWS S3, Azure Blob Storage, and Google Cloud Storage.

This client enables uploading, downloading, deleting, listing, copying, and managing blob metadata and multipart uploads across multiple cloud providers.


Feature Support Across Providers

Core API Features

Feature Name GCP AWS ALI Comments
Basic Upload ✅ Supported ✅ Supported ✅ Supported Upload from InputStream, byte[], File, Path
Basic Download ✅ Supported ✅ Supported ✅ Supported Download to OutputStream, byte[], File, Path
Delete Objects ✅ Supported ✅ Supported ✅ Supported Single and batch delete operations
Copy Objects ✅ Supported ✅ Supported ✅ Supported Server-side copy within and across buckets
Get Metadata ✅ Supported ✅ Supported ✅ Supported Retrieve object metadata and properties
List Objects ✅ Supported ✅ Supported ✅ Supported Paginated listing with filters
Object Tagging ⏱️ End of July’25 ✅ Supported ✅ Supported Get and set object tags
Presigned URLs ✅ Supported ✅ Supported ✅ Supported Generate temporary access URLs
Versioning Support ✅ Supported ✅ Supported ✅ Supported Object version-specific operations

Multipart Upload Features

Feature Name GCP AWS ALI Comments
Initiate Multipart ️ Mid of Aug’25 ✅ Supported ✅ Supported Start multipart upload session
Upload Part Mid of Aug’25 ✅ Supported ✅ Supported Upload individual parts
Complete Multipart Mid of Aug’25 ✅ Supported ✅ Supported Finalize multipart upload
List Parts Mid of Aug’25 ✅ Supported ✅ Supported List uploaded parts
Abort Multipart Mid of Aug’25 ✅ Supported ✅ Supported Cancel multipart upload

Advanced Features

Feature Name GCP AWS ALI Comments
Async Operations ✅ Supported ✅ Supported 📅 In Roadmap CompletableFuture-based async API available only for AWS
Bucket Operations ✅ Supported ✅ Supported ✅ Supported List buckets via BlobClient

Configuration Options

Configuration GCP AWS ALI Comments
Endpoint Override ✅ Supported ✅ Supported ✅ Supported Custom endpoint configuration
Proxy Support ✅ Supported ✅ Supported ✅ Supported HTTP proxy configuration
Credentials Override ✅ Supported ✅ Supported ✅ Supported Custom credential providers via STS

Provider-Specific Notes


Creating a Client

BucketClient bucketClient = BucketClient.builder("aws")
    .withRegion("us-west-2")
    .withBucket("my-bucket")
    .build();

You can also configure advanced options:

URI endpoint = URI.create("https://custom-endpoint.com");
URI proxy = URI.create("https://proxy.example.com");

bucketClient = BucketClient.builder("aws")
    .withRegion("us-west-2")
    .withBucket("my-bucket")
    .withEndpoint(endpoint)
    .withProxyEndpoint(proxy)
    .build();

Uploading Files

Supports various sources:

UploadRequest request = new UploadRequest("object-key");

bucketClient.upload(request, inputStream);
bucketClient.upload(request, new File("file.txt"));
bucketClient.upload(request, path);
bucketClient.upload(request, byteArray);

Downloading Files

DownloadRequest request = new DownloadRequest("object-key");

bucketClient.download(request, outputStream);
bucketClient.download(request, new File("dest.txt"));
bucketClient.download(request, path);
bucketClient.download(request, byteArray);

Listing Blobs

ListBlobsRequest request = new ListBlobsRequest();
Iterator<BlobInfo> blobs = bucketClient.list(request);
while (blobs.hasNext()) {
    System.out.println(blobs.next().getName());
}

Deleting Blobs

bucketClient.delete("object-key", null); // optional versionId

Collection<BlobIdentifier> toDelete = List.of(
    new BlobIdentifier("object1"),
    new BlobIdentifier("object2")
);
bucketClient.delete(toDelete);

Copying Blobs

CopyRequest copyRequest = new CopyRequest();
// populate source and destination
CopyResponse response = bucketClient.copy(copyRequest);

Metadata and Tags

BlobMetadata metadata = bucketClient.getMetadata("object-key", null);
Map<String, String> tags = bucketClient.getTags("object-key");
bucketClient.setTags("object-key", Map.of("env", "prod"));

Presigned URLs

PresignedUrlRequest presignedRequest = new PresignedUrlRequest();
URL url = bucketClient.generatePresignedUrl(presignedRequest);

Multipart Uploads

MultipartUploadRequest initRequest = new MultipartUploadRequest();
MultipartUpload upload = bucketClient.initiateMultipartUpload(initRequest);

UploadPartResponse part = bucketClient.uploadMultipartPart(upload, partData);

List<UploadPartResponse> parts = List.of(part1, part2);
bucketClient.completeMultipartUpload(upload, parts);

List<UploadPartResponse> uploadedParts = bucketClient.listMultipartUpload(upload);

bucketClient.abortMultipartUpload(upload);

Error Handling

All operations may throw SubstrateSdkException. These can be caught and handled generically:

try {
    bucketClient.upload(request, new File("file.txt"));
} catch (SubstrateSdkException e) {
    // Handle access denied, IO failure, etc.
    e.printStackTrace();
}

Use BucketClient when you need full CRUD support and advanced control over blobs inside a single bucket, across any supported cloud provider.