All those who are using AWS might have a requirement to download\sync\upload etc with your S3 bucket.
There are several ways to achieve that which includes some third party tool and even there are some ways via Visual Studio.
Let us check them one by one, we will take the example of downloading entire S3 bucket using below tools:
AWS CLI
The AWS Command Line Interface is a unified tool that provides a consistent interface for interacting with all parts of AWS.
Install AWS CLI using command sudo pip install awscli and then follow below command to download entire S3 bucket:
aws s3 sync s3://mybucket
Using s3cmd and S3Express
s3cmd is a third party tool which is a Command Line S3 Client and Backup for Linux and Mac and S3Express is Command Line S3 Client and S3 Backup for Windows.
You can download it from above link.
Once downloaded you can configure it as below:
s3cmd --configure
s3cmd sync s3://bucketnamehere/folder /destination/folder
You can even create and remove buckets using above tools. Have a look here for more details.
Using Visual Studio
You can download entire S3 bucket using Visual Studio. For that, you would be required to download AWS toolkit for visual studio which can be downloaded from here.
Once it is installed, go to Visual Studio – AWS Explorer – S3 – Your bucket – Double click
In the window, you will be able to select all files. Right click and download files.
Using Cyberduck
One more awesome tools for this is Cyberduck.
Cyberduck is a Libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift browser for Mac and Windows.
It just requires your AWS credentials and you can use the simple interface to download/upload/sync any of your buckets/folders/files.
Using Rclone
Rclone is a command line program to sync files and directories to and from
- Google Drive
- Amazon S3
- Openstack Swift / Rackspace cloud files / Memset Memstore
- Dropbox
- Google Cloud Storage
- Amazon Drive
- Microsoft OneDrive
- Hubic
- Backblaze B2
- Yandex Disk
- SFTP
- The local filesystem
You can sync your S3 bucket by giving below commands:
rclone sync /home/local/directory remote:bucket
Using S3Browser
S3 Browser is also one tool which can be used for above purpose. It is windows only tool.
S3 Browser is a freeware Windows client for Amazon S3 and Amazon CloudFront. Amazon S3 provides a simple web-services interface that can be used to store and retrieve any amount of data, at any time, from anywhere on the web. Amazon CloudFront is a content delivery network (CDN). It can be used to deliver your files using a global network of edge locations.
Using CloudBerry
I recently checked this one and it is nice too. It has a free version for S3.
As per the website:
CloudBerry Explorer for Amazon S3 provides a user interface to Amazon S3 accounts allowing to access, move and manage files across your local storage and S3 buckets. Amazon S3 file manager by CloudBerry is available in two versions – Freeware and PRO.
Freeware version. Free S3 browser comes with full support for such AWS features and services as Server Side Encryption, Lifecycle rules, Amazon CloudFront, Bucket Policies and more.
If you know any other awesome tools then do share it here.
Happy learning.
Webdrive would be a nice addition to this list. I have tried it and Cyberduck with S3, and must say that WebDrive was faster and easier to use.
LikeLike
Hey, thanks for the suggestion, I looked into Webdrive and it is very nice.
LikeLike
In 2020, a few more tools got created. I’ve been working on such a tool: https://www.filestash.app/s3-browser.html Filestash is intended to be as easy to use as Dropbox while giving additional features like collaboration, inline document editing, video transcoding and more. Ho and it’s open source as well: https://github.com/mickael-kerjean/filestash
LikeLike