Wasabi sometimes gets asked about the best approach to copy files from AWS S3 to Wasabi. Although there are commercial cloud services that can be used for the purpose of cloud-to-cloud migration, they are often expensive as these services typically charge on a per-GB transferred basis. These fees combined with the AWS egress fees can make the migration or duplication of files from AWS S3 to Wasabi challenging from a cost perspective.
Another approach to copying files from AWS S3 to Wasabi is to leverage standard S3 tools that operate on premises or cloud compute resources that you control. Several different approaches for using these tools are described below.
Wasabi is also working with several partners to provide cloud-to-cloud migration capabilities. Please contact us for more info on this topic.
Option 1. Using the AWS CLI (Command Line Interface) tool:
Install AWS CLI and configure using your AWS Access Key and Secret Key. The instructions for the same can be found here.
Configure additional AWS CLI profile for Wasabi account using the Wasabi keys. You can refer to this article.
Transfer all files from the AWS bucket to local directory by running the following command:
aws s3 cp s3://<source_bucket>/ <local_directory> --recursive
Then, transfer all files from the local directory to destination bucket at Wasabi:
aws s3 cp <local_directory>/ s3://<destination_bucket>/ --recursive --profile wasabi
Option 2. Using the s3cmd tool:
Install and configure the CLI using --configure switch and enter the AWS Access Key and Secret Key when prompted.
Transfer files from the AWS bucket to the local directory by running the following command:
s3cmd get --recursive s3://<source_bucket>/ <local_directory>
Change the configuration of CLI to Wasabi access keys and the instructions for the same can be found here.
To transfer files from local directory to destination bucket at Wasabi simply run the command:
s3cmd put --recursive <local_destination_directory>/ s3://<destination_bucket>/
Option 3. Using Cloudberry Backup tool:
- Create accounts in Cloudberry Backup for AWS and Wasabi buckets
- Choose Cloud to Cloud transfer
- Create Backup plan to transfer files from AWS to Wasabi by choosing the appropriate options
- Excecute the plan by clicking on the play button under the Backup Plans tab