AWS DataSync now supports transfers to and from self-managed object storage! 🎉

This new feature makes it easy for customers to automate copying large amounts of data between on-premises object storage and AWS Cloud Storage.

What is AWS DataSync?

If you’re new to AWS DataSync, you may be wondering how this service works.

AWS DataSync makes it simple and fast to move large amounts of data between on-premises storage and AWS Cloud Storage. AWS DataSync makes it easy for you to move data by automating both the management of data transfer processes and the infrastructure required for a high-performance and secure data transfer. The below image illustrates how you can use AWS DataSync to quickly and efficiently move data between on-premises storage systems and Amazon S3, Amazon EFS, and Amazon FSx for Windows File Server.

 

AWS-DataSync-How-it-Works-Diagram

 

Let’s see a demo…

Who’s ready for a demo? I know I am! 😁

Let’s head over to the AWS Console and search for AWS DataSync.

AWS DataSync

 

Let’s click “Get Started.”

AWS DataSync

For the purpose of this blog post, we will pretend we’ve already Created an Agent. After you have created an agent and configured your source and destination, the next step is to Create a Task.

We want to set up a task that will transfer files from our on-premises object storage system to AWS. To do this, we select “Create Task.”

Screen Shot 2020 06 24 at 2.24.33 PM

 

We select “Create a new location” and specify an Object storage location type for our source.

Screen Shot 2020 07 01 at 7.42.45 AM

 

Now it’s time to select your agent. We add the IP address of our on-premises object storage server, as well as our path to the files we want to move.

Screen Shot 2020 07 20 at 4.48.47 PM

Your object storage will likely require credentials to access it, so you may want to require Authentication.

We configure an Access key and Secret key to access our S3 bucket.

Screen Shot 2020 07 01 at 7.46.06 AM

Now it’s time to configure our destination location. We do so by selecting “Choose an existing location” and by choosing an existing S3 bucket.

destination s3

Next I pick a “Task Name.

Screen Shot 2020 06 24 at 2.35.48 PM

We also have the option to schedule what frequency we wish to execute this Task. (You may want to schedule it in order to regularly pick up incremental changes until the migration cut-over.)

Screen Shot 2020 06 24 at 2.39.12 PM

Now we can attach a CloudWatch LogGroup to the task and log all transferred objects and files!

Screen Shot 2020 06 24 at 2.39.40 PM

The next step is to review our setup and finally create that task.

screencapture console aws amazon datasync home 2020 07 20 16 52 30 edit

And if all goes well, we get our happy green bar. 🙌🏽

Screen Shot 2020 06 24 at 2.44.15 PM

 

Now we head over to the S3 console, because we want to make sure that the objects were actually copied into our S3 bucket.

Voilà! There it is. 😁

Screen Shot 2020 07 20 at 5.00.57 PM

Lastly…

Support for on-premises object storage for AWS DataSync is now globally available in 22 AWS Regions for our customers to leverage. 🌎

To learn more about AWS DataSync, visit the DataSync product page and the DataSync developer guide.

 

You may also enjoy…

Check out this awesome demo video of AWS DataSync made by my fellow teammate, Jerry Hargrove.

 

¡Gracias por tu tiempo!
~Alejandra 💁🏻‍♀️ y Canela 🐾

 

AmazonWebServicesBlog?d=yIl2AUoC8zA AmazonWebServicesBlog?d=dnMXMwOfBR0 AmazonWebServicesBlog?d=7Q72WNTAKBA

bdSU7SQ f8E