Welcome To TechBrothersIT: How to download file from Amazon S3 Bucket to Azure Blob Storage

Issue: How to download file from Amazon S3 Bucket to Azure Blob Storage.

In this article, we are going to learn How to download file from Amazon S3 Bucket to Azure Blob Storage, let's start our demonstration first of all we are going to create an S3 bucket on our amazon account and then will upload some files to our S3 bucket and then will download by using blob storage.

To create an S3 bucket, open the amazon account and then search and select the S3 'Scalable storage in the cloud'.

Click on Create bucket button.

Name the S3 bucket, then select the region and click on 'Block all public access' and then click on Create bucket button.

Once our S3 bucket is created, let's create some folders inside, click on the S3 bucket and then click on Create folder button.

Name the folder and click on create folder button, and then create another folder by following the same.

Once our folders are created so let's upload some files to our newly created folders, click on the upload button then click on add files button and then select the files which you want to upload.

Then go to the main page and search and select IAM to create some users and give access to our S3 bucket.

First of all, we need to create a policy, to create a policy click on the policies and then click on Create policy button.

To create policy select S3 as Service and then in the action select the permission, which are ListAllMyBuckets, ListBucket, then GetBucketLocation, GetObject, GetObjectVersion, then select All resources and click on Next:Button.

Then name the policy, write a description and then click on create policy button.

Once our policy is created now we have to create a user, so click on the Users tab then click on create user button.

Then name the user and click on next to give permissions.

Click on the Attach existing policies directly, and then select the policy which we created before and then click on next and then click on create user button.

Once our user will create it will create and CSV, in this file, we will find the login keys for the newly created user, click on the download .CSV.

Next, go to the Azure data factory, and in the Azure data factory click on the manage tab then select linked services, and then click on the + New button to create a new linked service.

Select Amazon S3 and then click on continue.

Give then to the linked service, then provide the access key and secret key which we find in our CSV file then provide the bucket name then provide the folder name and click on create.

Next, go to the author tab then click on pipelines, and then click on the + button to create a new pipeline.

Then search and drag the copy data activity, then click on the source then click on + New button to create a new source dataset.

Select Amazon S3 then click on continue.

Then select Binary and click on continue.

Give the name, then select the linked service which we created before, then provide the bucket name, then provide the folder name then select the file and then click ok.