How to Delete Files from Multiple Blob Containers by Using Controlled File in Azure Data Factory

 Issue: How to delete files from multiple blob containers by using controlled file in Azure data factory.


In this article we are going to learn how to delete files from multiple blob containers by using controlled file in the Azure data factory, in this scenario I have 3 folders in my Blob storage named ''Input'' ''Output'' and ''Logs'', I have uploaded some files in these three folders, now I have to create a controlled file to delete the specific type of files, let's start our demonstration.

I have created the controlled file, in which I have two columns named folder name and wild card, and under these columns, I have folder names and in front of the folders, I have described the file type which I want to delete from these folders, and I have uploaded this master delete file in another folder which name is Mylogs.



Next, Open the Azure data factory, and go to the Author tab and click on the + Sign to create a new pipeline, then find and drag the lookup activity.


Now, click on the lookup activity, then go to the settings tab and click on the + New button to create a new source dataset.



Select the Azure Blob Storage, then click on continue.



Then select the CSV as file format, and click on continue.


Name the dataset, then select the linked service, then select the DeleteMaster file which we have uploaded in the Mylog folder, then select the first row as header, select none for import schema, and then click on ok


.

Please uncheck '' First row only''.


Once we are done with our lookup activity, now find and drag the ForEach loop activity and then connect with the lookup activity.


Click on the ForEach loop activity, then go to the settings tab then click on sequential, and in the items click on the Add dynamic content, to provide the list of the items from our Lookup activity.



Now go to our ForEach activity and click on the pencil sign to go inside the activity where we have to set up our delete activity.



Inside the ForEach Loop activity, find and drag the Delete activity, then go to the source tab and then click on the + New button to create a new source dataset.

 

Select the Azure Blob storage and click on continue.


Name the dataset, then select your linked service, and then click on ok


Inside the source, tab click on the Open button to provide the folder path from where we need to delete our files



Now go to the parameter tab and click on the + sign to create a new parameter.


Then go to the connection tab and in the file path provide this parameter.



Now, go back to the Delete activity, and provide the values, which we will get from our ForEach loop Activity.



Next, Click on the Wildcard file path and click on ''Add dynamic content''.



Then we have a very important thing to do, as we are going to delete our files so it is extremely recommended to save logs, so select the storage and container where you want to save your delete logs.




Now we are done with our delete activity, so Click on Debug.





Video Demo: How to Delete Files from Multiple Blob Containers by Using Controlled File in Azure Data Factory



1 comment:

  1. BINARY SCAM RECOVERY

    ❌ Binary Option, Forex and their likes are a means of making money but it’s more like gambling. There are no sure means to guarantee that a person could make profit with them and that’s why it can also be reasoned to be scam. Let’s not forget that some individuals even give you đŸ’¯ % guarantee of making profits and end up running away with your money. The internet today is full of Binary Option Recovery Scam, you see so much testimonies been shared about how a firm or Company helped them recover what they lost to Binary Options. But believe it, it’s just a way to lure more people and end up scamming them.

    ❌ You might have also come across some individuals that say they will give you guarantee on successful trades but they only end up as SCAMMERS as well. You here them say stuffs like 200% guaranteed in just 2 weeks and when you go into trade with them, they start telling you to pay profits percentage before you can get your income. These are all liars please avoid them. But if you have been a victim of this guys, then you should contact FIRMWARE now‼️

    ✳️The big Question is “Can someone Recover their money lost to Binary Option and Scam⁉️
    I will say yes, and will tell you how.

    The only way to Recovery your money back is by hiring HACKERS to help you break into the Firms Database Security System using the information you provide them with, Extract your file and get back your money. It seems like a really impossible thing to do, I will tell you, it should be impossible, but with the use of specially designed softwares known to HACKERS and Authorities (such as The FBI, CIA e.t.c) it is possible and the only way to recover your money.

    ✅FIRMWARE are a group of hackers who use their hacking skill to hunt down SCAMMERS and help individuals recovery their money from Internet SCAMMERS.
    We just need the contact details of the SCAMMERS and Paymnet Info and within 4-8 hours your money will be return to you.

    ✳️ You can contact us via the emails below-:
    firmwarehacks@gmail.com


    We also provide Legit Hacking Services such as-:
    đŸ”¸Phone Hacking/Cloning
    đŸ”¸Email Hacking & Password Recovery
    đŸ”¸Social Media Hacking & Passowrd Recovery
    đŸ”¸Deleted Files Recovery đŸ”¸Mobil Tracking
    đŸ”¸Virus detection & Elimination.

    Email-: firmwarehacks@gmail.com




    Firmware
    2022 © All Right Reserved.

    ReplyDelete