How to Use Azure Key Vault Secrets in Azure Data Factory for SQL Connection and Blob Connection- ADF Tutorial 2021

 Issue: How to Use Azure Key Vault Secrets in Azure Data Factory for SQL Connection and Blob Connection.


In this article, we are going to learn How to use Azure Key vault secrets in Azure Data Factory, for SQL connection and Blob connection, First of all, we learn how to create an Azure key vault.

How to Create Azure Key vault.

 Open the Azure portal and then go to the key vaults, you can find it at the search bar on the top of the Azure portal, then click on the + Create button to create a new Key Vault.


Select the Azure subscription, then select your resource group, provide a name to the key vault, select your region, select pricing tier, then click on Review + create and then click on create.


Once our key vault is created, now go to the storage account, then click on Access keys, then copy the connection string key.



Now go to our Azure key vault, then click on secrets, and then click on + Generate/Import. 


Select the upload option, then provide a name, then paste the access key which we copied from our storage account, and then click on create.


Next, we have to get the connection string from our Azure SQL database, so go to the resource group, then go to the server, then go to the database and then click on the connection strings under the security tab.


Copy the connection strings key, paste it to a notepad file, provide the password in the key, and then copy the key again.


Next, go to our Azure key vault, then click on Secrets under the security tab, and then click on + Generate/Import button.


Select the upload option, provide a name, paste the access key that we copied from our connection strings, and click on create.


Next, go to the SQL server and go to your SQL databases, then select your database and provide the username and password then connect, and then create a new table.


Then click on the Firewalls and virtual networks, then Allow Azure services and resources to access this server, and click on save.


Next, open your Azure data factory studio, then go to the author tab and then click on + button, and then click on the new pipeline.



Find and drag the copy data activity in the working window, then go to the source, then click on the +New button to create a new source dataset.


Select Azure SQL Database then click on continue.


Provide the name, then click on Azure Key vault, and then it will ask for the linked service, click on + New.


Then provide a name, then select your Azure subscription, then select the Azure key vault and then click on create.


Now go to the azure key vault, select Key permissions, select secret permissions, select the certificate permissions, select the Azure data factory as principal, and then click add.


Once we add the access key policy in the Aure key vault, go back to our linked service and now select the secret name, then test the connection and then click on create.


Then select the table name and click on ok.


Now our source dataset is completed and we need to create a sink dataset, that we can copy the data from our source, to create a sink dataset, go to the sink tab then click on the + New button.


Select Azure blob storage and click on continue.


 Click the CSV file format, then click on continue.


Then it will ask for the linked service, click on + New, then provide a name, then select Azure key vault, then select linked service which we created before, then select the secret name, then test the connection, and click on create.


Once our linked service is created select the container where we will copy our data and then click on ok.


In the sink dataset click on open and provide a name for our file.


As our pipeline is ready click on debug, and then your file/files will be copied.




Video Demo: How to Use Azure Key Vault Secrets in Azure Data Factory for SQL Connection and Blob Connection






20 comments:

  1. The rare resources New World players want can be obtained by buying New World Coins at IGGM. IGGM offers a 5% discount, the discount code is "NW5".

    Attached link: https://www.iggm.com/new-world-coins

    ReplyDelete
  2. Such a great information for blogger i am a professional blogger thanks.


    Algorithmic Trading

    ReplyDelete
  3. I am very impressed with the article. The content of information is very informative. We are also providing the best services click on below links to visit our website.
    Snowflake Training
    Workday Training
    Okta Training
    AEM Training
    CyberArk Training

    ReplyDelete
  4. I have read your blog and I gathered some new information through your blog. Your blog is really very informative and unique. Keep posting like this.

    IoT Analytics Services

    Text Analytics Solutions

    Advanced Analytics Solutions

    Big Data Services

    Data Lake Solutions

    Data Migration Services

    ReplyDelete
  5. Infycle Technologies offers couples for care and technology in addition to Python Training in Chennai, 100% of the internship class will be prepared. After completing the training, the participants will be sent to the upper MNCs interviews. Call 750633333 to get more information and get a free display.

    ReplyDelete
  6. This comment has been removed by the author.

    ReplyDelete
  7. Here is the best Software training institute to study AWS training in Chennai, Infycle Technologies and we also provide courses like Power BI, Cyber Security, Graphic Design and Animation, Block Security, Oracle, Java, Data Science, Big data, AWS, Python, etc., After the completion, of course, students will be able to crack their jobs in top MNC's. For more queries dial 7504633633.

    ReplyDelete
  8. I most likely appreciating each and every bit of it. It is an incredible site and decent impart. I need to much obliged. Great employment! You all do an incredible blog, and have some extraordinary substance. Keep doing awesome. check this link

    ReplyDelete
  9. Practically all calfskin produced using lighter-weight steers stows away and from the skin of sheep, sheep, goats, and pigs is chrome tanned. The initial steps of the cycle (splashing, fleshing, liming/dehairing, deliming, bating, and pickling) and the Men Black Biker Jacket drying/completing advances are basically equivalent to in vegetable tanning.

    ReplyDelete
  10. Are you looking for an affordable and reliable CEMENT TREATED BASE service? Hasten Contracting can provide you with all the services you need to get your home or commercial property ready for Earthquake proofing. We use theCEMENT TREATED BASE service in texas latest technology and equipment to treat your base and ensure that it is compliant with all current codes and standards. Contact us today to learn more about our services, or book an appointment to see how we can help you!

    ReplyDelete
  11. If you're looking for a top-quality ceramic coating Ottawa, look no further than envirosteam! Our team of experts have years of experience in the ceramic coating industry, and we know how to deliver the best results for your property. We usePaint Protection Film Ottawa the latest technologies and equipment to ensure that every coat is applied with precision, and that your finished product looks as good as it feels. Contact us today to learn more about our services, or schedule a consultation to get a better idea of what we can do for you.

    ReplyDelete
  12. A natural aphrodisiac epimedium sex honey in uae that gives you energy and relief from erectile dysfunction and enhances both female arousal and male performance

    ReplyDelete
  13. Hasten Chemical is a team of professionals who work to maximize the bottom line results of its clients. As a wholesaler of chemical products, Hasten provides unconditional commitment to excellence in quality, that will provide consistent results, and make us the partner of choice to help produce and maintain growth of Products and Service Companies.
    Fly Ash Florida

    ReplyDelete
  14. Fluxx tuning came up with the idea of starting this website because all of us ran into sourcing parts at the right price for our own cars. A platform like Fluxx Tuning would have helped us a lot in that process, just like we hope to help everyone interested in modifying their cars now. WAGNER INTERCOOLER dubai

    ReplyDelete
  15. Combined Pumps design engineer and manufacture all of their own pump systems on site at our Aberdeen facility. Combined Pumps also holds ISO 9001 accreditation illustrating our commitment to quality and certification. In addition to manufacturing our own pump products we also have capacity for elastomer seal engineering and manufacturing.  hydrocarbon pumps Aberdeen

    ReplyDelete
  16. First of all, we learn how to create an Azure key vault. Continue Reading...Partitioning your SAP HANA database requires some restrictions and considerations. In this blog post, we will discuss assignmentsquare options for storing keys in Azure Key Vaults - First of all, to start off with SAP HANA partitioning it is necessary to have a single instance (SAP Cloud Platform) as the master branch manager due to the geo-redundancy implemented within this solution.

    ReplyDelete
  17. Our capabilities stretch not only for new projects but also in the retrofitting of existing structures and equipping them to operate state of the art early detection & warning systems in order to safeguard critical assets in the long term.
    Gas Leak Detector Sensor

    ReplyDelete
  18. This comment has been removed by the author.

    ReplyDelete
  19. We aim to create unique kitchen companies in uae that suit your tastes by bringing the best Italian kitchen designs straight from the factory to your homes. We promise you the kitchen of your dreams with assured functionality, all for an affordable price.

    ReplyDelete