How to Read the data from Rest API (JSON) by using REST Connector and write to CSV File on Azure Blob Storage in Azure Data Factory

 Issue: How to Read the data from Rest API (JSON) by using REST Connector and write to CSV File on Azure Blob Storage in Azure Data Factory.


In this article, we are going to learn how to read the data from the rest API which is in the JSON format by using rest Connector and write to CSV file on Azure blob storage in the Azure data factory, let's start our demonstration, first of all, open the Azure data factory, and inside the Azure data factory click on the author, and go to the pipeline and click on the new pipeline.



Then select the copy data activity from the activity tab, and drag it into the working window.



Then go to the source and click on the + New button to create a new source dataset to read the data from our source.



Then select the Rest connector and click on continue.


Once we select the connector it will ask for the linked service, click on the new linked service




To create a linked service, name the linked service, then select connect via integration runtime, then provide the Base URL, then select the authentication type, then enable or disable then Server Certificate Validation as per the requirement of your company then click on create.



Once our source dataset is created let's create our sink dataset, to create sink the dataset click on the sink tab then click on the + New button.


Select the Azure blob storage and click on continue.



Select the file format in which we need the output data, in my case, it is CSV (Delimited Text) and then click on continue.



For the sink dataset, we need a new linked service so click on the + New button to create a new linked service.


Select the Azure Subscription, then select the storage account, then test the connection, and then click on create
 

Then select the output container.


To provide the file name click on Open.





And then name the file and there is many options you can select as per your need.



Then click on mapping and select the import schemas.




Then finally click on Debug.





Video Demo: How to Read the data from Rest API (JSON) by using REST Connector and write                           to CSV File on Azure Blob Storage in Azure Data Factory.








5 comments:

  1. Another great way to know whether a digital marketing company is the best, is through recommendations. Ask your friends and family if they have anyone in mind, or if any friends-of-friends are in the know. Turnkey Marketing

    ReplyDelete
  2. wonderful article. Very interesting to read this article. I would like to thank you for the efforts you had made for writing this awesome article. This article resolved my all queries. Mason Jacob

    ReplyDelete
  3. Positive site, where did u come up with the information on this posting?I have read a few of the articles on your website now, and I really like your style. Thanks a million and please keep up the effective work. tape storage to buy

    ReplyDelete
  4. I love the way you write and share your niche! Very interesting and different! Keep it coming! Peter Black

    ReplyDelete
  5. Pretty good post. I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I'll be subscribing to your feed and I hope you post again soon. Big thanks for the useful info. Anthony Clark

    ReplyDelete