How to Read the data from Rest API (JSON) by using REST Connector and write to CSV File on Azure Blob Storage in Azure Data Factory

 Issue: How to Read the data from Rest API (JSON) by using REST Connector and write to CSV File on Azure Blob Storage in Azure Data Factory.


In this article, we are going to learn how to read the data from the rest API which is in the JSON format by using rest Connector and write to CSV file on Azure blob storage in the Azure data factory, let's start our demonstration, first of all, open the Azure data factory, and inside the Azure data factory click on the author, and go to the pipeline and click on the new pipeline.



Then select the copy data activity from the activity tab, and drag it into the working window.



Then go to the source and click on the + New button to create a new source dataset to read the data from our source.



Then select the Rest connector and click on continue.


Once we select the connector it will ask for the linked service, click on the new linked service




To create a linked service, name the linked service, then select connect via integration runtime, then provide the Base URL, then select the authentication type, then enable or disable then Server Certificate Validation as per the requirement of your company then click on create.



Once our source dataset is created let's create our sink dataset, to create sink the dataset click on the sink tab then click on the + New button.


Select the Azure blob storage and click on continue.



Select the file format in which we need the output data, in my case, it is CSV (Delimited Text) and then click on continue.



For the sink dataset, we need a new linked service so click on the + New button to create a new linked service.


Select the Azure Subscription, then select the storage account, then test the connection, and then click on create
 

Then select the output container.


To provide the file name click on Open.





And then name the file and there is many options you can select as per your need.



Then click on mapping and select the import schemas.




Then finally click on Debug.





Video Demo: How to Read the data from Rest API (JSON) by using REST Connector and write                           to CSV File on Azure Blob Storage in Azure Data Factory.








No comments:

Post a Comment

Note: Only a member of this blog may post a comment.