Issue: How to Use Filter Activity in Azure Data Factory.
In this article, we are going to learn about how to use filter activity, in this article we will also learn how to use the Get metadata activity, how to create a pipeline, etc. Let's start our demonstration.
How to Create a Pipeline and use Get Metadata activity.
Open the Azure Data Factory, go to the author tab, click on the pipeline, then click on the new pipeline, find and drag the Get Metadata activity, go to the Dataset tab and click on the + New button to create a new dataset.
As we are going to use files from our blob storage, here select the Azure Blob storage, then click on continue.
Select the file format, which is CSV, then click on continue.
Name your dataset, select the linked service that will connect to the blob storage, select the Files path, import schema will be from the connection/store, then click on Ok.
Go to the filed list in the dataset tab, click on the + New, and select child items.
How to Use Filter activity:
Find and drag the filter activity, connect with the Get Metadata activity, go to the settings tab, in the items, click on Add dynamic content, select the Get metadata and in the end add ''.childitems'', then in the connection click on Add dynamic content and write the expressions for the file name which is Customer.
Next, find and drag another filter activity, connect with the Get Metadata activity, go to the settings tab, in the items, click on Add dynamic content, select the Get metadata and in the end add ''.childitems'' then in the connection click on Add dynamic content and write the expressions for the file name which is Sale Amount.
No comments:
Post a Comment