TechBrothersIT is the blog spot and a video (Youtube) Channel to learn and share Information, scenarios, real time examples about SQL Server, Transact-SQL (TSQL), SQL Server Database Administration (SQL DBA), Business Intelligence (BI), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Data Warehouse (DWH) Concepts, Microsoft Dynamics AX, Microsoft Dynamics Lifecycle Services and all other different Microsoft Technologies.
How to Deploy SSIS Project in Azure File Share and call SSIS Packages in Azure Data Factory Pipeline
Issue: How to Deploy SSIS Project in Azure File Share and call SSIS Packages in Azure Data Factory Pipeline.
In this article, we are going to learn how to deploy SSIS projects in Azure file share and call SSIS packages in Azure Data Factory, in this article, we will also learn, how to create an SSIS package to load two databases, how to create SSIS integration runtime to use Azure file share to save SSIS project, How to create a pipeline, to use SSIS package saved in Azure file share, and at the end, we will learn how to schedule SSIS package by using Azure pipeline.
How to Create an SSIS Package:
Open the Visual studio, in the file tab click on the new project, select the Integration Services project then name your project and click on ok
Next, bring the data flow task, then inside the dataflow task bring the OLEDB source and OLEDB destination and then configure both, and connect with the SQL server database.
Click on OLEDB source, in the connection manager click new, then provide the SQL Server name, select the authentication type, provide the username and password, provide the database name from where you will read the data, test the connection and then click on ok if everything goes right.
Once our OLEDB source is ready connect it with the OLEDB destination and click on OLEDB destination in the connection manager click on new, Provide the server name, select the authentication, provide the user name and password, select or enter a database name, test the connection and then click on ok
Go to the parameter tab, create a new parameter, name your parameter, select the data type, provide the values, select the case sensitive you require then go back to the data flow activity and use the parameter in Source and in the destination.
Once we configured our SSIS package click on Build, then click on Rebuild solution.
Once we are done with our SSIS package, go to the Azure portal and create a storage account, then inside the storage account, we need to create two file share accounts, click on the file share under the Data storage tab, then click on the + File share button to create a new file share.
Name your file share and then click on create and then upload the package file and configuration file from the destination where we have saved these files.
How to Create SSIS Integration Runtime:
Open the Azure data factory, go to the Manage tab, click on integration runtimes, click on the + New button to create an Integration runtime.
Select Azure SSIS then click on continue.
Name your Integration Runtime, select your location, select node size, and number as per your requirement and budget, then click on continue.
Select the deployment settings and then click on the + New button.
Name your package store and click on + new to create a linked service that will be pointing to our package store.
Name your linked service, select the type, select your Azure subscription, Select the Storage account name, select the file share, and click on create.
Once our linked service is created click on Add.
Our SSIS package which is on file share is added, click on continue and then click on create.
How to Create A Pipeline to use SSIS package saved in Azure file share:
Go to the Author tab, click on pipelines then click on the new pipeline, find and drag the Execute SSIS package activity, then go to the Settings tab select Azure SSIS IR, provide the package location, provide the package path, provide the configuration path, select the domain, then provide the user name and password, and finally click on Debug to execute the SSIS package.
Go to the SSIS parameters tab, click on the + New button, select the scope, provide the name of the parameter which we created in our SSIS package, then provide the same values, and now our pipeline is ready to be executed, click on Debug to execute the SSIS package pipeline.
How to Schedule an SSIS package by using Azure Pipeline:
Click on Add Trigger button, select New/edit.
Name your trigger, select the type, select the start date and time, select your time zone, select the recurrence, select End date and time, select start trigger on the creation and then click on ok.
Video Demo: How to Deploy SSIS Project in Azure File Share and call SSIS Packages in Azure Data Factory Pipeline
No comments:
Post a Comment