Issue : How to upload files from On-Prem to Azure Data Lake Gen2 by using SSIS Package
In this article we are going to learn how to upload files from on-premises to Azure data lake Gen2, by using the (SSIS) SQL Server Integration Sservices package, first of all, we have to create azure data lake storage Generation 2, for creating ADLS Gen2, Open Azure Portal, and in the search bar search for the Storage accounts, and click on that, it will open a page just fill the required fields as shown in the picture below, which are, Subscription, Resource group, Storage account name, region, performance, Redundancy and then click on advance and select the ''Enable Hierarchical namespace'' which means ADLS Gen2 type of storage, if you don't do that that will be create a normal blob storage, click Review + create and then click on Create.
Meanwhile, the Azure Data Lake Storage Gen2 is being created, let's go to Visual Studio 2017, and create SQL Server Integration Package, for creating SSIS package, Click on File then click on new + project then select integration services project then name the project and click ok as shown in the picture below.
Once our SQL Server Integration Services package is created right-click on the project and go to the properties and change the target server version, in my case I am using visual studio 2017, change it 2017, and click ok, now go to the toolbox at the left side and click on the ''flexible file task'' under the azure tab and drag it, double click on that a new window will open which is shown in the picture below, in this window gove the source folder path, then source file name, select the destination connection type and then create a connection, click on the new connection and select the ''Data Lake Storage Gen2'', then give the account name, account key and then click ok, as the connection is made then select the Destination Folder path in my case it in ''Input'', then provide the file path and click ok and Execute the task.
No comments:
Post a Comment