Copying data to an on-premises cluster
In this recipe, we'll add a package that will copy local data to the local cluster.
Getting ready
This recipe assumes that you have access to an on-premises cluster and have created a folder to hold the files in it from the previous recipe.
How to do it...
- In the solution explorer, open (expand) the
ETL.DWproject and right-click on it to add a new package. Name itFactOrdersToHDPCuster.dtsx.
- Go to the
Parameterstab and add a new parameter:Name:LoadExecutionIdData type:Int64Value: Leave the default value0Sensitive: Leave the default valueFalseRequired:True
- Add a data flow task on the control flow and name it
dft_FactOrders. - In the data flow task, drag and drop an OLE DB source. Name it
ole_src_DW_vwFactOrders. - Double-click on it to open the OLE DB source editor.
- Set the OLE DB connection manager to
cmgr_DW. - For data access mode, use the SQL command.
- Set the SQL command text to the following:
SELECT OrderDate, FirstName, LastName, CompanyName, Category...
