From the course: Advanced Data Engineering with Snowflake
Unlock this course with a free trial
Join today to access over 24,800 courses taught by industry experts.
Set up the data pipeline using snowflake CLI - Snowflake Tutorial
From the course: Advanced Data Engineering with Snowflake
Set up the data pipeline using snowflake CLI
Now that we've connected Snowflake to the GitHub repo, let's set up our pipeline. To complete this exercise, be sure you completed the instructions and the reading that precedes this video. We'll need to do two things. First, load the data for the pipeline, and second, build the pipeline objects using that data. To do this, we're going to use Snowflake CLI. What is Snowflake CLI? It's the command line interface for working with Snowflake. It is super powerful and can do many things with your Snowflake projects. For example, you can use it to start Snowpark objects, execute Snowflake notebooks and SQL directly from the command line, bootstrap a Snowflake native app, and much more. We're specifically going to use the CLI's snow git execute command. This command will execute a file or a series of files in a repository path. These files can be SQL files or Python files. Here's how we'll use it. We'll use this command to set up our data environment in Snowflake. We'll run this command…
Contents
-
-
-
DevOps in the world of data engineering4m 13s
-
(Locked)
DevOps with Snowflake3m 1s
-
(Locked)
What we'll build1m 21s
-
(Locked)
Source control in Snowflake with Git7m 51s
-
(Locked)
Set up the data pipeline using snowflake CLI10m 43s
-
(Locked)
Database change management (DCM)6m 23s
-
(Locked)
Declarative approach with CREATE OR ALTER13m 58s
-
(Locked)
Continuous integration and continuous delivery (CI/CD) for data pipelines4m 1s
-
(Locked)
Implementing continuous delivery for our data pipeline12m 10s
-
(Locked)
Recap and best practices for DevOps with Snowflake2m 22s
-
-