From the course: Advanced Data Engineering with Snowflake

Unlock this course with a free trial

Join today to access over 24,800 courses taught by industry experts.

Set up the data pipeline using snowflake CLI

Set up the data pipeline using snowflake CLI - Snowflake Tutorial

From the course: Advanced Data Engineering with Snowflake

Set up the data pipeline using snowflake CLI

Now that we've connected Snowflake to the GitHub repo, let's set up our pipeline. To complete this exercise, be sure you completed the instructions and the reading that precedes this video. We'll need to do two things. First, load the data for the pipeline, and second, build the pipeline objects using that data. To do this, we're going to use Snowflake CLI. What is Snowflake CLI? It's the command line interface for working with Snowflake. It is super powerful and can do many things with your Snowflake projects. For example, you can use it to start Snowpark objects, execute Snowflake notebooks and SQL directly from the command line, bootstrap a Snowflake native app, and much more. We're specifically going to use the CLI's snow git execute command. This command will execute a file or a series of files in a repository path. These files can be SQL files or Python files. Here's how we'll use it. We'll use this command to set up our data environment in Snowflake. We'll run this command…

Contents