Delhi_Meetup_flyway_Integration.pptx

Delhi MuleSoft Meetup
Flyway Integration with MuleSoft
27th Aug 2022
11:00 AM IST

Today’s Meetup Host
https://t.me/muleSoftStation

Shyam Raj Prasad
Senior Principal Engineer
Tricon Infotech Private Limited
About: Shyam Raj Prasad
● Working as Senior Principal Engineer at Tricon Infotech
Private Limited.
● 12+ years of Total Experience.
● 4+ years experience in Mulesoft.
● Certified MuleSoft Developer and Architect.
● Certified Liquibase Fundamentals
● Active on mulesoft help forum
Speaker

● Both the speaker and the host are organizing this meet-up in individual capacity only. We are
not representing our companies here.
● This presentation is strictly for learning purposes only. Organizer/Presenter do not hold any
responsibility that same solution will work for your business requirements.
● This presentation is not meant for any promotional activities.
5
Safe Harbour Statement

A recording of this meetup will be uploaded to events page within 24 hours.
Questions can be submitted/asked at any time in the Chat/Questions & Answers Tab.
Make it more Interactive!!!
Give us feedback! Rate this meetup session by filling feedback form at the end of the day.
We Love Feedbacks as it helps us to improve the sessions.
6
Housekeeping

7
A SHOW OF HANDS:
New Members With Us.!!
CHEERS…!!!
We have prizes to give away!
3 Winners a special prize is ready

Flyway
Database Change Management

9
Agenda
● Why Database Migrations?
● Flyway Introduction
● Flyway Migrations
● Flyway Commands
● Demo

10
● Multiple test and production stages
● Complicated in-house solution
● Goals:
○ Automatic deployment of database changes
○ Avoidance of human error factor
○ Control of the update process
Motivation

11
● Never use a shared database server for development work
● Always have a single, authoritative source for your schema
● Always version your database
Three rules for Database Work

12
● Treat database migrations as integral part of the project(db scripts
checked in source code repository)
● Fail-fast: check/migrate database at app startup
● Continuous Database integration
Best Practices

13
“Continuous Database Integration (CDBI) is the process of rebuilding
your database and test data at any time a change is applied to a
project’s version control repository”
(P. M. Duvall, S. Matyas, A. Glover, Continuous Integration)
Continuous Database Integration

14
● Liquibase
● Flyway
● MyBatis
● And a few dead projects:
○ dbdeploy(2009)
○ Migratedb(2014)
○ migrate4j(2008)
○ dbmaintain(2011)
○ autopatch(2014)
Database Migration Tools

15
● We used to maintain DB scripts(text based) and add them manually
to DB
● But there are more issues
○ easy to lost sync between code and DB state
○ hard to recover from error during development (ex: in case of applying
wrong statement to DB)
○ often require to re-create DB from scratch during development
○ hard to find out state of particular DB environment
● For these issues, Liquibase/flyway is a good solution
Why Database Migration tools ?

Development: Database side (1/2)
17

Development: Database side (2/2)
18

Let’s focus on database for once
20

Ever considered database migration?
21
Flyway

22
● Solves only one problem and solves it well
● Lightweight and easy to set up
● Continuous delivery - migrate database changes on application
startup or as a build pipeline
● Plain SQL update scripts
● Convention over configuration
Flyway

23
● Aurora MySQL
● Aurora PostgresSQL
● Azure Synapse
● Google BigQuery
● Cloud Spanner
● Cockroach DB
● DB2
● Derby
● Firebird
● H2
● HSQLDB
● Informix
● MariaDB
Supported Databases
● MySQL
● Oracle
● Persona XtraDB cluster
● PostgresSQL
● Redshift
● SAP Hana
● Snowflake
● SQLIte
● SQL Server
● Sybase ASE
● Test Containers
● TimeScale DB
● TIDB
● YugaByte DB

Inside flyway_schema_history table
27

30
● Two types of Migrations
○ SQL-based
■ DDL Changes (CREATE/ALTER/DROP statements for tables,
views, triggers, sequences)
■ Simple reference data changes (CRUD in reference data
tables)
■ Simple bulk data changes (CRUD in regular data tables)
○ Java-based
Flyway Migrations

Flyway Migrations Naming
34
In order to be picked up by Flyway, SQL
migrations must comply with the following
naming pattern:
● Prefix: V for versioned (configurable),
U for undo (configurable)and R for
repeatable migrations (configurable)
● Version: Version with dots or
underscores separate as many parts as
you like (Not for repeatable migrations)
● Separator: __ (two underscores)
(configurable)
● Description: Underscores or spaces
separate the words
● Suffix: .sql (configurable)

Where to store the migrations?
35

Where to store the migrations?
36
Flyway discovers SQL-based migrations from one or more directories referenced
by the locations property.
● Unprefixed locations or locations with the classpath: prefix target the Java
classpath.
● Locations with the filesystem: prefix search the file system.
● Locations with the s3: prefix search AWS S3 buckets. To use AWS S3, the
AWS SDK v2 and dependencies must be included, and configured for your
S3 account.
● Locations with the gcs: prefix search Google Cloud Storage buckets. To use
GCS, the GCS library must be included, and the GCS environment variable
GOOGLE_APPLICATION_CREDENTIALS must be set to the credentials file
for the service account that has access to the bucket.

Let’s migrate using maven
38

Let’s migrate using maven
39

Flyway commands
40
Migrates the database Drops all objects in the configured
schemas
Prints the details and status
information about all the migrations
Validates the applied migrations
against the ones available on the
classpath
Repairs the schema history table
Baselines an existing database

43
●Nominate yourself for the next meetup speaker and suggest a topic as well.
Take a Stand !

Get ready to WIN a Special Gift from MuleSoft Community
Quiz Time

45
● Share:
○ Tweet your pictures using the hashtag #MuleSoftMeetup
○ Invite your network to join: https://meetups.mulesoft.com/delhi/
● Feedback:
○ Fill out the survey feedback and suggest topics for upcoming events
○ Contact MuleSoft at meetups@mulesoft.com for ways to improve the program
○ Reach out to Delhi Meetup Leaders to suggest topics for next Meetup
What’s Next ?

46
● Anurag Sharma : https://www.linkedin.com/in/anurag-sharma-59745b20/
● Ankit Lawaniya: https://www.linkedin.com/in/ankit-lawaniya/
● Pryank Gupta: https://www.linkedin.com/in/gupta-pryank-24a1293b/
● Abhay Aggarwal: https://www.linkedin.com/in/abhay-agarwal-851121112/
● Minni Jajodia : https://www.linkedin.com/in/minni-jajodia/
Organizers :
Contact us for any query related to Today’s Meetup

Delhi_Meetup_flyway_Integration.pptx

Thank you
Don’t forget to provide the Feedback of this meetup

Delhi_Meetup_flyway_Integration.pptx

More Related Content

Similar to Delhi_Meetup_flyway_Integration.pptx (20)

More from AnuragSharma900 (7)

Recently uploaded (20)

Delhi_Meetup_flyway_Integration.pptx