SlideShare a Scribd company logo
Linux backup system Backup files from Linux laptop to Linux server All automated (ie I don't think about it) Use simple standard Linux command-line tools
Motivation
My situation Laptop that goes everywhere – my primary workstation Server, sits in my apartment. Doesn't do much other then hold files + serve as test bed for the occassional wacky experiment Wireless network
What I did Cron job on laptop which runs rsync script to mirror changes nightly at 10:10pm Monthly which takes a snapshot of subset of files and pushes these to Amazon S3 [Still in the future] Nightly rsync from server to Amazon S3
S3FOX
Rsync Is awesome! ” is an open source utility that provides fast incremental file transfer” - samba.anu.edu.au/rsync/ Used for mirroring + backup purpose
Cron ” Program that enables unix users to execute commands or scripts automatically at a specified time/date.” - Wikipedia Used extensively by all *nix systems and aspiring amateur Linux sysadmins
Tar + gzip Tar turns many files into one file – no built-in compression Commonly used with gzip or bzip2 (making, respectively *.tar.gz and *.tar.bz2 files
Unix Philosophy Do one thing and do it well Rsync, tar, gzip, cron all do one task well
Small pieces loosly joined Tools reusable Designed to interoperate Can be used together in scripts in 1000s of different ways
Easier to learn Use these different tools all the time Rsync to mirror changes from laptop to production (or devel) server Tar to uncompress files from internet Makes it easier to start a new scripting project
K.I.S.S Keep It Simple Stupid Simple tools make for simple systems that are easy to build, understand, and maintain
Odes to Simplicity ” Everything should be made as simple as possible, but no simpler.” – Albert Einstein "Simplicity is the ultimate sophistication" – Leonardo Da Vinci "It seems that perfection is reached not when there is nothing left to add, but when there is nothing left to take away" – Antoine de Saint Exupéry
Backups = peace of mind
 

More Related Content

What's hot (20)

PDF
Warsztaty ansible
gnosek
 
PDF
Getting instantly up and running with Docker and Symfony
André Rømcke
 
DOCX
Clustering manual
Md. Mahedi Mahfuj
 
PDF
Docker
Kamil Grabowski
 
ODP
Linuxday.at - Lightning Talk
Jan Gehring
 
PPTX
Docker techzone
Bjørn Nordlund
 
PPTX
How to configure multiple PostgreSQL-9
Vivek Singh
 
PDF
Dockerizing Symfony Applications - Symfony Live Berlin 2014
D
 
PDF
Hybrid (Windows + Linux) Apps with Docker Swarm
Runcy Oommen
 
PDF
Testing Ansible with Jenkins and Docker
Dennis Rowe
 
PDF
Docker up and running
Victor S. Recio
 
ODP
Fabric: A Capistrano Alternative
Panoptic Development, Inc.
 
PDF
Fun with containers: Use Ansible to build Docker images
abadger1999
 
PDF
Launching containers with fleet
충섭 김
 
PDF
Fedora Atomic Host
rranjithrajaram
 
PPTX
Dockerize Me: Distributed PHP applications with Symfony, Docker, Consul and A...
Alexey Petrov
 
PPTX
Docker 101 & Workshop
Elton Stoneman
 
PDF
How to contribute Apache CloudStack
Go Chiba
 
PPTX
Dockerizing a Symfony2 application
Roman Rodomansky
 
PDF
Declare your infrastructure: InfraKit, LinuxKit and Moby
Moby Project
 
Warsztaty ansible
gnosek
 
Getting instantly up and running with Docker and Symfony
André Rømcke
 
Clustering manual
Md. Mahedi Mahfuj
 
Linuxday.at - Lightning Talk
Jan Gehring
 
Docker techzone
Bjørn Nordlund
 
How to configure multiple PostgreSQL-9
Vivek Singh
 
Dockerizing Symfony Applications - Symfony Live Berlin 2014
D
 
Hybrid (Windows + Linux) Apps with Docker Swarm
Runcy Oommen
 
Testing Ansible with Jenkins and Docker
Dennis Rowe
 
Docker up and running
Victor S. Recio
 
Fabric: A Capistrano Alternative
Panoptic Development, Inc.
 
Fun with containers: Use Ansible to build Docker images
abadger1999
 
Launching containers with fleet
충섭 김
 
Fedora Atomic Host
rranjithrajaram
 
Dockerize Me: Distributed PHP applications with Symfony, Docker, Consul and A...
Alexey Petrov
 
Docker 101 & Workshop
Elton Stoneman
 
How to contribute Apache CloudStack
Go Chiba
 
Dockerizing a Symfony2 application
Roman Rodomansky
 
Declare your infrastructure: InfraKit, LinuxKit and Moby
Moby Project
 

Similar to Linux Backup System using rsync, tar, gzip (20)

PDF
Backup UUASC 9/6/12
Chason Chaffin
 
PDF
OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...
NETWAYS
 
DOCX
lec5+.docx
ismailaboshatra
 
PDF
Backups
Svet Ivantchev
 
PDF
Linux backup
Alec Clews
 
PDF
I am in need of two separate files that I can save independently.pdf
brijeshagarwa329898l
 
PPT
Basic Linux day 6
Saikumar Daram
 
PDF
Deploying secure backup on to the Cloud
Lahav Savir
 
ZIP
Back Up 101
Gowtham
 
PPT
101 apend. backups
Acácio Oliveira
 
PPTX
12 linux archiving tools
Shay Cohen
 
PDF
Backup and restore in linux
Mohammed Yazdani
 
PPT
4.8 apend backups
Acácio Oliveira
 
ODP
Nguyễn Vũ Hưng: Basic Linux Power Tools
Vu Hung Nguyen
 
PDF
Setting up Puppet at Colruyt
Puppet
 
PDF
Unix reference sheet
apajadeh
 
PDF
LinuxTag2012 Rear
Gratien D'haese
 
PDF
Linuxcon​ 2013
Sirinart Khongyadee
 
PDF
Rman Presentation
Rick van Ek
 
PDF
6 examples to backup linux using dd command (including disk to disk)
chinkshady
 
Backup UUASC 9/6/12
Chason Chaffin
 
OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...
NETWAYS
 
lec5+.docx
ismailaboshatra
 
Linux backup
Alec Clews
 
I am in need of two separate files that I can save independently.pdf
brijeshagarwa329898l
 
Basic Linux day 6
Saikumar Daram
 
Deploying secure backup on to the Cloud
Lahav Savir
 
Back Up 101
Gowtham
 
101 apend. backups
Acácio Oliveira
 
12 linux archiving tools
Shay Cohen
 
Backup and restore in linux
Mohammed Yazdani
 
4.8 apend backups
Acácio Oliveira
 
Nguyễn Vũ Hưng: Basic Linux Power Tools
Vu Hung Nguyen
 
Setting up Puppet at Colruyt
Puppet
 
Unix reference sheet
apajadeh
 
LinuxTag2012 Rear
Gratien D'haese
 
Linuxcon​ 2013
Sirinart Khongyadee
 
Rman Presentation
Rick van Ek
 
6 examples to backup linux using dd command (including disk to disk)
chinkshady
 
Ad

More from Kyle Mathews (11)

PPTX
Presentation on Gatsby to SF Static Web Tech Meetup
Kyle Mathews
 
PPT
Eduglu presentation at TTIX
Kyle Mathews
 
PPT
Presentation on Eduglu from Drupalcon SF
Kyle Mathews
 
ODP
Designing and using group software through patterns
Kyle Mathews
 
ODP
Drupal Training#2 Cck Views
Kyle Mathews
 
ODP
Drupal Training #1
Kyle Mathews
 
PPT
Building Social Networks in the University -- Ignite Salt Lake 2
Kyle Mathews
 
PPT
Drupalcon Dc Presentation
Kyle Mathews
 
PPT
Enterprise 2.0
Kyle Mathews
 
PPT
Chapter 4 - Light the Fire
Kyle Mathews
 
PPT
Chapter 4 - Light the Fire
Kyle Mathews
 
Presentation on Gatsby to SF Static Web Tech Meetup
Kyle Mathews
 
Eduglu presentation at TTIX
Kyle Mathews
 
Presentation on Eduglu from Drupalcon SF
Kyle Mathews
 
Designing and using group software through patterns
Kyle Mathews
 
Drupal Training#2 Cck Views
Kyle Mathews
 
Drupal Training #1
Kyle Mathews
 
Building Social Networks in the University -- Ignite Salt Lake 2
Kyle Mathews
 
Drupalcon Dc Presentation
Kyle Mathews
 
Enterprise 2.0
Kyle Mathews
 
Chapter 4 - Light the Fire
Kyle Mathews
 
Chapter 4 - Light the Fire
Kyle Mathews
 
Ad

Recently uploaded (20)

PDF
Building Resilience with Digital Twins : Lessons from Korea
SANGHEE SHIN
 
PDF
LLMs.txt: Easily Control How AI Crawls Your Site
Keploy
 
PDF
NewMind AI Journal - Weekly Chronicles - July'25 Week II
NewMind AI
 
PDF
SWEBOK Guide and Software Services Engineering Education
Hironori Washizaki
 
PPTX
AUTOMATION AND ROBOTICS IN PHARMA INDUSTRY.pptx
sameeraaabegumm
 
PPTX
Building a Production-Ready Barts Health Secure Data Environment Tooling, Acc...
Barts Health
 
PDF
Smart Trailers 2025 Update with History and Overview
Paul Menig
 
PDF
Jak MŚP w Europie Środkowo-Wschodniej odnajdują się w świecie AI
dominikamizerska1
 
PPTX
Top iOS App Development Company in the USA for Innovative Apps
SynapseIndia
 
PDF
CIFDAQ Token Spotlight for 9th July 2025
CIFDAQ
 
PDF
Blockchain Transactions Explained For Everyone
CIFDAQ
 
PDF
HubSpot Main Hub: A Unified Growth Platform
Jaswinder Singh
 
PDF
Windsurf Meetup Ottawa 2025-07-12 - Planning Mode at Reliza.pdf
Pavel Shukhman
 
PDF
Using FME to Develop Self-Service CAD Applications for a Major UK Police Force
Safe Software
 
PDF
Why Orbit Edge Tech is a Top Next JS Development Company in 2025
mahendraalaska08
 
PPT
Interview paper part 3, It is based on Interview Prep
SoumyadeepGhosh39
 
PPTX
✨Unleashing Collaboration: Salesforce Channels & Community Power in Patna!✨
SanjeetMishra29
 
PDF
Presentation - Vibe Coding The Future of Tech
yanuarsinggih1
 
PPTX
Webinar: Introduction to LF Energy EVerest
DanBrown980551
 
PDF
Complete JavaScript Notes: From Basics to Advanced Concepts.pdf
haydendavispro
 
Building Resilience with Digital Twins : Lessons from Korea
SANGHEE SHIN
 
LLMs.txt: Easily Control How AI Crawls Your Site
Keploy
 
NewMind AI Journal - Weekly Chronicles - July'25 Week II
NewMind AI
 
SWEBOK Guide and Software Services Engineering Education
Hironori Washizaki
 
AUTOMATION AND ROBOTICS IN PHARMA INDUSTRY.pptx
sameeraaabegumm
 
Building a Production-Ready Barts Health Secure Data Environment Tooling, Acc...
Barts Health
 
Smart Trailers 2025 Update with History and Overview
Paul Menig
 
Jak MŚP w Europie Środkowo-Wschodniej odnajdują się w świecie AI
dominikamizerska1
 
Top iOS App Development Company in the USA for Innovative Apps
SynapseIndia
 
CIFDAQ Token Spotlight for 9th July 2025
CIFDAQ
 
Blockchain Transactions Explained For Everyone
CIFDAQ
 
HubSpot Main Hub: A Unified Growth Platform
Jaswinder Singh
 
Windsurf Meetup Ottawa 2025-07-12 - Planning Mode at Reliza.pdf
Pavel Shukhman
 
Using FME to Develop Self-Service CAD Applications for a Major UK Police Force
Safe Software
 
Why Orbit Edge Tech is a Top Next JS Development Company in 2025
mahendraalaska08
 
Interview paper part 3, It is based on Interview Prep
SoumyadeepGhosh39
 
✨Unleashing Collaboration: Salesforce Channels & Community Power in Patna!✨
SanjeetMishra29
 
Presentation - Vibe Coding The Future of Tech
yanuarsinggih1
 
Webinar: Introduction to LF Energy EVerest
DanBrown980551
 
Complete JavaScript Notes: From Basics to Advanced Concepts.pdf
haydendavispro
 

Linux Backup System using rsync, tar, gzip

  • 1. Linux backup system Backup files from Linux laptop to Linux server All automated (ie I don't think about it) Use simple standard Linux command-line tools
  • 3. My situation Laptop that goes everywhere – my primary workstation Server, sits in my apartment. Doesn't do much other then hold files + serve as test bed for the occassional wacky experiment Wireless network
  • 4. What I did Cron job on laptop which runs rsync script to mirror changes nightly at 10:10pm Monthly which takes a snapshot of subset of files and pushes these to Amazon S3 [Still in the future] Nightly rsync from server to Amazon S3
  • 6. Rsync Is awesome! ” is an open source utility that provides fast incremental file transfer” - samba.anu.edu.au/rsync/ Used for mirroring + backup purpose
  • 7. Cron ” Program that enables unix users to execute commands or scripts automatically at a specified time/date.” - Wikipedia Used extensively by all *nix systems and aspiring amateur Linux sysadmins
  • 8. Tar + gzip Tar turns many files into one file – no built-in compression Commonly used with gzip or bzip2 (making, respectively *.tar.gz and *.tar.bz2 files
  • 9. Unix Philosophy Do one thing and do it well Rsync, tar, gzip, cron all do one task well
  • 10. Small pieces loosly joined Tools reusable Designed to interoperate Can be used together in scripts in 1000s of different ways
  • 11. Easier to learn Use these different tools all the time Rsync to mirror changes from laptop to production (or devel) server Tar to uncompress files from internet Makes it easier to start a new scripting project
  • 12. K.I.S.S Keep It Simple Stupid Simple tools make for simple systems that are easy to build, understand, and maintain
  • 13. Odes to Simplicity ” Everything should be made as simple as possible, but no simpler.” – Albert Einstein "Simplicity is the ultimate sophistication" – Leonardo Da Vinci "It seems that perfection is reached not when there is nothing left to add, but when there is nothing left to take away" – Antoine de Saint Exupéry
  • 14. Backups = peace of mind
  • 15.