Backup Script - Backing up my machine

Close Up of a USB Hard DriveClose Up of a USB Hard Drive Photo from Pexels

I keep a backup somewhat regularly and especially when I want to wipe and reinstall my OS once in a while (although it's very rare, and mostly I stick to Ubuntu distributions).

One issue that I have when I backup, is that the file permissions, get lost when I copy them to my 1TB Seagate HDD which is formatted with ExFAT as I want it to show up on both Windows and Linux and all others alike.

Recently I came across, a backup script on Ellie's wiki which is using tar to make tar.gz archives along with flags to permissions and ignore a bunch of local directories to skip while archiving.

Let's try this.

Supposing my test folder is ~/code/tmp which is where I keep a lot of well.. tmp things, I planned to archive this with some changed permissions such as a directory with no executable access, making it not possible to cd into, an executable shell script etc.

1$ ls -la
2
3total 10560
4drwxrwxr-x  6 dg dg     4096 Jan 18 23:54 .
5drwxr-xr-x 35 dg dg     4096 Jan 18 13:43 ..
6drwxrwxr-x  2 dg dg     4096 Jan 11 20:33 beamer-latex
7drwxr-xr-x  4 dg dg     4096 Jan 11 17:33 Eisvogel-3.0.0
8-rw-r--r--  1 dg dg 10783082 Jan 11 20:35 Eisvogel-3.0.0.tar.gz
9-r-xr-xr-x  1 dg dg       31 Jan 18 23:54 ex.sh
10drw-rw-r--  2 dg dg     4096 Jan  1 22:41 testpaper
11drwxrwxr-x  3 dg dg     4096 Jan 11 00:58 updog2

Here is the original script, which is MacOS specific, so on Linux some other exclusions might be useful.

1BACKUP=backup-macbook-$(date +%FT%H:%M:%S).tar.gz
2
3tar -cvpzf $BACKUP \
4    --exclude=$BACKUP \
5    --exclude=.cache \
6    --exclude=.debug \
7    --exclude=.local/lib \
8    --exclude=.local/share/virtualenvs \
9    --exclude=.recently-used \
10    --exclude=.thumbnails \
11    --exclude=.pyenv \
12    --exclude=.Trash \
13    --exclude=.npm \
14    --exclude=.poetry \
15    --exclude=.kube \
16    --exclude=.fastlane \
17    --exclude=.mix \
18    --exclude=.pyenv \
19    --exclude=.gem \
20    --exclude=.vscode \
21    --exclude=.cocoapods \
22    --exclude=Downloads \
23    --exclude=Library \
24    --exclude=Movies \
25    --exclude=Music \
26    --exclude=nltk_data \
27    --exclude=Pictures \
28    --exclude=pkg \
29    --exclude=Applications \
30    .

Let's try this out.

Here I ignore updog2, which is my local installation of a more maintained version of updog which I sometimes use to host my local computer and access on my phone or other local devices.

A simple search on PyPI also showed updog3, i might look that up later.

1BACKUP=backup-test-$(date +%FT%H:%M:%S).tar.gz
2tar -cvpzf $BACKUP \
3    --exclude=$BACKUP \
4    --exclude=updog2 \
5    .

It failed on a non writable directory with my user. I think I should actually have access to the directory if its owned by me, so the new permissions of that directory is as follows. The owner has all permissions to read, write and execute into directories.

1total 28
2drwxrwxr-x  6 dg dg 4096 Jan 19 00:19 .
3drwxr-xr-x 35 dg dg 4096 Jan 18 13:43 ..
4drwxrwxr-x  2 dg dg 4096 Jan 11 20:33 beamer-latex
5drwxr--r--  4 dg dg 4096 Jan 11 17:33 Eisvogel-3.0.0
6-r-xr-xr-x  1 dg dg   31 Jan 18 23:54 ex.sh
7drwxr--r--  2 dg dg 4096 Jan  1 22:41 testpaper
8drwxrwxr-x  3 dg dg 4096 Jan 11 00:58 updog2

Okay it completed to give this:

1-rw-rw-r-- 1 dg dg 11327475 Jan 19 00:22 backup-test-2025-01-19T00-22-59.tar.gz

Okay copying it to my HDD and back again clearly messed up my permissions (notice all the executable bits and stuff)

1.rwxr-xr-x   11M dg   19 Jan 00:22  backup-test-2025-01-19T00-22-59.tar.gz

Doing a tar xzvf <file>.tar.gz seemed to go on normally as expected and preserved permissions, so I am back with original file permissions. The directory still does not have group and world write perms and my script is not writable.

1total 11088
2
3drwxrwxr-x  5 dg dg     4096 Jan 19 00:19 .
4drwxr-xr-x 35 dg dg     4096 Jan 19 00:24 ..
5-rwxr-xr-x  1 dg dg 11327475 Jan 19 00:22 backup-test-2025-01-19T00-22-59.tar.gz
6drwxrwxr-x  2 dg dg     4096 Jan 11 20:33 beamer-latex
7drwxr--r--  4 dg dg     4096 Jan 11 17:33 Eisvogel-3.0.0
8-r-xr-xr-x  1 dg dg       31 Jan 18 23:54 ex.sh
9drwxr--r--  2 dg dg     4096 Jan  1 22:41 testpaper

To further encrypt stuff which is possibly wanted, we can use GPG as a handy tool for encryption:

1gpg --symmetric --cipher-algo AES256 $BACKUP

It will ask for a passphrase twice and then spit out a .gpg file.

1.rw-rw-r-- 11M dg 19 Jan 00:35 backup-test-2025-01-19T00-34-31.tar.gz.gpg

Decrypting the encrypted archive with gpg:

Syntax from Superuser

1gpg --output destination --decrypt sourcefile.gpg

So for example on my archive

1$ EXTRACTED=backup-test-2025-01-19T00-34-31.tar.gz
2$ gpg --output $EXTRACTED --decrypt $EXTRACTED.gpg
3gpg: AES256.CFB encrypted data
4gpg: encrypted with 1 passphrase

Then extract the `tar.gz` file normally,

1tar xvf $EXTRACTED