How to backup a linux server to another storage while there is not enough storage space in the system

Yusuf gndz

8/3/24, 1:17 PM

For example I have a ubuntu server 20.04 with 200gb disk and 150gb of that storage is full.

And I want to backup the data in this system to a remote system.

Is there a way to push all the data to S3 async?
If I want to target a docker db and files inside a docker what should I do?
I already have a backup system but as in this example when the storage is not enough. process will be cut in half when the system tries to save files to local file system.

What ways do I have to be able to save my system to a remote system? I have more than 100 servers like this and some of the servers are like 50gb full in 200gb and some are 1.3tb full in 1.6tb. So because some servers are this way. I am asking here.

0 + 7

linux

ubuntu

backup

incremental-backup

docker

alexus

8/3/24, 2:07 PM

i'd try to free up the space first: `docker system prune --all --force --volumes` & `apt-get clean`, etc.. then worry about syncing files...

Yusuf gndz

8/3/24, 2:48 PM

@alexus My issue is I can't cleanup any space. Those files are our user's media files so There is no way I can delete them

paladin

8/3/24, 2:52 PM

First you determine how much total space you need for a backup of all your machines. Then you create a system which has that amount of total space free. Then you backup all files to that system. How hard can it be? I also don't see why local free space should be a limiting factor when doing a remote backup .

djdomi

8/3/24, 3:26 PM

hm you may use duplicacy to push from inside, or veeam can do the job from outside

tsc_chazz

8/3/24, 3:28 PM

@paladin many backup techniques rely on making a local copy first, compressing in place, and then moving the compressed files because they use `gzip`. @Yusuf gndz a simple option is to mount an external drive with NFS and then `rsync` to it.

paladin

8/3/24, 3:31 PM

@tsc_chazz In my opinion those are not backup-programs, those are trash programs. Delete this useless shit and use better programs or mechanics. rsync & Co can and should compress data while transferring on-the-fly.

Yusuf gndz

8/3/24, 3:40 PM

Any source for remote backup? In my case I don't want to store backup files in the server I am going to backup. I will be checking rsync. Also because I need like more than 100tb backup storage is it possible to use s3 or do you have any recommendation?

Elon Musk

I sit in a Tesla and translated this thread with Ai:

EN: How to backup a linux server to another storage while there is not enough storage space in the system

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.