Please wait...
"we promise"
Ya.. no thanks.
Fri Feb 03 2023 06:00:51 PM EST from IGnatius T Foobar Subject: Re: Ding dong, proprietary Unix is dead.Other possibilities are dual-licensing (GPL and BSD) or, as Linus has called for, a covenant not to sue over OpenZFS.
Subject: Re: Ding dong, proprietary Unix is dead.
I get it, Oracle is not a well loved or trusted company.
And if that is to be the case, then btrfs will keep getting improved until it reaches feature parity with ZFS, and that'll be the end of that.
It's their choice, really.
Ok so ran across something last night, and dont see a fix so looking for alternatives..
Been seeing the issue where my rsync backup drive of my home directory fills up.. have to erase and start over. Yet my home directory is not that big. Has not been a huge deal so i been putting it off.
Last night i forgot to empty trash before i did a backup ."damn, that is 75g ... let me empty it and run sync again " . But in logs it didnt actually delete anything. Turns out that if you have a hidden folder rsync will copy new items to the destination, but if you remove the file, it ignores it .. if you delete the entire folder, it will sync that change.
So as cache files and such build ( browsers, etc ) in the hidden folders, it just keeps accumulating on my backup.. until poof, its full.
Trying to search around for an alternative, which i have never cared to do, rsync has always done ok for me for all these years, and all i get is commercial cloud crap. Yes i could erase/copy full each time, but when 90% of my flies don't change its wasted time and extra stress on my ssd for no reason. ( and since i have 3 backups, one i take off-site, even more wasted time )
Ya, i do have that as a parameter. and it does delete a dot folder ( and any files in it ), and files that were in regular folders, fine. Its just files inside a dot folder that didnt get deleted that its ignoring once they are written to the destination..
( user name changed due to the obvious reasons ) -> rsync -azvh --delete '/home/xxxx' '/media/xxxx/357c67df-e734-431f-8adc-a40366d690a8/' ( that mess that looks a bit like a UUID is how one my external SSD shows up and its not worth me changing it really, its scripted, i dont type it. The one i send off site is a veracrypt drive instead and it does the same thing. )
Going to install an older version of Debian ( buster ) later this week and try it there, as i wonder if its a bug in bookworm. But i think i had this problem as far back as stretch. Before that i did backups differently and just a zip of separate folders.. ( since tar wont do a 'sync' on updates very well ) but having files 'open' is far more convenient, and i could just shove the drive into a new PC and mount it as my home.. instantly be back and running.
Sun Mar 26 2023 09:25:17 PM EDT from zelgomer--delete delete extraneous files from dest dirs
Bleh typo.
"files in a dot folder that got deleted" not didnt.. of course it wont delete files that are still in the source.. :) Just delete the extra word delete i had :) rsync reached out and grabbed my keyboard :)
I actually ended up writing my own backup scripts. I wanted something that would generate incremental snapshots while my archive medium is not connected. Then, once a month or so, I connect the medium and tell it to "replay" the snapshots into their final destination. So it actually keeps track of a list of files that should be in each snapshot, and then only records the files that have changed. When I "replay", then it creates a new snapshot from the previous snapshot with "cp -l", identifies files that were copied which don't exist in the target snapshot's file list and deletes them, and then unpacks the incremental snapshot over it.
I remember when I was younger, earlier versions of Windows used to have a concept of a briefcase directory. As a kid, I didn't pay much attention to it - "briefcase" sounds like something my Dad would take to the office, and not at all like DooM or Commander Keen, which is what computers were really for. Ironically, I think that what I've ended up writing is pretty similar to that old Windows briefcase concept.
sure, i can, but hate to go to all hat trouble when rsync *should* do this out of the box. I could always go back to zip, just was a nice feature to have it 'plug and play' if i got into a jam. i dont do it so much to recover a file from an 'oh crap' moment, its more for disaster recovery.
For all my other items i backup, rsync works well, no funny folders to deal with, its just my actual home directory that is causing me issues.
Mon Mar 27 2023 10:51:03 AM EDT from zelgomerBy the way, if it comes to it, you may have to implement your own "generate a list of files and then go find and delete the chaff" script. A verbose flag to rsync may help to generate the list of wheat files for you.
$ mkdir -p src/.config dest
$ cd src
$ touch one .config/two .config/three four
$ rsync -a --delete . ../dest/
$ rm one .config/two
$ rsync -a -v --delete . ../dest/
sending incremental file list
deleting one
./
deleting .config/two
.config/
sent 154 bytes received 45 bytes 398.00 bytes/sec
total size is 9 speedup is 0.05
$ rm .config/three
$ rsync -a -v --delete . ../dest/
sending incremental file list
deleting .config/three
.config/
sent 122 bytes received 33 bytes 310.00 bytes/sec
total size is 5 speedup is 0.03
What version and what OS? I suspect i have a bug in my version, and the one before it ( i think i cant be 100% sure now ) version 3.2.7 protocol version 31 - bookworm
in my case it would be
First
- create /house/.files
- add /house/.files/bla.txt
rsync.. adds folder and file.
Then
- Delete /house/.files/bla.txt
rsync:
- ignores change and leaves bla.txt
Then
- Add /house/.files/blue.txt
- still ignores the fact bla.txt is gone
- adds blue.txt
- delete entire folder /house/.files
rsync
- removes folder and both files
But adding/removing files from root of /house/ works fine.
The python code GPT-3.5 gave me ( since i wont pay for GPT4 ) looked good doing a review, tested.. works like its supposed to.
Sure, not as many features ( like ssh, compression, bla bla ), and not as efficient, but it will do what i want..
2023-03-27 19:30 from Nurb432 <nurb432@uncensored.citadel.org>
What version and what OS? I suspect i have a bug in my version, and
My test came from RHEL 8, rsync 3.1.3, protocol version 31.
Ah, an older version..
Tomorrow going to install a test vm and get an older version of rsync on it ..
Mon Mar 27 2023 05:33:16 PM EDT from zelgomer2023-03-27 19:30 from Nurb432 <nurb432@uncensored.citadel.org>
What version and what OS? I suspect i have a bug in my version, and
My test came from RHEL 8, rsync 3.1.3, protocol version 31.
2023-03-26 10:52 from Nurb432
Ok so ran across something last night, and dont see a fix so looking
for alternatives..
Been seeing the issue where my rsync backup drive of my home
directory fills up.. have to erase and start over. Yet my home
directory is not that big. Has not been a huge deal so i been
putting it off.
Last night i forgot to empty trash before i did a backup ."damn, that
is 75g ... let me empty it and run sync again " . But in logson my backup.. until poof, its
it didnt actually delete anything. Turns out that if you have a
hidden folder rsync will copy new items to the destination, but if
you remove the file, it ignores it .. if you delete the
entire folder, it will sync that change.
So as cache files and such build ( browsers, etc ) in the hidden
folders, it just keeps accumulating
full.
Trying to search around for an alternative, which i have never cared
to do, rsync has always done ok for me for all these years, and all i
get is commercial cloud crap. Yes i could erase/copy full each
time, but when 90% of my flies don't change its wasted time and extra
stress on my ssd for no reason. ( and since i have 3 backups, one i
take off-site, even more wasted time )
rsync has a flag for propagating deletions. I think it is --delete.
If you are sick for good of rsync, you can try rclone, but I don't see a reason to use it when you have rsync setup already.
Ya i have that parameter, else it would not work with normal files ( which it does just fine .. including .dot folders if removed, just not the files IN the .dot folder ).
i installed a fresh Debian, installed 3.1.3 version of rsync. it works like it should, so must be a bug in later versions ( not going to see how far back..) . Grumble. Going to try to install older version on my desktop then pin it, if it lets me.
quick search says rclone uses cloud destinations?
Tue Mar 28 2023 10:06:44 AM EDT from darknetuserrsync has a flag for propagating deletions. I think it is --delete.
If you are sick for good of rsync, you can try rclone, but I don't see a reason to use it when you have rsync setup already.
quick search says rclone uses cloud destinations?
rclone uses nearly any backend destination you want to use, including ftp, local filesystems, ssh/sftp, webdav servers... you name it.
ah, ok i saw cloud and sort of stopped reading :)
This weekend after i get back from hospital going to see if i can back date rsync on my desktop, if i can, then problem solved without having to adjust my workflow. Frustrating bug.
Wed Mar 29 2023 05:28:01 PM EDT from darknetuserquick search says rclone uses cloud destinations?
rclone uses nearly any backend destination you want to use, including ftp, local filesystems, ssh/sftp, webdav servers... you name it.
Hi there. I am not the sort of people who does these things, so let me preface this post with a Full Disclosure warning: I get money from some of the people involved so I have a conflict of interests (ie. it is in my best interest to tell you this stuff is amazing so you go and visit the link).
Long story short, with the CentOscalypse there are some admins running arround like headless chickens because they no longer have a clean upgrade path forward. A number of them is jumping ship to Debian from their CentOS. The rest is still wondering which free (as in beer) RHEL clone to adopt. Main contenders nowadays are Alma Linux and Rocky Linux
I am posting a link for a free PDF download, which is an ADMIN Magazine mini-issue sponsored by the Rocky/CIQ people. It contains an interview with the Rocky Linux head-honcho, instructions for migrating your CentOS installs to Rocky Linux, and some general interest information about the History of Rocky and their long term goals.
I know in the end of the day it is just a 24 pages long advertisement piece, but I think it is still informative, specially if you are not involved with RHEL clones and want to know what the fuss is about. Debian admins here will enjoy their popcorn while reading how the Red Hat ecosystem has a clone war XD
Here is the link. The download is free but subscribing to a newsletter (from which you may unsubscribe later) is required. I am not directly affiliated with this link (ie. I don't get directly paid if you visit)
https://bit.ly/Inside-Rocky-Linux
(BTW, it is my understanding the ADMIN Magazine people does not usually run sponsored articles, which may explain why they released this as a separate mini-issue instead of incorporating it to one of their regular numbers)