Language:
switch to room list switch to menu My folders
Go to page: First ... 77 78 79 80 [81]
[#] Fri Feb 03 2023 19:51:50 EST from Nurb432

Subject: Re: Ding dong, proprietary Unix is dead.

[Reply] [ReplyQuoted] [Headers] [Print]

"we promise" 

Ya.. no thanks.

Fri Feb 03 2023 06:00:51 PM EST from IGnatius T Foobar Subject: Re: Ding dong, proprietary Unix is dead.
Other possibilities are dual-licensing (GPL and BSD) or, as Linus has called for, a covenant not to sue over OpenZFS.

 



[#] Tue Feb 07 2023 09:42:37 EST from IGnatius T Foobar

Subject: Re: Ding dong, proprietary Unix is dead.

[Reply] [ReplyQuoted] [Headers] [Print]

I get it, Oracle is not a well loved or trusted company.

And if that is to be the case, then btrfs will keep getting improved until it reaches feature parity with ZFS, and that'll be the end of that.

It's their choice, really.



[#] Sun Mar 26 2023 10:52:32 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

Ok so ran across something last night, and dont see a fix so looking for alternatives..

Been seeing the issue where my rsync backup drive of my home directory fills up.. have to erase and start over.  Yet my home directory is not that big.  Has not been a huge deal so i been putting it off.

Last night i forgot to empty trash before i did a backup ."damn, that is 75g ... let me empty it and run sync again "  .   But in logs it didnt actually delete anything. Turns out that if you have a hidden folder rsync will copy new items to the destination, but if you remove the file, it ignores it ..      if you delete the entire folder, it will sync that change. 

So as cache files and such build ( browsers, etc ) in the hidden folders, it just keeps accumulating on my backup.. until poof, its full.

Trying to search around for an alternative, which i have never cared to do, rsync has always done ok for me for all these years, and all i get is commercial cloud crap.  Yes i could erase/copy full each time, but when 90% of my flies don't change its wasted time and extra stress on my ssd for no reason.  ( and since i have 3 backups, one i take off-site, even more wasted time )



[#] Sun Mar 26 2023 21:25:17 EDT from zelgomer

[Reply] [ReplyQuoted] [Headers] [Print]

--delete delete extraneous files from dest dirs

[#] Mon Mar 27 2023 07:22:21 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

Ya, i do have that as a parameter. and it does delete a dot folder ( and any files in it ), and files that were in regular folders, fine. Its just files inside a dot folder that didnt get deleted that its ignoring once they are written to the destination.. 

( user name changed due to the obvious reasons ) ->  rsync -azvh --delete '/home/xxxx' '/media/xxxx/357c67df-e734-431f-8adc-a40366d690a8/'         ( that mess that looks a bit like a UUID is how one my external SSD shows up and its not worth me changing it really, its scripted, i dont type it. The one i send off site is a veracrypt drive instead and it does the same thing. )

Going to install an older version of Debian ( buster ) later this week and try it there, as i wonder if its a bug in bookworm. But i think i had this problem as far back as stretch. Before that i did backups differently and just a zip of separate folders.. ( since tar wont do a 'sync' on updates very well ) but having files 'open' is far more convenient, and i could just shove the drive into a new PC and mount it as my home.. instantly be back and running. 

 

Sun Mar 26 2023 09:25:17 PM EDT from zelgomer
--delete delete extraneous files from dest dirs

 



[#] Mon Mar 27 2023 07:40:50 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

Bleh typo.

 

"files in a dot folder that got deleted"   not didnt..  of course it wont delete files that are still in the source.. :)      Just delete the extra word delete i had :)  rsync reached out and grabbed my keyboard :)



[#] Mon Mar 27 2023 10:42:42 EDT from zelgomer

[Reply] [ReplyQuoted] [Headers] [Print]

I wonder if --delete-excluded would do it? I should have read your post a second time, I obviously didn't understand it fully the first time around. I'm surprised rsync cares about dot versus no-dot. Of course, the dots-are-hidden thing is only a convention, it has no bearing on readdir or any of the other filesystem related system calls. That makes me suspect that perhaps rsync has a default exclusion pattern to prevent it from descending into dot-dirs, and maybe --delete-excluded will do the trick?

[#] Mon Mar 27 2023 10:51:03 EDT from zelgomer

[Reply] [ReplyQuoted] [Headers] [Print]

By the way, if it comes to it, you may have to implement your own "generate a list of files and then go find and delete the chaff" script. A verbose flag to rsync may help to generate the list of wheat files for you.

I actually ended up writing my own backup scripts. I wanted something that would generate incremental snapshots while my archive medium is not connected. Then, once a month or so, I connect the medium and tell it to "replay" the snapshots into their final destination. So it actually keeps track of a list of files that should be in each snapshot, and then only records the files that have changed. When I "replay", then it creates a new snapshot from the previous snapshot with "cp -l", identifies files that were copied which don't exist in the target snapshot's file list and deletes them, and then unpacks the incremental snapshot over it.

I remember when I was younger, earlier versions of Windows used to have a concept of a briefcase directory. As a kid, I didn't pay much attention to it - "briefcase" sounds like something my Dad would take to the office, and not at all like DooM or Commander Keen, which is what computers were really for. Ironically, I think that what I've ended up writing is pretty similar to that old Windows briefcase concept.

[#] Mon Mar 27 2023 12:40:18 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

sure, i can, but hate to go to all hat trouble when rsync *should* do this out of the box.  I could always go back to zip, just was a nice feature to have it 'plug and play' if i got into a jam. i dont do it so much to recover a file from an 'oh crap' moment, its more for disaster recovery. 

For all my other items i backup, rsync works well, no funny folders to deal with, its just my actual home directory that is causing me issues.

Mon Mar 27 2023 10:51:03 AM EDT from zelgomer
By the way, if it comes to it, you may have to implement your own "generate a list of files and then go find and delete the chaff" script. A verbose flag to rsync may help to generate the list of wheat files for you.


 



[#] Mon Mar 27 2023 14:37:24 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

Tho, i guess i''m missing the obvious time saving measure:

 

"hey bot, in python make me.... "



[#] Mon Mar 27 2023 15:06:13 EDT from zelgomer

[Reply] [ReplyQuoted] [Headers] [Print]

I think that one of us is missing something. Works for me.

$ mkdir -p src/.config dest
$ cd src
$ touch one .config/two .config/three four
$ rsync -a --delete . ../dest/
$ rm one .config/two
$ rsync -a -v --delete . ../dest/
sending incremental file list
deleting one
./
deleting .config/two
.config/

sent 154 bytes received 45 bytes 398.00 bytes/sec
total size is 9 speedup is 0.05
$ rm .config/three
$ rsync -a -v --delete . ../dest/
sending incremental file list
deleting .config/three
.config/

sent 122 bytes received 33 bytes 310.00 bytes/sec
total size is 5 speedup is 0.03

[#] Mon Mar 27 2023 15:30:12 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

What version and what OS? I suspect i have a bug in my version, and the one before it ( i think i cant be 100% sure now )    version 3.2.7  protocol version 31 - bookworm

 

in my case it would be 

 

First

  • create  /house/.files
  • add /house/.files/bla.txt

rsync.. adds folder and file.

Then

  • Delete /house/.files/bla.txt

rsync: 

  • ignores change and leaves bla.txt

Then

  • Add /house/.files/blue.txt
rsync
  • still ignores the fact bla.txt is gone
  • adds blue.txt
Then.
  • delete entire folder /house/.files

rsync

  • removes folder and both files

 

But adding/removing files from root of /house/  works fine. 

 

 


[#] Mon Mar 27 2023 16:05:16 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

The python code GPT-3.5 gave me ( since i wont pay for GPT4 ) looked good doing a review, tested..  works like its supposed to.

Sure, not as many features ( like ssh, compression, bla bla ), and not as efficient, but it will do what i want..



[#] Mon Mar 27 2023 17:33:16 EDT from zelgomer

[Reply] [ReplyQuoted] [Headers] [Print]

2023-03-27 19:30 from Nurb432 <nurb432@uncensored.citadel.org>
What version and what OS? I suspect i have a bug in my version, and

My test came from RHEL 8, rsync 3.1.3, protocol version 31.

[#] Mon Mar 27 2023 18:41:09 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

Ah, an older version..  

Tomorrow going to install a test vm and get an older version of rsync on it ..  

Mon Mar 27 2023 05:33:16 PM EDT from zelgomer
2023-03-27 19:30 from Nurb432 <nurb432@uncensored.citadel.org>
What version and what OS? I suspect i have a bug in my version, and

My test came from RHEL 8, rsync 3.1.3, protocol version 31.

 



[#] Tue Mar 28 2023 10:06:44 EDT from darknetuser

[Reply] [ReplyQuoted] [Headers] [Print]

2023-03-26 10:52 from Nurb432
Ok so ran across something last night, and dont see a fix so looking

for alternatives..

Been seeing the issue where my rsync backup drive of my home
directory fills up.. have to erase and start over.  Yet my home
directory is not that big.  Has not been a huge deal so i been
putting it off.

Last night i forgot to empty trash before i did a backup ."damn, that

is 75g ... let me empty it and run sync again "  .   But in logs
it didnt actually delete anything. Turns out that if you have a
hidden folder rsync will copy new items to the destination, but if
you remove the file, it ignores it ..      if you delete the
entire folder, it will sync that change. 

So as cache files and such build ( browsers, etc ) in the hidden
folders, it just keeps accumulating
on my backup.. until poof, its
full.

Trying to search around for an alternative, which i have never cared

to do, rsync has always done ok for me for all these years, and all i

get is commercial cloud crap.  Yes i could erase/copy full each
time, but when 90% of my flies don't change its wasted time and extra

stress on my ssd for no reason.  ( and since i have 3 backups, one i

take off-site, even more wasted time )


rsync has a flag for propagating deletions. I think it is --delete.

If you are sick for good of rsync, you can try rclone, but I don't see a reason to use it when you have rsync setup already.

[#] Tue Mar 28 2023 10:33:37 EDT from Nurb432

[Reply] [ReplyQuoted] [Headers] [Print]

Ya i have that parameter, else it would not work with normal files ( which it does just fine .. including .dot folders if removed, just not the files IN the .dot folder ).

i installed a fresh Debian, installed 3.1.3 version of rsync.   it works like it should, so must be a bug in later versions ( not going to see how far back..) . Grumble.  Going to try to install older version on my desktop then pin it, if it lets me.  

quick search says rclone uses cloud destinations? 

Tue Mar 28 2023 10:06:44 AM EDT from darknetuser
rsync has a flag for propagating deletions. I think it is --delete.

If you are sick for good of rsync, you can try rclone, but I don't see a reason to use it when you have rsync setup already.

 



Go to page: First ... 77 78 79 80 [81]