[rdup] rdup issues
miek at miek.nl
Sat May 20 23:30:29 CEST 2006
Mark J Hewitt noticed some issues with rdup:
a) the current speed, esp when doing gzip.
b) a race with %C (showing content)
(and some other things, but those are fixed in trunk/)
When using gzip.sh and/or crypt.sh there is a lot of I/O
going on. This is becuase the new (smaller) filesize needs
to be known before the file can be printed to standard out
again. A fix would be to do this all on-the-fly.
Because rdup using the filesize to determine when a file
is completed read from standard input, there is race with
shrinking and/or growing files during this 'cat' operation.
Both these issues stem from the fact that the filesize
is used. The only fix for this would be to create some
magic marker which signal end-of-file.
If tried some C, shell script and perl this afternoon
to see if this could be done by using EOF. It can't. So
some other magic marker is needed. Trouble is that such
a marker cannot occur in the files' content.
It could use a bunch of \0 values which are pretty hard
to typ in...
Has anybody some bright ideas about this?
PGP: 6A3C F450 6D4E 7C6B C23C F982 258B 85CF 3880 D0F6
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 191 bytes
Desc: Digital signature
More information about the rdup