[rdup] rdup issues

[Miek Gieben]

Hello,

Mark J Hewitt noticed some issues with rdup:
a) the current speed, esp when doing gzip.
b) a race with %C (showing content)

(and some other things, but those are fixed in trunk/)

Ad a)
 When using gzip.sh and/or crypt.sh there is a lot of I/O
 going on. This is becuase the new (smaller) filesize needs 
 to be known before the file can be printed to standard out
 again. A fix would be to do this all on-the-fly.

Ad b)
 Because rdup using the filesize to determine when a file
 is completed read from standard input, there is race with
 shrinking and/or growing files during this 'cat' operation.

Both these issues stem from the fact that the filesize
is used. The only fix for this would be to create some
magic marker which signal end-of-file. 

If tried some C, shell script and perl this afternoon
to see if this could be done by using EOF. It can't. So 
some other magic marker is needed. Trouble is that such
a marker cannot occur in the files' content.

It could use a bunch of \0 values which are pretty hard
to typ in...

Has anybody some bright ideas about this?

--
grtz,
  - Miek

  http://www.miek.nl              http://www.nlnetlabs.nl
  PGP: 6A3C F450 6D4E 7C6B C23C  F982 258B 85CF 3880 D0F6
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 191 bytes
Desc: Digital signature
URL: <http://miek.nl/pipermail/rdup/attachments/20060520/073bfa78/attachment-0007.pgp>