Re: Migrate 200 Million of rows

From: Stu Charlton <stuartc_at_mac.com>
Date: 29 Jul 2003 09:21:48 -0700
Message-ID: <21398ab6.0307290821.7a1f18b2@posting.google.com>

vslabs_at_onwe.co.za (Billy Verreynne) wrote in message news:<1a75df45.0307282103.1b5c53cf_at_posting.google.com>...

> The compression program (standard on all Unix flavours AFAIK) is
> called compress. And as I said, it uses an adaptive Lempel-Ziv coding
> scheme.

As an aside, I've always wondered why GZIP's "Deflate" was better than Compress because they're both apparently using the same underlying concept (though I think Deflate is a bit different because it's not the exact patented LZW algo). BZIP2's BWT algorithm apparently is even better but it apparently has slower latency for transmissions like this.

Anyway, I've used GZIP for this kind of pipe-based data transfer too, with FTP not NFS... it works well. Received on Tue Jul 29 2003 - 11:21:48 CDT