The other day I was trying to copy a large gzip file onto a USB drive and it kept erroring out when it hit the 4Gb mark. I realized (face palm) that the drive is formatted as a vfat filesystem. Which I think is a synonym for FAT-32. Obviously FAT-32 is limited to max a max file size of 4Gb. So simply split the file into 4000MB chunks with:

split --line-bytes=4000m foo.tar.gz foo_ &

Copy the pieces onto the USB drive. Take the USB drive to the other copmputer. Copy the files off the drive and rejoin the file with:

cat foo_a* > foo.tar.gz &