Re: GLUG: transfering lots of files

[Paul Sheer <psheer@xxxxxxxxxxxxxx>]

Try mirrordir

www.obsidian.co.za/mirrordir

its a brilliant package

I,... err,... wrote it

-paul

On 15 Jun, Marc Peiser did thusly spake:
> Hi there,
> 
> I have a staging server with html and grahics that I need to push to 3
> live load balanced web servers about twice a day. A utility like rsync can
> do the job if you only have a few files, but I have 250 000 images and
> html files, and rsync just can't cope. It really takes too long...
> 
> One script which works well is mirror.pl (on freshmeat) but that is run
> from the live web servers and pulls the files from the staging server via
> ftp. I need something similar but must be run from the staging server for
> security reasons. The staging server is on a inside network and the 3
> web servers are on the DMZ. Content must be pushed from the Hidden staging
> server to the live web servers.
> 
> Does anyone have any suggestions on how I can do this. 
> 
> Does anyone do anything similar? I'm keen to hear how:-)
> 
> Regards,
> Marc
> 
> ---
> To unsubscribe from this list: send the line "unsubscribe glug" in
> the body of a message to majordomo@xxxxxxxxxxxx

-- 
-----BEGIN PGP PUBLIC KEY BLOCK-----
Version: 2.6.3i

mQCNAzdiRpAAAAEEANPUPC/Lrs4OCJOjWaIWaCYTzTIY1p73uPY+8ZOJH5fc4QNp
IAX+EFQ/yZ3RMOLg8yy++HufzBwDoePO4W0MKwyVFCcNIIjsY6JCXWdbpQXsY1LL
OASlGexQnEQ4mfc7ThOAKWSgPyiMv5vDJ6S0EL8rdIFL7fVv56BAxnN042FRAAUR
tCJQYXVsIFNoZWVyIDxwc2hlZXJAb2JzaWRpYW4uY28uemE+iQCVAwUQN2JGkKBA
xnN042FRAQF5CAP/Y0TaguqCpYiTEBHxZPpT/dliInVRBzryi4gdlgX6CCLDRRGH
ATP4ac8aiATegc4ev4+vcdn4fBwc6fQ2AP6hd25ZI93vShxztM/bQlGWy0zp79Uo
+69uGdJhdvgYpIsTCqppM/yjeXAJEqq5TG2Gy4pqHY235rspmeA/fX7kgIo=
=aX4m
-----END PGP PUBLIC KEY BLOCK-----

Cellular . . . +27 83 604 0615 . . . .  Land . . . +27 21 761 7224
Obsidian Systems . . . .  Linux installations, support, networking
info@xxxxxxxxxxxxxx . . . . . . . . . .  Tel  . .  +27 21 448 9265
http://www.obsidian.co.za  . . . . . . . Jhb . . . +27 11 792 6500
L I N U X . . . . . . . . . . . . . The Choice of a GNU Generation