Re: Download URL File

From: Bassam Abdul-Baki (babdulbaki_at_comcast.net)
Date: 10/16/04 

Date: Fri, 15 Oct 2004 20:35:44 -0400

Hi Marty,

I tried WGET and it didn't do what I wanted. Considering that I only played
with it for a few hours, I may have missed something. My dilemma is this.
We're getting the weather news as an XML feed from an outside site by
calling loadXML in a javascript function (hundreds of users on an intranet
getting the weather from the internet). All of a sudden, the weather site
went down and slowed down our intranet page immensely. Our solution to this
was to get the XML feed separately, and copy it to a local server (cached).
This way, users will load the local copy and the server will always check
for a newer version. If no new version exists or the server's slow or down,
users won't feel it. However, when I used WGET (after getting rid of those
filename.1, .2, .3 extras), the file kept getting replaced with an empty
HTML file that had a META tag REDIRECT link of zero seconds to that weather
page. So the cached copy would just keep trying to get the newer version
over and over. I didn't think it was WGET that was doing that, but clicking
on the link would not bring it up in the browser, instead I would get an
unknown error. I tried creating a link to the XML feed and see what happens
if I download it manually, I got a could not download error from IE that
usually appears whenever the file doesn't exist or the URL is broken.

Any suggestions on how to implement a cached copy of a file using WGET?

Thanks.

Bassam

"Marty List" <bill.gates@sun.com> wrote in message
news:2t90h4F1selglU1@uni-berlin.de...
>
> "Bassam Abdul-Baki" <babdulbaki@comcast.net> wrote in message
> news:O%23hiR$ksEHA.2560@tk2msftngp13.phx.gbl...
>> Greetings,
>>
>> Is there a DOS command that will allow users to download a file from an
> HTTP
>> URL? Thanks.
>>
>> Bassam
>>
>
>
> Just yesterday I posted this. You could try the freeware tool WGET.EXE:
> http://www.gnu.org/software/wget/wget.html
>
> If you're using Windows XP you can use BITSADMIN.EXE from the Support
> Tools.
>
>
>

Relevant Pages

  • Re: Download URL File
    ... > I tried WGET and it didn't do what I wanted. ... > getting the weather from the internet). ... > unknown error. ... > if I download it manually, I got a could not download error from IE that ...
    (microsoft.public.win2000.cmdprompt.admin)
  • Re: Download URL File
    ... >> I tried WGET and it didn't do what I wanted. ... >> getting the weather from the internet). ... >> was to get the XML feed separately, and copy it to a local server ... >> if I download it manually, I got a could not download error from IE that ...
    (microsoft.public.win2000.cmdprompt.admin)
  • Re: Free Metalworking Plans
    ... NRA LOH & Endowment Member, Golden Eagle, Patriot"s Medal. ... | I Dl'd the lathe plans, ... Use something like Wget ... or some other worthy download manager to retrieve it. ...
    (rec.crafts.metalworking)
  • Wget usage : request for comments
    ... I am going to start a small project to analyze ... 8 websites with hyperlinks, images, js, etc.. ... I will use wget as a crawler (I like command ... seems I can't download the results in text format. ...
    (comp.os.linux.misc)
  • Re: [unix, console] : something like wget but with forms + authentification
    ... >> download the response after submitting your name and password, ... > tools, like lynx, links, elinks, wget, don't seem to access to this ... I used wget to download the pages you linked to, ... html expert, but perhaps I have been exposed to a little more ...
    (comp.unix.shell)