What to use?

  • Follow


I need to take the results from fetching a webpage, parse what I get
back, and then fetch other pages based on what that webpage returned.

What programming or script languages would be the best to use for
this? This would be running on a Windows machine.

Thanks,

Ken
0
Reply kso74z402 (2) 2/22/2004 11:08:02 PM

KenL wrote:

> I need to take the results from fetching a webpage, parse what I get
> back, and then fetch other pages based on what that webpage returned.
> 
> What programming or script languages would be the best to use for
> this? This would be running on a Windows machine.
> 
> Thanks,
> 
> Ken

I used Java2 for this with success...

-- 
#include <stdio.h>
#define p(s) printf(#s" endian")
int main(void){int v=1;*(char*)&v?p(Little):p(Big);return 0;}

Giannis Papadopoulos
http://dop.users.uth.gr/
University of Thessaly
Computer & Communications Engineering dept.
0
Reply ipapadop (140) 2/22/2004 11:48:02 PM


On 22 Feb 2004 15:08:02 -0800, KenL <kso74z402@sneakemail.com> wrote:

> I need to take the results from fetching a webpage, parse what I get
> back, and then fetch other pages based on what that webpage returned.
>
> What programming or script languages would be the best to use for
> this? This would be running on a Windows machine.

Probably Windows Scripting Host (by default uses VBScript and JScript).

-- 
Josh
0
Reply usenet96 (3) 2/22/2004 11:53:08 PM

On 22 Feb 2004 15:08:02 -0800, kso74z402@sneakemail.com (KenL) wrote:

>I need to take the results from fetching a webpage, parse what I get
>back, and then fetch other pages based on what that webpage returned.
>
>What programming or script languages would be the best to use for
>this? This would be running on a Windows machine.
>
>Thanks,
>
>Ken
This is one of the things that perl and especially it's libraries
(LWP) do extremely well.

If you can't stomache Perl then there is a package for OCaml
that allows you to cvall perl libs from OCaml ( can't remmeber the
name but you can google it).

Frankly, I would go with the OCaml option.
The reply-to email address is olczyk2002@yahoo.com.
This is an address I ignore.
To reply via email, remove 2002 and change yahoo to
interaccess,

**
Thaddeus L. Olczyk, PhD

There is a difference between
*thinking* you know something,
and *knowing* you know something.
0
Reply olczyk2002 (317) 2/23/2004 12:54:26 AM

>>>>> "KenL" == KenL  <kso74z402@sneakemail.com> writes:

 KenL> I need to take the results from fetching a webpage, parse what I get
 KenL> back, and then fetch other pages based on what that webpage returned.

 KenL> What programming or script languages would be the best to use for
 KenL> this? This would be running on a Windows machine.

I did something similar on Python (mainly because I built a KDE applet using
Superkaramba, which runs on Python). Ok, I fetched only one page, but
still. As long as you have some library that lets your program act as a
webbrowser, any programming language will do. (There is quite a good Python
version for Windows, so you could use Python, also).

-- 
Arto V. Viitanen				                  av@cs.uta.fi
University of Tampere, Department of Computer Sciences
Tampere, Finland				      http://www.cs.uta.fi/~av/
0
Reply av111 (38) 2/23/2004 1:04:45 PM

On Sun, 22 Feb 2004, KenL wrote:

> I need to take the results from fetching a webpage, parse what I get
> back, and then fetch other pages based on what that webpage returned.
>
> What programming or script languages would be the best to use for
> this? This would be running on a Windows machine.

To me this screams Perl. I find it extremely useful when parsing text. It
also has a number of modules you can get. Most the time I just grab the
right modules, add a little glue and I'm done.

-- 
Send e-mail to: darrell at cs dot toronto dot edu
Don't send e-mail to vice.president@whitehouse.gov
0
Reply darrell13 (357) 2/23/2004 6:40:07 PM

darrell@NOMORESPAMcs.utoronto.ca.com (Darrell Grainger) wrote in message news:<Pine.GSO.4.58.0402231340360.21675@drj.pf>...

> To me this screams Perl. I find it extremely useful when parsing text. It
> also has a number of modules you can get. Most the time I just grab the
> right modules, add a little glue and I'm done.

My thanks to everyone responding. My first thought when faced with
this project was Perl, but I've never done anything with it and I
didn't know if there were better alternatives.

After giving it some thought, I've decided to go with Perl. The
LWP::UserAgent class seems to be just what I need and this little
project is just the catalyst I need to get into Perl.

Ken
0
Reply kso74z402 (2) 2/24/2004 1:07:57 AM

KenL wrote:

> After giving it some thought, I've decided to go with Perl.

Good choice.  I would have "thirded" the perl vote...

-- 
|_ CJSonnack <Chris@Sonnack.com> _____________| How's my programming? |
|_ http://www.Sonnack.com/ ___________________| Call: 1-800-DEV-NULL  |
|_____________________________________________|_______________________|
0
Reply Chris7 (2511) 2/24/2004 3:54:37 PM

7 Replies
31 Views

(page loaded in 0.74 seconds)

Similiar Articles:













7/16/2012 6:31:03 AM


Reply: