Web Services Forum - How to save all search engine results urls in a text file

Articles |
News |
Weblogs |
Books |
Forums

Artima Forums | Articles | Weblogs | Java Answers | News

Sponsored Link •

Web Services Forum
How to save all search engine results urls in a text file

1 reply on 1 page. Most recent reply: Jan 17, 2007 3:08 PM by Dave Andrews

Welcome Guest
Sign In

Back to Topic List

Reply to this Topic

Search Forum

Threaded View


Previous Topic		Next Topic

Flat View: This topic has 1 reply on 1 page

bojan dragosavac

Posts: 4
Nickname: bojan
Registered: Dec, 2006

How to save all search engine results urls in a text file

Posted: Dec 26, 2006 8:28 AM

From this search engine:

https://siteexplorer.search.yahoo.com/mysites

when I make all subdomains search just by typing a domain url in a search box like
blogspot.com -and after I verify my yahoo email password I get 28 millions webpages listed on thousands of search result pages.I want to save the all urls and again only the one that have flv files in a text file so some flash downloader preferably freeware could preview or download them selectively or all.And can interrupt it use what was saved and finish if I like anytime.

Dave Andrews

Posts: 2
Nickname: linknz
Registered: Jan, 2007

Re: How to save all search engine results urls in a text file

Posted: Jan 17, 2007 3:08 PM

Perhaps you could try to use a webspider to index and collect all the links found within the results as the pages are displayed. You may even be able to send a webspider into the search engine and then simply index the results for later viewing.
I had a small problem with G indexing my search engines results pages despite them being noindex no follow but they would be displayed as search results to users who were using the other search engine. It played havoc with our stats until we worked out what was going on.

Flat View: This topic has 1 reply on 1 page

Previous Topic

Next Topic


	Web Artima.com