Thread: google search scraper - a basic tutorial

thanks vicky for books,
i am familiar with VB and i want to learn vb .net. how different is vb.net from vb? i mean what is main difference between two languages?

why do i need extract url at the first ? tell me why we use it ? newbie here....

well you can add a button and on the click event call webbrowser1.stop()

DONE!!!

Just add the code from button click to a timer tick. Set the timer tick to 5 secs. Then every 5 secs the new urls will be extracted



its used to directly goto search results, rather than wasting time entering the search term and clicking search.

not much - i started with same vb 6 and no info of .net languages. Its pretty much the same. Double-click a control to generate the events (like double-click a button to generate click event) etc. Also unlike vb 6 .net has every thing wrapped up in class. Just do one thing install visual studio 2008/10 and create a windows application in vb.net. Place a button and double-click to go to code-window. Then its all like vb 6.

Assuming you could create complex programs in vb6 .net will be a piece of cake.

Hope you will have fun.

wow nice tut mate ... thanks a lot for share ^_^

looks like I am having a hard time understanding... I need to know more about programing

Yuo can make it with stop button it is easy and it works great but your code in document completed very weak and it collects links with dups.
But it's ok this can be fixed :)

I have look for along time how google scraper works using multithreading,backgroundworker but when i ask someone how to make it to click next page ,next page etc and finally found the answer from you :)

Really thank you.

I didn't even think that it can be so easy to do,much more easy :)

So you're good and tutorial good but weak.

If you wanna remove dups from richtextbox so here is the code if you help this.

Code:

Private Sub WebBrowser1_DocumentCompleted(ByVal sender As System.Object, ByVal e As System.Windows.Forms.WebBrowserDocumentCompletedEventArgs) Handles WebBrowser1.DocumentCompleted
     
Dim strFind As String = "forumdisplay.php" ' type what you want to get for real sites or keywords :)
        For Each lineStr As String In Me.RichTextBox1.Text

            If lineStr.ToLowerInvariant Like "*" & strFind.ToLowerInvariant & "*" Then
                Me.RichTextBox1.AppendText(lineStr & vbLf)
            End If
        Next
    End Sub

Just enter example: my dog can eat you :) end hit button.
in the second button type timer1.stop() and when you reach the last of google page like 49 or 50 hit button to stop.
And wolia :)
I hope you help.