google suggestions craper

archel

Client
Регистрация
02.05.2011
Сообщения
175
Благодарностей
22
Баллы
18
Hi

I'd like to scrape the google suggestions but can't make it to work.

When you enter a word manually in the google search field, google gives you the suggestions.
Though, the word doesn't show up when using zenno...only when you click on the search button, google then shows the word, together with the search results, but without the suggestions of course.

anyone knows how to simulate manually typing it in?

thanks in advance.
 

flexfanatic

Client
Регистрация
03.11.2011
Сообщения
19
Благодарностей
3
Баллы
0
Maybe I'm misunderstanding what you're trying to do but why would you need to simulate text entry. If you're trying to scrape the results why not just load the keywords from a text file?
 

archel

Client
Регистрация
02.05.2011
Сообщения
175
Благодарностей
22
Баллы
18
Well, if you type it in manually, eg. within action recording section of zenno, you get this:
manually.png


When you then do it with debug (doesn't matter if I pull it from a txt file or not), you get this:
automatically.png


Only when you push the search button, google registers and shows the keyword you entered. But since I want the suggestions, I can't push the search button.
 

flexfanatic

Client
Регистрация
03.11.2011
Сообщения
19
Благодарностей
3
Баллы
0
Ah, now I get what you're trying to do. Not that's out of my league of skills but now you have me interested. Also have you tried http://ubersuggest.org/ (create a bot to enter your term there ands scrape the results).
 
  • Спасибо
Реакции: RealDiGi и archel

archel

Client
Регистрация
02.05.2011
Сообщения
175
Благодарностей
22
Баллы
18
Yes, I've thought about ubersuggest.
It gives you 10 results instead of 4, which is good, but it is very slow (you have to press submit button and then wait...) while the suggestions in google are instant (and not recorded?).

Thanks for your help already though.
 

flexfanatic

Client
Регистрация
03.11.2011
Сообщения
19
Благодарностей
3
Баллы
0
Well for those that are looking to use ubersuggest, I created a Google Instant Search parser that uses their site. Enjoy (free of course).

Google Suggestions Scraperr
 

bigcajones

Client
Регистрация
09.02.2011
Сообщения
1 216
Благодарностей
683
Баллы
113
That's fine and dandy that you made this bot and want to share it, but many of us have shared templates here without having to give us your email. Would appreciate a file we can download here on the forum.
 
  • Спасибо
Реакции: CaptainObvious

flexfanatic

Client
Регистрация
03.11.2011
Сообщения
19
Благодарностей
3
Баллы
0
Template is attached. Enjoy
 

Вложения

  • Спасибо
Реакции: bigcajones

archel

Client
Регистрация
02.05.2011
Сообщения
175
Благодарностей
22
Баллы
18
That's find and dandy but anyone knows how to solve the google issue? :D
 

bigcajones

Client
Регистрация
09.02.2011
Сообщения
1 216
Благодарностей
683
Баллы
113
@archel, that's funny and still working on it. Damn them Googlers.
 

flexfanatic

Client
Регистрация
03.11.2011
Сообщения
19
Благодарностей
3
Баллы
0

archel

Client
Регистрация
02.05.2011
Сообщения
175
Благодарностей
22
Баллы
18
No worries.

I'll try to look at it some more and post it if I'd find it.
 

archel

Client
Регистрация
02.05.2011
Сообщения
175
Благодарностей
22
Баллы
18
Ok, found it. It's quite easy.

Instead of 'value', just input 'innertext'.
 

bigcajones

Client
Регистрация
09.02.2011
Сообщения
1 216
Благодарностей
683
Баллы
113
We must've got it about the same time. Here's another option. Use a Rize=>Html element right before it and do a 'focus' for event name.

And for anyone watching this thread here's a template for it. Just fill the keyword.txt file with your keywords and the appropriate text files will be generated.

Посмотреть вложение GoogleSuggest.rar
 
  • Спасибо
Реакции: archel и flexfanatic

archel

Client
Регистрация
02.05.2011
Сообщения
175
Благодарностей
22
Баллы
18
Damn, got sort of the same problem on another search engine...:
http://www.vinden.nl/

Tried everything I know, even simulating keystrokes with codecreator.

Would be great if anyone knows how to beat this one. It has 10 suggestions instead of 4.
 

username

Новичок
Регистрация
24.10.2011
Сообщения
13
Благодарностей
1
Баллы
3
If you have money, you can do it in Automate Anywhere, in fact, the damn thing lets you to enter strings in style of typing, unless you copy the string to clipboard before. Sorry for mentioning another product.
 

Stereomike

Client
Регистрация
29.03.2011
Сообщения
221
Благодарностей
30
Баллы
0
I find their site a bit messy, after a bit of surfing I still can't say, what it is able to achieve...
 

Кто просматривает тему: (Всего: 2, Пользователи: 0, Гости: 2)