Compare two list

javier

Новичок
Регистрация
25.08.2012
Сообщения
93
Благодарностей
0
Баллы
0
Hi,

I want do the next:

I go to website and take all links I see. Well If I do today I find 50 link, thats work good. I save this links in a list and do something with this.

The problem is that when I return tomorrow I find 60 links, 50 I take yestherday and 10 new link. I only want save new links.

I think and think, I know I can download all links again and later delete duplicate, but how I can say to my template do something with only new links I found?

Thats it.

Thanks for read.
 

rostonix

Известная личность
Регистрация
23.12.2011
Сообщения
29 067
Благодарностей
5 707
Баллы
113
1) You add to project the list 1 which will contain all the links that you already worked with and sync with file on hard drive.
2) When you scrape new portion of links, you add them to list 2.
3) Merge lines in list 1.
4) Take line from list 2
5) Text processing - regex.
In text window you put variable from merge step (3).
In regex field you put variable from (4)

Then use If action.
If something found = skip this link and take another
 
  • Спасибо
Реакции: javier

javier

Новичок
Регистрация
25.08.2012
Сообщения
93
Благодарностей
0
Баллы
0
Now I read and don`t understand some comands but I go to fight with software before asking again.

Thanks for your help
 

rostonix

Известная личность
Регистрация
23.12.2011
Сообщения
29 067
Благодарностей
5 707
Баллы
113

javier

Новичок
Регистрация
25.08.2012
Сообщения
93
Благодарностей
0
Баллы
0
oK, I have variable {-variable-linkfound-}

I can have nothing or htp:/....

How I write in logical if, if {-variable.linkfound-} are empey do something Else do other thing?
 

archel

Client
Регистрация
02.05.2011
Сообщения
175
Благодарностей
22
Баллы
18
in logic:
'{-variable.linkfound-}'!=''

successful exit = link is there
bad exit = link not there
 
  • Спасибо
Реакции: javier

Кто просматривает тему: (Всего: 1, Пользователи: 0, Гости: 1)