Variables

Variables block is usually used to set keyword list as starting URLs.

Let`s say we need to harvest Google search results by several keywords:

business

government

economics

Google search results URL string has the following format:

https://www.google.com.ua/search?num=100&start=0&q=OUR_KEYWORD

If you need to harvest results for about 1000 keywords, adding URLs may become a big problem. Using Variables block you can avoid this long and routine task. In the Basic string OUR_KEYWORDS is replaces with meta string {VAR}. Starting URL list is used to set the list of values substituted instead of {VAR}. As you may have guessed, this list will contain our keywords. Note, that keyword is automatically encoded (to pass in URL) before replacing {VAR}. Substitution results (final list of starting URLs) can be checked with Test button.

Created with the Personal Edition of HelpNDoc: Full-featured Documentation generator