If this is set to FALSE, the crawler tries to find links only inside html-tags (< and >).
If this is set to TRUE, the crawler tries to find links everywhere in an html-page, even outside of html-tags.
The default value is TRUE.
Please note that if agressive-link-searching is enabled, it happens that the crawler will find links that are not meant as links and it also happens that it
Disabling agressive-link-searchingn results in a better crawling-performance.