Web crawler
Posted: Thu Jan 23, 2014 10:34 pm
Is anyone aware of a LiveCode web crawler? I have a website I am interested in backing up and want to have it do things with the data it crawls, such as categorizing, tagging, storing in a database structure, etc based on the content. I don't have a really concrete idea of what it will do, I am wondering if there are any projects people are working on her or have seen, and it sounds like something interesting to try to develop with LiveCode. Any suggestions on how to crawl and parse the pages?