Back to list
Views:   21K
Replies:  4

Design Patterns for Web App Screen Scraping?

Hi All,

I am developing a Windows Form application to screen scrape a complex web application that has Ajax in its pages.

In fact, the web app has multiple pages and I need to navigate & perform click operation many times to get the appropriate page data.
I am thinking about a Design Pattern to implement this. Can anyone guide as to which Pattern or Patterns would be suitable for this?

Neetha Adehalli, Jun 06, 2011
Reply 1
Screen Scraping is an important part of data migration and integration scenarios. It enables modern apps to talk with legacy apps that do not offer an API and is the complement to the data entry side of automation.Get all latest apps for free on Appvn app store. Appvn app download.
Lenivan Mike, Oct 02, 2017
Reply 2
Hi Neetha,

What about using visitor pattern ? from what i understand about the context is that you have collection of pages that needs to be visited to collect data so my suggestion is to use visitor pattern where you visit each page to collect the required data.

Thanks & Regards
Pubudu Thilakarathna
Pubudu Thilakarathna, Aug 30, 2011
Reply 3
Building complex objects and exposing as API - Builder pattern is the best ... Please share the details of the expected features...c an try to put in a workable solution..

- Tarriq Ferrose Khan
Tarriq Ferrose Khan, Aug 26, 2011
Reply 4

Regex is your HTML screen scraping friend. 
No specific Patterns come to mind.

Good luck!
John Telstra, Jun 07, 2011
Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.