Extract data from authenticated and dynamic pages using

This workflow automates data extraction from web pages inaccessible via API — including those requiring login, using dynamic content loading, or protected by WAF. Ideal when direct scraping is not feasible.

## Who it´s for
- Developers automating data collection from login-protected sites
- Analysts extracting data from dynamic web pages
- Companies monitoring competitors on platforms like GitHub
- Scraping specialists facing WAFs and captchas
- Marketers gathering data without API access

## What the automation does
- Receives an HTTP webhook with target URL and data description
- Launches Chrome via Selenium for proper JS rendering
- Injects session cookies if authentication is required
- Takes a full-page screenshot
- Sends image to OpenAI GPT-4o Vision for analysis
- Returns structured JSON data based on AI interpretation
- Detects blocks (WAF) and returns ´BLOCK´ status for system response

## What´s included
- Ready-to-use n8n workflow
- Webhook trigger logic
- Integrations with Google Search, OpenAI, ip-api.com, GeoNode (proxy)
- Proxy and custom cookie support
- Basic text instructions for launch and adaptation

## Requirements for setup
- n8n instance with headless browser execution capability
- OpenAI API key (GPT-4o Vision)
- Proxy service (GeoNode or equivalent)
- Session cookies (if login is needed)
- Access to external APIs: Google, ip-api.com

## Benefits and outcomes
- Bypass site protections including captchas and WAFs
- Extract data from JS-rendered pages without API
- Automate competitor monitoring, pricing, GitHub activity tracking
- Simplify scraping of authenticated pages
- Scale with proxy support
- Debug-friendly via visual screenshots
- Compatible with downstream data processing systems

## Important: template only
Important: you are purchasing a ready-made automation workflow template only. Rollout into your infrastructure, connecting specific accounts and services, 1:1 setup help, custom adjustments for non-standard stacks and any consulting support are provided as a separate paid service at an individual rate. To discuss custom work or 1:1 help, contact via Telegram: @gleb923.