procurement data
A county bid notice is worth more joined to two other public records
An example ScrapeUp dataset: Florida county bid notices joined to past awards and to Sunbiz and DBPR company records, one enriched record per solicitation.
Sloane Merritt
Anti-Bot
Search, Agent, or Training? Cloudflare's New Bot Rules and Your Scraper
Cloudflare announced that Training and Agent bots would be blocked by default on ad-supported pages from September 15 — then quietly revised it six weeks later. Here is what the rule actually says now, and the 20-minute audit worth running on your pipeline.
MCP
How to Give Your AI Agent Live Web Access: Build a Web Scraping MCP Server in Python
Your agent can reason about a web page beautifully — it just can't get one. Here's a complete MCP server in Python that gives Claude, Cursor, or any agent live, unblocked web access, with a cost-escalation ladder that stops it burning your budget.
How to Build a Lead List of 1,000 Qualified Prospects (Without Buying One)
Bought lead lists are stale the day they arrive. Here's how to build your own — scored by real buying signals, and filtered by disqualifiers most lists ignore — with working Python.
How to Scrape Amazon Without Building a Bot Army (2026)
Amazon is widely considered the hardest site on the internet to scrape. Here's how to get clean product data from it with a single plain-English request — no bot army required.
How to Feed Live Web Data Into Your AI Agent: A RAG Scraping Tutorial (2026)
Your AI agent is only as smart as its data — and its training data is already stale. Here's how to wire live web data into a RAG pipeline, step by step, with code.
LLM Extraction vs CSS Selectors: Which Should You Use in 2026?
CSS selectors tell a computer exactly where to look. LLM extraction tells it what to find. Both belong in your scraping toolkit. Here is exactly when to use each, with real examples against Amazon, LinkedIn, Hacker News, and five e-commerce sites simultaneously.
How to Scrape Amazon Product Data in 2026 (Prices, Reviews & Rankings)
Amazon has 350 million SKUs, real-time prices, and the richest review dataset on the internet. Here is how to extract all of it reliably in 2026 using Python and ScrapeUp's API, including LLM-powered extraction that requires zero CSS selectors.
How to Bypass Cloudflare When Web Scraping in 2026
Cloudflare protects over 20% of all websites on the internet. If you have spent any time building web scrapers, you have almost certainly hit it — the instant 403, the 1020 Access Denied page, or the spinning interstitial that your scraper cannot get past. In 2024 and 2025, Cloudflare's
Web Scraping
Is Scraping Google Search Still Possible in 2026?
Yes, Google SERP scraping still works in 2026 — but the way most people try it fails immediately. Here's exactly what Google checks, what the working approach looks like, and four real use cases with Python code.
Tutorial
How to Build a Job Board Scraper in Under an Hour Using ScrapeUp's API
Extract job listings from Indeed, LinkedIn, and Glassdoor with a single API call. Step-by-step Python tutorial — no proxy management, no CAPTCHA headaches.
Web Scraping
The Web Is the World's Largest Database. Most Companies Don't Know How to Query It.
Public web data is one of the most underutilized sources of competitive intelligence available today. Here's the business case for building the capability — and how to think about where to start.