close

DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to scrape Google Play data with Node.js (no API key needed)

How to scrape Google Play data with Node.js (no API key needed)

Image 1
Comments
4 min read
How to scrape Shopify App Store data with Python (no API key needed)

How to scrape Shopify App Store data with Python (no API key needed)

Comments
4 min read
How to scrape Redfin (US real estate) data with Node.js (no API key needed)

How to scrape Redfin (US real estate) data with Node.js (no API key needed)

Comments
4 min read
3 Reasons Your Web Scraper Breaks in Production (and How to Fix Each)

3 Reasons Your Web Scraper Breaks in Production (and How to Fix Each)

Comments
2 min read
IRS 990 Scraper: pull nonprofit officer comp + financials for $3.05/1K

IRS 990 Scraper: pull nonprofit officer comp + financials for $3.05/1K

Comments
8 min read
Kick Chat Scraper: archive live chat before it disappears forever

Kick Chat Scraper: archive live chat before it disappears forever

Comments
7 min read
Spoofing Your Scraper's Fingerprint Is a Losing Arcade

Spoofing Your Scraper's Fingerprint Is a Losing Arcade

Comments
9 min read
Stop pretending your scraper worked: honest JSON for AI agents

Stop pretending your scraper worked: honest JSON for AI agents

Image 1
Comments
4 min read
Lessons Learned: Dealing With Instagram Rate Limits and Blocks (and Why I Switched to a Hosted API)

Lessons Learned: Dealing With Instagram Rate Limits and Blocks (and Why I Switched to a Hosted API)

Image 1
Comments
2 min read
When AI Agents Should Stop Using Browsers for Web Data

When AI Agents Should Stop Using Browsers for Web Data

Image 1
Comments 1
5 min read
I scraped 50,000 G2 reviews to map the 2026 SaaS Battlecard Atlas

I scraped 50,000 G2 reviews to map the 2026 SaaS Battlecard Atlas

Image 1
Comments
8 min read
Your Scraper Returned a Clean Row. It Was Wrong.

Your Scraper Returned a Clean Row. It Was Wrong.

Comments
10 min read
The compiler caught a lot. It didn't catch enough.

The compiler caught a lot. It didn't catch enough.

Comments
8 min read
How to Handle JavaScript-Rendered Pages Without a Full Browser

How to Handle JavaScript-Rendered Pages Without a Full Browser

Comments
5 min read
Why Your Scraper Works in the Browser But Fails in Python

Why Your Scraper Works in the Browser But Fails in Python

Comments
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.