findaskill

—skills · counting…

30,375MCP servers

SkillsMCP serversAgent BuilderRun agentSoon
Sign in
  1. Home
  2. Skills
  3. Web Scraping & Data
Scraping · 4 verified skills

Web Scraping & Data Extraction Agent Skills

Give your AI agents eyes on the web. These scraping and crawling skills turn raw websites into clean Markdown and structured JSON, handling dynamic JavaScript rendering and modern bot protection.

Find more Scraping skillsAll skill categories

firecrawl-scrape

Author
firecrawl
Repository
firecrawl/cli

Turns any known URL into clean Markdown or structured data through the Firecrawl CLI — main content only, links included, with an option to wait for JavaScript to render first.

$ npx skills add firecrawl/cli --skill firecrawl-scrape
Skill details & usage for firecrawl-scrapeView source on GitHub (opens in a new tab)

firecrawl-crawl

Author
firecrawl
Repository
firecrawl/cli

Bulk-extracts many pages from one site or section — for example everything under /docs — with depth limits and status checks for long-running crawls.

$ npx skills add firecrawl/cli --skill firecrawl-crawl
Skill details & usage for firecrawl-crawlView source on GitHub (opens in a new tab)

playwright-cli

Author
microsoft
Repository
microsoft/playwright-cli

Microsoft's official Playwright skill: open pages, interact through accessibility snapshots, take screenshots and work with Playwright tests straight from the terminal.

$ npx skills add microsoft/playwright-cli --skill playwright-cli
Skill details & usage for playwright-cliView source on GitHub (opens in a new tab)

agent-browser

Author
vercel-labs
Repository
vercel-labs/agent-browser

A browser automation CLI built for AI agents: navigate, fill forms, click, take screenshots and extract data from websites — for scraping, QA and exploratory testing.

$ npx skills add vercel-labs/agent-browser --skill agent-browser
Skill details & usage for agent-browserView source on GitHub (opens in a new tab)

How to install Web Scraping & Data skills

  1. 01

    Copy a command

    Every card above has its own npx skills add command and a copy button. Installing only requires Node.js; a few skills need an extra tool or API key, noted in their description.

  2. 02

    Run it in your project

    The CLI asks which agents to install for — Claude Code, Cursor and other supported agents — and adds the skill to your project. Add -g to install it for your user account across every project.

  3. 03

    Describe the task

    Start a new agent session and ask in plain words. The agent loads the skill when your request matches its description. Read the SKILL.md on GitHub before installing anything on a system that matters.

Frequently asked questions

Is web scraping with an AI agent legal and ethical?

Collect only public data, respect robots.txt and each site's terms of service, avoid personal data unless you have a lawful basis to process it, and rate-limit requests so you never burden a server. A skill doesn't change those rules — you remain responsible for how the data is collected and used. This is general guidance, not legal advice.

Can these skills scrape JavaScript-heavy websites?

Yes. playwright-cli and agent-browser drive a real browser, so pages run their JavaScript before anything is extracted, and the agent can click, scroll and fill forms when content only appears after an interaction. firecrawl-scrape can also wait for rendering before returning clean Markdown.

Scrape or crawl: which skill should I use?

Use firecrawl-scrape when you know the exact pages, firecrawl-crawl to bulk-extract everything under a section such as /docs, and a browser skill when you must log in or interact before the data appears. The Firecrawl skills run through the Firecrawl CLI, which uses a Firecrawl API key.

Explore other skill categories

  • Coding

    Coding & Development

    Code review, conventional commits, test-driven development and safe refactoring.

    Explore Coding skills
  • SEO

    SEO & Site Audits

    Technical SEO audits, crawls, structured data and Core Web Vitals fixes.

    Explore SEO skills
  • DevOps

    DevOps & Cloud

    Dockerfiles, Kubernetes manifests, CI/CD workflows and Terraform.

    Explore DevOps skills
  • Security

    Security Auditing

    Security code review, Semgrep scans, secret scanning and dependency audits.

    Explore Security skills
  • MCP

    MCP Tools & Connectors

    Build, generate and call Model Context Protocol servers and MCP Apps.

    Explore MCP skills

By using it, you agree to our Terms and Privacy Policy. . Contact us.

Explore Skills & Tools

findaskill

The open skills directory for Claude Code & AI agents

© 2026 findaskill

Categories

  • Coding
  • SEO
  • Scraping
  • DevOps
  • Security
  • MCP

Featured Skills

  • seo-auditMarketing & Technical SEO
  • firecrawl-seo-auditWeb Crawling & Audit
  • audit-websiteAutomated Code Fixer
  • web-quality-seoLighthouse & Standards

Platform & Legal

  • Skills Catalog
  • Categories
  • MCP Directory
  • Terms
  • Privacy