Add your data to Google Sheets.
Create a column with URLs you want to crawl.
Premium
Website Crawler
Automatically scrape website content to enrich your lists.
Used by 31,000+ BD teams Updated
Try it for free →
How to use this feature
Get started in 3 simple steps.
Select Website Crawler
Open the Derrick add-on, choose Website Crawler, and select the columns to scrape.
Extract page text instantly
Your sheet fills with on-page content.
All the data you can extract
Enrich companies and leads with 5+ data points each.
| Field Name | Description | Example |
|---|---|---|
| 📝 pageTitle (crawler) | the meta title of the page | How to rank on google ? |
| 📝 pageDescription (crawler) | The meta description of the page | A clear, no-hype guide to making money online: realistic strategies... |
| 📝 pageHeadings (crawler) | Headings of the page | How to make money online... |
| 📝 pageText (crawler) | The text on the page (max 50k characters) | lorem ipsum dolor ... |
| 📝 pageLength (crawler) | The length of the page | 1231234 |
Workflow using
Website Crawler
Combine this feature with others to create powerful automation workflows.
When to reach for it
Website Crawler use cases
Website Crawler is a Derrick workflow that runs natively inside Google Sheets (plus REST API + MCP server). It pulls the data class you need and writes it back into the sheet your team already lives in - no CSV exports, no separate web app.
- Daily account-research - pull website crawler on every account in your morning queue.
- CRM hygiene - keep website crawler fresh on existing records to avoid stale-data costs.
- Trigger-based automation - have website crawler pulled the moment a new lead lands in the sheet.
- Bulk batch jobs - run website crawler across thousands of rows in a single Sheets job.
Loved by sales teams worldwide
See what our customers say about Derrick.
"This app saved me so much time and effort. Great for anyone looking to build a contact list or network at scale quickly. As a start-up it's been invaluable."
Alex Clark
Director | SaaS GTM Leader
"Working pretty nifty compared to Snov.Io. Price wise it does give a fair shake, and IMO better interface since it's google sheets."
David Sire
Mortgage Broker at Zero Point Mortgage
"Derrick is a very simple and user-friendly app to enrich your contacts database. Best thing: you can test it for free. And then the price is so low, it's a no brainer."
Etienne Grange
CEO Form'actions
"Super easy to enrich linkedin urls using this tool. Both personal and company url data can be easily enriched with a click of a button."
Zaid Bilal
RevOps Professional
"Amazing Tool, I would like to advocate this to my colleagues. So that you can get more users. Keep it Up. 5 Stars!"
Asif Hanzala
Lead Generation Specialist at IdeaPeel
"This app is fantastic. Brilliantly created to help small and mid sized businesses."
Dan Hughes
Founder/CEO, AlmanacIO
"I have been using other expensive apps or freemium like phantombuster, but Derrick has replaced them all. I love the simplicity of the Google sheet add-in, but what is best is the efficiency it delivers."
Julien Walon Cohen
CEO & Co-founder @ Diffly | B2B Sales Advisor
"The LinkedIn scraping and email finder combo is incredibly powerful. I can build a complete prospect list with contact info in under an hour. Absolute must-have for outbound."
Michael Kim
SDR Team Lead at CloudScale
"Have tested over 10+ LI scraper apps, Derrick beats them all. Simple to use, accurate data, and affordable price."
AJ Alexander
Opportunity Prospector
Scraping arbitrary content from a company website — the founder bio, the about-us paragraph, the careers page, the customer logo wall — is the unsung hero of B2B personalisation. Most teams either write Python scripts (Scrapy, Playwright) or pay for ScraperAPI / Apify monthly. Both options need a developer in the loop.
Derrick reads a list of URLs directly from Google Sheets and returns the cleaned text content of each page in the next cell, with optional CSS-selector filtering when you only want a specific element. No headless browser to manage, no proxy rotation, no rate-limit code. The bulk use case that drives adoption : enriching every prospect company's homepage text into a single column so AI prompts further down can reference it for personalisation. Free up to 100 URLs/month, no card. Higher volumes on the Derrick pricing page.
Related : website-text-by-company-name recipe, extract emails + social URLs from any website. Tool comparison context : all sales tools we reviewed.
Frequently asked questions
Do I need to install anything to use Website Crawler?
Just the Derrick Google Sheets add-on (one click, no API keys, no developer setup). Once installed, Website Crawler is one of the workflows available from the Derrick sidebar inside any Sheet. The same feature is also available via REST API and via the Derrick MCP server for Claude / ChatGPT.
Can I use Website Crawler on a list of 1,000+ rows?
Yes - Website Crawler runs as a batch job inside Google Sheets, with progress tracking and per-row credit accounting. The workflow scales linearly: 10 rows or 10,000 rows, the steps are identical and you can step away while it runs.
Where does the data behind Website Crawler come from?
Derrick aggregates 10+ public-data sources (LinkedIn graph, company websites, registry data, web crawl, third-party providers) and runs them in a waterfall for Website Crawler. The first source that returns a confident match wins; if no source is confident enough, the cell is left blank rather than guessed.
Is Website Crawler GDPR-compliant?
Yes. Derrick only enriches public data, doesn't store personal records beyond the duration of the lookup, and supports full deletion on request. The Sheets add-on runs inside Google's OAuth-protected environment so your data stays private to your account.
Can I trigger Website Crawler automatically when I add a row?
Yes - set up a Google Sheets onEdit trigger (Apps Script, takes 2 minutes) so a new row in column A automatically runs Website Crawler into column B. Pair with Zapier / Make / n8n to push CRM contacts directly into the sheet for hands-free enrichment.
Start crawling websites today
Pull key website content automatically.
Try it for free → 2 Credits per line (starts at €0.0034)
Unused credits roll over Keep unused credits for next month
No learning curve Install, click, get results instantly