Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.1Bright Data is a web data platform; this toolkit enables Arcade tools to scrape, search, and extract structured data from any public website at scale without being blocked.
Capabilities
- Web scraping: Fetch any webpage and return its content as clean Markdown.
- Multi-engine search: Query Google, Bing, or Yandex with control over result count, search type (web/images), and country targeting.
- Structured data extraction: Pull typed, schema'd records from a wide range of platforms — e-commerce (Amazon), professional networks (LinkedIn, ZoomInfo), social media (Instagram, Facebook, X), real estate (Zillow), travel (Booking.com), and video (YouTube).
Secrets
No OAuth or API-key auth flow is required at the Arcade level; credentials are supplied as secrets injected at runtime.
BRIGHTDATA_API_KEY
Your Bright Data account API key, used to authenticate all requests. Obtain it from the Bright Data dashboard under Account Settings → API Token. A paid or trial Bright Data account is required; free-tier access may be limited. See Bright Data API documentation for details on generating and managing API keys.
BRIGHTDATA_ZONE
The Bright Data zone (proxy/scraping zone) to route requests through. Zones are created and named in the Bright Data dashboard under Proxies & Scraping Infrastructure. Each zone corresponds to a specific product type (e.g., datacenter, residential, SERP API, Web Unlocker); the zone you provide must match the capabilities required by the tools you intend to use. Copy the zone name exactly as it appears in your dashboard.
For guidance on adding secrets to Arcade, see the Arcade secrets docs. You can also manage secrets directly at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |