Supadata

Access Supadata API to fetch YouTube and web data

Actions7

Overview

This node integrates with the Supadata API to scrape data from web pages or fetch YouTube-related information. Specifically, for the Web - Scrape URL operation, it allows users to provide a URL and retrieve scraped data from that webpage. This is useful for extracting structured or unstructured data from websites without needing to write custom scraping scripts.

Practical examples include:

  • Extracting product details from an e-commerce page.
  • Gathering article content or metadata from news sites.
  • Collecting data tables or lists from informational websites.

Properties

Name Meaning
URL The web address of the page to scrape. Must be a valid URL (e.g., https://example.com).

Output

The node outputs JSON data representing the scraped content from the specified URL. The exact structure depends on the webpage's content and how the Supadata API processes it. Typically, this could include text content, metadata, links, or other extracted elements.

No binary data output is indicated for this operation.

Dependencies

  • Requires an active connection to the Supadata API via an API key credential.
  • The node uses the Supadata API endpoint /web/scrape to perform the scraping.
  • Proper network access to the target URLs is necessary for successful scraping.

Troubleshooting

  • Common issues:

    • Invalid or unreachable URL: Ensure the URL is correct and accessible from the environment where n8n runs.
    • API authentication errors: Verify that the API key credential is correctly configured and has sufficient permissions.
    • Rate limiting or quota exceeded: The Supadata API may limit requests; check your plan and usage.
    • Unexpected or empty response: Some websites may block scraping or require additional headers/cookies not handled by this node.

  • Error messages:

    • Errors returned from the API will appear in the node output if "Continue On Fail" is enabled.
    • Typical error messages might include network timeouts, invalid URL format, or unauthorized access.

To resolve these:

  • Double-check the URL format.
  • Confirm API credentials are valid.
  • Review API usage limits.
  • Consider using proxy or VPN if the target site blocks automated requests.

Links and References

Discussion