Overview
This node is designed to extract content from specified URLs using the Tavily service. It allows users to input one or multiple URLs and retrieve extracted data such as text content and optionally images. This can be useful for scenarios like web scraping, content aggregation, SEO analysis, or monitoring changes on web pages.
For example, a user might provide URLs of news articles to extract their main content for summarization or feed generation. Another use case could be extracting product details from e-commerce pages.
Properties
| Name | Meaning |
|---|---|
| URLs | One or more URLs (comma-separated) from which to extract content. |
| Options | Collection of optional settings: |
| - Include Images: Whether to include images in the extraction result (true/false). | |
| - Extract Depth: Level of extraction detail; "Basic" for simple content, "Advanced" for deeper extraction including more elements. |
Output
The node outputs JSON data containing the extracted content from the provided URLs. The structure typically includes textual content and, if enabled, image data related to the pages. If images are included, they may be represented as URLs or embedded data references.
No binary data output is indicated by the source code.
Dependencies
- Requires access to the Tavily API or service for content extraction.
- Needs an API key or authentication token configured in n8n credentials to authorize requests to Tavily.
- Network connectivity to the target URLs and Tavily service is necessary.
Troubleshooting
- Invalid URL format: Ensure URLs are correctly formatted and accessible.
- Authentication errors: Verify that the API key or authentication credentials for Tavily are correctly set up in n8n.
- Network issues: Check internet connectivity and firewall settings that might block access to Tavily or target URLs.
- Extraction depth issues: Using "Advanced" extraction may increase processing time or fail on complex pages; try switching to "Basic" if errors occur.
- Empty or incomplete results: Confirm that the URLs contain extractable content and that options are set appropriately.
Links and References
- Tavily Official Website — For detailed documentation and API reference.
- n8n Documentation — For setting up API credentials and using HTTP request nodes.