BrightData

Interact with Bright Data to scrape websites or use existing datasets from the marketplace to generate adapted snapshots

Actions14

Overview

The node "BrightData" provides integration with the Bright Data platform, specifically enabling users to send HTTP requests through the Web Unlocker service. The Web Unlocker resource allows users to route their HTTP requests via proxy zones and countries managed by Bright Data, effectively bypassing web restrictions or blocks.

This node operation is beneficial when you need to programmatically access web resources that might be geo-restricted, rate-limited, or protected by anti-bot measures. For example, it can be used to scrape data from websites that block direct IP addresses or to test how a website behaves when accessed from different countries.

Practical examples:

Sending a GET request to a news website through a US proxy zone to retrieve localized content.
Posting form data to a web service while routing the request through a specific country to simulate user behavior.
Accessing APIs that restrict access based on geographic location by selecting the appropriate country.

Properties

Name	Meaning
Zone	Select the proxy zone through which the request will be routed. Options are fetched dynamically from available active zones.
Country	Select the country from which the request should appear to originate. Options are fetched dynamically from available countries.
Method	The HTTP method to use for the request. Options: DELETE, GET, HEAD, PATCH, POST, PUT.
URL	The target URL to which the HTTP request will be sent.
Format	The expected format of the response. Options: Raw (plain text), JSON (parsed JSON object).

Output

The node outputs the response of the HTTP request in the json field of the output data. Depending on the selected "Format" property:

If "Raw" is selected, the response is returned as plain text.
If "JSON" is selected, the response is parsed and returned as a JSON object.

If the response contains binary data, it would typically be handled separately, but this node focuses on textual or JSON responses.

Dependencies

Requires an API key credential for authenticating with the Bright Data platform.
Depends on the Bright Data Web Unlocker service being active and accessible.
The node uses dynamic lists for Zones and Countries, which require network calls to fetch current options.

Troubleshooting

Invalid Zone or Country Selection: If the selected zone or country is not active or incorrectly specified, the request may fail. Ensure that the zone and country are valid and currently available.
HTTP Errors: Since the node ignores HTTP status errors by default, check the response content for error messages if the request does not behave as expected.
Authentication Issues: Make sure the API key credential is correctly configured and has sufficient permissions.
Response Parsing Errors: If "JSON" format is selected but the response is not valid JSON, parsing will fail. Switch to "Raw" format to debug the raw response content.