API Ingest Component
Connect your data pipeline directly to external REST APIs. GraphQL endpoints are supported via HTTP POST.
Last updated:
The API Ingest Component (labeled API Fetch in the palette) allows you to pull real-time data into your DataLensia pipeline. It supports various authentication methods and dynamic URL parameters.
GraphQL note: GraphQL is supported as a standard HTTP
POSTrequest. Send your query in the request body via theHeadersfield asContent-Type: application/json. There is no native GraphQL parser — the raw JSON response is passed downstream as-is.
⚙️ Configuration
| Property | Type | Description |
|---|---|---|
URL | string | The endpoint URL. Supports templates like https://api.example.com/users/{{id}}. |
Method | enum | HTTP method: GET or POST. |
Headers | object | Custom HTTP headers in JSON format (e.g., for Authorization). |
🔄 Dynamic URL Resolution
You can use double curly braces {{path.to.key}} to inject values from the preceding component into your API request.
Example:
If the input to this component is {"userId": 123}, setting the URL to https://jsonplaceholder.typicode.com/users/{{userId}} will fetch data for user 123.
🛡️ Security & CORS
DataLensia performs API requests directly from your browser. This means:
- Your API credentials never leave your browser.
- The target API must support CORS (Cross-Origin Resource Sharing) for the request to succeed.
- If CORS is not enabled on the server, you may need to use a proxy.