Skip to main content

Data Sources

Overview​

A Data Source is a single external resource that an application can read from and write to during a run. Two source types are available today:

  • Signaloid Cloud Storage, the per-account storage that ships with every Signaloid account. See Signaloid Cloud Storage for the file browser and the default sd0/ mount.
  • AWS S3 buckets that you own and grant access to.

The add a Data Source dialog​

New Data Source on the create card of the Data and Sensors page opens the Add a Data Source dialog. S3 Bucket is the only selectable entry in the Data Source dropdown today. Selecting it reveals the bucket configuration fields:

FieldAccepted value
AWS Account IDThe 12-digit ID of the account that owns the bucket, shown in the top right of your AWS console
S3 Bucket NameThe bucket name, not the ARN
ReadPermission to read from the bucket. Selected by default
WritePermission to write to the bucket. Cleared by default

The dialog carries two further controls:

  • Copy Suggested IAM Policy () copies a bucket policy granting the Signaloid AWS account the permissions you selected, and links to your bucket's policy editor in the AWS console. The policy is provided as-is, without warranty.
  • Connect registers the bucket.

When your tier is at the data source limit, the create card switches to a usage line and Upgrade, which links to Billing.

For the walkthrough that connects a bucket end to end, see How to Connect an AWS S3 Bucket.

Figure 1. Connecting an S3 bucket: copy the IAM policy, paste it in the AWS console, and complete the Add a Data Source dialog.

Inspecting and editing a connected Bucket​

Each connected bucket appears as a card on the Data and Sensors page. The card shows:

  • The bucket name, with a tooltip that surfaces the bucket owner account ID, the bucket ARN, and the unique source ID.
  • A Read and a Write chip, showing which permissions you granted the Signaloid AWS account.
  • The created and last-updated timestamps.
Figure 2. Editing the read and write permissions on a connected S3 bucket.

The card has three actions:

  • View Files opens the bucket in the AWS console in a new tab.
  • Edit Configuration reopens the dialog. The AWS Account ID and bucket name are locked once the source exists, so you can only change the read and write permissions.
  • Disconnect () removes the bucket from your account. See Disconnecting a bucket.

Disconnecting a Bucket​

The disconnect dialog first checks whether any Data Drive mounts the bucket. If it does, the dialog lists the affected drives and disables Disconnect until you remove the bucket from each one. Otherwise it asks for a single confirmation and removes the bucket. Disconnect cannot be undone, but it frees a slot against your data source quota and does not delete any objects in the bucket itself.

Figure 3. Disconnecting a connected S3 bucket from its card on the Data and Sensors page.

Where to use a Data Source​

A data source you connect here is available in every place the platform attaches data to a run:

Last updated on