OneDrive
The OneDrive connector lists, reads and writes files in a OneDrive account through Microsoft Graph. It signs in with your own Microsoft Entra app registration.
When to use it
- The files are in a person's OneDrive, not in a SharePoint site.
- You deliver a generated file to a person's own storage.
For a team's document library, use SharePoint Files.
What you need
- An app registration in the Microsoft Entra admin center, under Entra ID > App registrations, with a client secret.
- A redirect URI on that registration of platform type Web, not Single-page application.
- The Microsoft Graph delegated permissions
offline_access,openid,profile,User.ReadandFiles.ReadWrite.
Provider-side setup for this connector, including the app registration, the redirect URI and the permissions, is in the File hub setup guide. Connection basics and environments are on the Connections page.
Connect
The connection form lists its steps on the left. Open any step from that list. The Environments step holds the values that differ per environment.
Test connection is in the form footer. Beside it, Test against picks Base, the connection as saved, or an environment, whose values are applied first.
| Field | Step | What to enter |
|---|---|---|
| Client ID | Authentication | The application (client) ID. |
| Redirect URI | Authentication | Filled in. Add it to the app registration as a Web redirect URI. |
| Tenant ID | Authentication | Optional. The directory (tenant) ID for a single-tenant app. Blank uses common. |
| Client Secret | Authentication | The client secret value. |
| Connected Account, Display Name | Authentication | Filled in when you connect the Microsoft account. |
| Default Drive ID | Connection | Optional. A drive other than the account's own. |
| Default Folder ID | Connection | Optional. The folder where browsing and every run start. Pick it with Browse. |
| Notes | Options | Free text for your team. |
The Redirect URI is filled in for you. Copy it with the copy button and add it to the app registration exactly as shown. Use Edit beside the field only when the app is registered against a different address for DataLug.
Connect the Microsoft account on the Authentication step. Save stays disabled until the account is connected.
Supported operations
| Node | Operations |
|---|---|
| Source | List Files, Get File |
| Load | Upload File(s), Write Rows To File(s), Move/Rename, Delete, Create Folder |
Reading files. Recursive and Files only shape a listing.
Include (glob), Exclude (glob) and Regex (advanced) choose files by
name. Parse content into rows turns each CSV file into rows, with CSV has
header row and CSV Delimiter settings. Format Auto (by extension)
reads a .csv file as CSV.
Writing rows to files. Under Format & Behavior:
- Format is CSV, JSON or XLSX. Compress (.gz) compresses the file.
- File Name Template accepts the tokens
{runId},{YYYYMMDD},{HHmmss},{chunkIndex},{partIndex},{groupKey}and{field:MyField}. Append timestamp adds{YYYYMMDD}_{HHmmss}_{SSS}when the template has none. - Split is Single file, One per row or Group by. Group by takes one or more field names, separated by commas.
- Overwrite decides what happens when the file exists: Overwrite, Skip or Fail.
Choosing a path
The remote path field in Configure Action has a Browse button that lists the folder.
- Open enters a folder, and Up goes back. Use picks a file, and Use this folder picks the folder you are in.
- An operation that names a folder shows folders only.
- The field stays editable. Type a wildcard such as
/inbound/*.csv. - Browsing reads only. Nothing is written.
Limits
Microsoft Graph applies its own throttling limits per app and per tenant.
The API limits card on the connection form is collapsed by default. Every field on it is optional, and a blank field uses the default shown below it.
| Setting | What it does | Default |
|---|---|---|
| Requests per period, Period | Paces outgoing calls. Set both to throttle. | No throttle, or the rate shown on the card. |
| Page size | Rows per request. A larger value is reduced to the provider's maximum. | The maximum shown on the card, or set by the provider. |
| Max attempts | Tries per call, including the first. | 3 |
| Cool-off (ms) | The first wait after a 429. Later waits grow from it. | 500 ms |
| Requests at once | Requests open at the same time within one run. | No limit |
A Retry-After header from the provider overrides the cool-off. The pace
applies per connection and is shared by every run on it. See
Run performance.
DataLug retries a call that the provider refused with 429, and a call that
could not connect. A read is also retried after a 408, a 5xx or a dropped
connection. A write is retried only after a 429 or a failed connection.
A Retry-After delay of up to one minute is honoured. A longer one fails the
call with the 429.
Troubleshooting
- Test connection passes and a Source lists nothing. Check the path. A folder that does not exist lists as empty, not as an error. Pick the folder with Browse.
- A file is written but does not appear where you expect. Check the target path on the Load node. A path that resolves to another folder still succeeds.
- Large files. Staging space is limited per run, and the run log names any node that spilled to disk. See Files and staging.
- A connection that worked stops working. The stored authorisation was withdrawn or has expired. Open the connection and connect the account again. Editing the other fields does not restore it.
- Sign-in fails with AADSTS9002327. The redirect URI is registered as Single-page application. Register it under Web instead.
- Sign-in fails with AADSTS50011. The redirect URI on the app registration does not match. Copy the Redirect URI again and add it exactly.
Related
- SharePoint Files, which uses the same kind of app registration.
- Source node and Load node.
- Google Drive and Dropbox.