In this section (9)

Export to your data warehouse

Send tickets, metrics, people and CSAT ratings to Amazon S3, Google BigQuery or Snowflake every day.

2 min read

Available on Enterprise. Compare plans

The data warehouse export copies your ChaosDesk data into your own storage once a day, so your analysts can join it with the rest of your company’s data.

Only admins can set it up, under Reporting, Data warehouse.

What is exported

Each export sends only what changed since the last run. You pick the datasets:

DatasetContains
TicketsTicket fields, without the text of comments
Ticket metricsFirst reply, resolution, reopens and other lifecycle numbers
UsersAgents and customers
OrganizationsNew organizations
Satisfaction ratingsCSAT ratings

Every row has a record_id, an updated_at time, an exported_at time and a payload with the record as JSON. Times are in UTC.

A record that changes is exported again. To get the current state, keep the newest row per record_id, for example:

QUALIFY ROW_NUMBER() OVER (PARTITION BY record_id ORDER BY updated_at DESC) = 1

Destinations

DestinationYou enter
Amazon S3 or an S3-compatible storeBucket, region, access key ID and secret access key. Optional: a prefix, and an https endpoint for other S3-compatible stores
Google BigQueryProject ID, dataset, an optional table prefix (default chaosdesk_), and a service account key (JSON) with the BigQuery Data Editor role on the dataset
SnowflakeAccount, user, database, schema, warehouse, optional role and table prefix, and the user’s private key for key-pair sign-in

In S3, each run writes compressed newline-delimited JSON files, one folder per dataset and day. In BigQuery and Snowflake, ChaosDesk creates one table per dataset the first time it writes.

Secrets are stored encrypted and never shown again.

Set up an export

  1. Open Reporting, Data warehouse and choose Add an export.
  2. Give it a name and pick the destination.
  3. Enter the destination details and pick the datasets.
  4. Choose the hour of day (UTC) when it runs.
  5. Choose Create export.
  6. Choose Test connection: ChaosDesk writes one row to a connection_test table or folder.

The page shows the last successful export, the next one and the rows exported. To send the changes now instead of waiting, choose Run now. Pause stops the daily runs until you choose Resume.

If a run fails

The error is shown on the page. Nothing is lost: ChaosDesk tries again later (after 5 minutes, then waiting longer each time, up to 6 hours) and continues from where the last accepted batch ended.

The first export of a large workspace takes several runs to catch up.

Was this article helpful?