Skip to content

Creating Golden Paths for Developers with Blueprints

โ†’ Register for the October 10 webinar

Usageยป

Download Usage Dataยป

Usage data can be downloaded:

  • from the Usage page: Organization Settings -> Other -> Usage
  • using spacectl command: spacectl profile usage-csv
  • via the Spacelift API at https://<your-spacelift-host>/usageanalytics/csv (note: this is not a GraphQL endpoint)

Analyzing Usage Dataยป

Load CSV data into PostgreSQLยป

Create a table for worker count and load the CSV file into the table:

1
2
3
4
5
6
create table worker_count (
  id int,
  count int,
  timestamp_unix int,
  worker_pool_name varchar(255)
);
1
psql -h <host> -U <user> -d <database> -c "\copy worker_count from '<path-to-csv-file>' delimiter ',' csv header"

And the same for run minutes:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
create table run_minutes (
  timestamp_unix bigint,
  state_duration_minutes float,
  public boolean,
  run_state varchar(255),
  run_type varchar(255),
  run_ulid varchar(26),
  stack_name varchar(255),
  stack_slug varchar(255),
  stack_ulid varchar(26),
  is_stack boolean,
  worker_pool_name varchar(255),
  worker_pool_ulid varchar(26)
);
1
psql -h <host> -U <user> -d <database> -c "\copy run_minutes from '<path-to-csv-file>' delimiter ',' csv header"

ELK stackยป

CSV files can be easily imported into Elastic Stack for visualization. The following example shows how to import your csv data into Kibana using Data Visualizer.

Steps:

  1. Download the CSV file.

    1
    spacectl profile usage-csv -aspect run-minutes > usage.csv
    

    Note: the exported CSV data doesn't contain zero values, so percentile calculations will be incorrect. To fix this, you can add zero values to the CSV file before processing it.

  2. Open Kibana and go to Machine Learning

  3. Select the CSV file.

  4. Use the mappings that were automatically generated by Kibana.

  5. Create a visualization using the imported data.

    Here's an example of a visualization that shows the number of run minutes on private workers, broken down by the run state: