Overview

The Infrastructure Overview dashboard provides a centralised view of your data systems' health and performance. Use this page to monitor data storage statistics, query performance, and the operational status of key services to ensure your data is flowing correctly and efficiently.

This guide will walk you through each section of the dashboard, explaining the available metrics and how to interpret them.

Accessing the Infrastructure Overview

To get to the Infrastructure Overview dashboard, follow these steps:

1. From the main Workspace Overview, navigate to the left-hand sidebar.

2. Click on the Infrastructure icon

Understanding the Infrastructure Dashboard

The dashboard is organised into three primary tabs, each focusing on a different component of your data infrastructure:

• Warehouse: Monitors your data warehouse tables, storage, and database performance.

• Key Value Store: Shows the operational health of your in-memory data stores.

• Pipeline: Tracks the performance of your data ingestion pipeline.

Warehouse

The Warehouse tab is the default view and provides detailed insights into your data storage and database activity.

Table Storage

This section displays statistics and growth trends for the different tables in your data warehouse.

• Metrics Displayed:

  • Total Rows: The current number of rows in the selected table.

  • Total Size: The current disk size of the table.

  • Size Uncompressed: The size of the data before compression.

• Analysing Data:

  • You can switch between the Events Table, Profile Table, and Products Table by clicking the corresponding buttons at the top right of the section.

  • Hover over the bar chart to see the cumulative row count for any given day, helping you visualise data growth over time.

Database Reads & Writes

These sections help you monitor the performance and throughput of your database.

• Database Reads:

  • Throughput (QPS): Queries Per Second, indicating the read load on the database.

  • Response Time: The average time taken to complete a read query.

• Database Writes:

  • Throughput (WPS): Writes Per Second, indicating the write load on the database.

💡 Tip: Use these charts to identify performance bottlenecks. A sudden spike in response time or a drop in throughput might indicate an issue that needs investigation.

Key Value Store

The Key Value Store tab provides a quick, at-a-glance view of the operational status of services used for fast data retrieval and lookups.

Each service listed displays its current health status.

• Profile Lookup: Used for fast user profile data retrieval.

• Data API Cache: Caches API responses and queries to improve speed.

• User Flow Metadata: Stores workflow and journey metadata.

• GeoIP Cache: Used for geographic IP location data.

A green "Operational" status indicates that the service is running correctly. If a service shows a different status, it may require attention.

Pipeline

The Pipeline tab allows you to monitor the efficiency of your user event data ingestion process. This is crucial for ensuring that data from your applications is being collected and processed in a timely manner.

You can analyse two key aspects of your user events pipeline:

• Ingestion Time: This chart shows the average time (in seconds) it takes for events to be processed. Hover over the chart to see the specific ingestion time for a given day.

• Volume: This chart shows the total number of events ingested per day. Use this to track data volume trends and identify any unexpected drops or spikes.