Dashboards

Dashboards

In Brief

A dashboard is a simple view of product metrics that displays information about the general health and viability of the product. While more detailed metrics are generally used to analyze the results of a specific feature-level experiment, a dashboard can indicate when complex factors are affecting the product. For example, competitor behaviors, seasonality, or multiple conflicting experiments are all potential factors.

Helps Answer

  • What is going on in the business right now?
  • How is the situation changing over time?
  • Do we have any major blind spots?
  • Does everyone in the company have access to the right metrics to track progress to overarching goals?
  • Are we making the right decision right now?
  • What are our current priorities?

Tags

  • Visual
  • Metrics
  • Tracking
  • Operations
  • KPI

Description

In situations where there is great uncertainty, planning for the future has less value than having a clear picture of the current status. Dashboards give you a visual "information radiator" that shows the exact current status on key metrics affecting operations:

  • How much of a product is built, or a goal already achieved?
  • What is the state of current channel-testing in marketing?
  • What is our market share?

Dashboards help visualize inter-relationships among parts of a business. For example, a $10k investment in a channel may seem like a lot of money, unless you knew that last year's revenue was $250k.

Dashboards are inherently motivating. They presuppose an open and data-driven culture. For many employees and partners, this level of trust and transparency motivates them to do their best work. By going through the effort of choosing one or a handful of key metrics for the whole organization, you generate a lot of focus. Dashboards help maintain this focus operationally if everyone continually checks a dashboard that contains those key metrics driving the business.

This technique can be used for:

  • The company as a whole
  • Specific departments
  • Key roles (such as the VP of Marketing's dashboard)
  • Individual contributors

In terms of how it works, it can be anywhere from "manually using a spreadsheet" to a custom-built monitoring system that integrates a number of the business systems so that you have a "real-time view" of the company.

Approaches that may or may not be helpful:

  • AARRR: Pirate metrics can help.

Time Commitment and Resources

This method tends to require a significant investment of thought to decide what needs to be on each dashboard (1-5 days). The implementation of the dashboard itself can vary widely. If done manually, it could cost one hour a week of a junior employee's time. If automated, there would be no recurring cost, but instead a potentially significant up-front technical implementation cost. The actual cost would vary widely based on exactly which systems and data need to be visualized. There are also off-the-shelf SaaS solutions that can provide a sufficient subset of the data required to reap most of the benefits in a small company, without bearing a significant cost.

How to

  1. Get all of the key decision-makers in one room, ideally physically (even if it's one startup founder).
  2. Decide what needs to be on the dashboard(s). What are the key metrics and drivers of the business as a whole?
  3. Design a process and/or a visualization of those key metrics.
  4. Include visual cues to help interpret quantitative data, such as two standard deviations.
  5. Consider how much you need to integrate "change over time" or cohort analysis in the dashboard, so that it's actionable.
  6. Publish them in a visually accessible place for everyone they affect.

Possible resources include:

  • Google Sheets: Manually keep track of key metrics in a spreadsheet.
  • Cyfe.com: Basic integration with a lot of standard startup tools.
  • Geckoboard.com: Geared towards being a TV interface in an open office space.
  • GuidingMetrics.com: Builds dashboards for small businesses.
  • BareMetrics.com: Subscription analytics and insights for SaaS or other subscription businesses.
  • Mixpanel.com: Decent free option for product-level analytics.
  • Tableau: Enterprise-level data visualization tool.

Interpreting Results

Dashboard colors, shapes (traffic light), and status icons help you quickly interpret the reported data. The size of each dashboard component should also reflect the importance of the particular data point.

Potential Biases

  • Graphs and visualizations can easily be misleading.
  • Using scales on an axis that doesn't start from zero will make the immediate trend swings seem much bigger, and therefore draw attention away from the fact that the absolute value is quite high.
  • Labels and naming on axes are often overlooked or unclear.
  • Data can intentionally or inadvertently be left out, making it possible to draw conclusions that do not reflect the full picture of a situation.
  • Sources should be fully documented, clear, and agreed upon by all parties.
  • Using cumulative graphs rather than breaking down data by time period. For example, https://qz.com/122921/the-chart-tim-cook-doesnt-want-you-to-see/
  • Ignoring conventions, such as pie charts that don't add up to 100 percent.

Field Tips

  • A good dashboard communicates everything you need to know even when looking at it from across the room. - @LaunchTomorrow
  • Got a tip? Add a tweetable quote by emailing us: [email protected]

Case Studies

Tools

References

Previous
Evaluative Product Experiment
Next
Net Promoter Score Survey
© All Rights Reserved            updated 2024-04-25 18:24:04

results matching ""

    No results matching ""