Release impact analysis release-impact
The
Use cases
Use cases for this analysis include:
- Overall performance evaluation: Comparing overall key indicators, such as engagement measures, can help you determine if a given release was overall successful.
- Monitoring: Track vital metrics that you would expect to remain flat when changes are made, such as load time or number of logins. Use this analysis to compare them before and after a release to ensure that it didn’t have any unintended consequences.
- Feature adoption: If a product update is focused on improving a certain feature, you can use this analysis to directly compare that feature’s usage before and after the product update.
- Bug detection: Tracking the number of errors before and after a release can provide an early indicator of customer issues. If you notice an increase of errors immediately following a release, you can work with engineering or development teams to identify and correct the issue, preventing further impact to customers.
Interface
See Interface for an overview of the Guided analysis interface. The following settings are specific to this analysis:
Query rail
The query rail allows you to configure the following components:
- View: Switch between this analysis and First use impact.
- Key indicators: The events that you want to measure per user. Each selected key indicator is represented as a colored line. A row representing the event is added to the table. You can include up to three events.
- Counted as: The counting method that you want to apply to the selected events. Options include Events per user, Percentage of users, Events, Sessions, and Users.
- Factors: The date that you want to compare before and after.
- Segments: The segment that you want to measure. The selected segment filters your data to focus only on the individuals who match your segment criteria.
Chart settings
The Release impact analysis offers the following chart settings, which can be adjusted in the menu above the chart:
- Chart type: The type of visualization that you want to use. Options include Line and Bar.
Date range
Date selection in Impact analysis operates differently than other analyses, since the report revolves around the date specified in the query rail. The following options are available:
- Interval: The date granularity that you want to view trended data by. Valid options include Daily, Weekly, Monthly, and Quarterly. Changing the interval affects the options available for the Before and after period.
- Before and after period: The amount of time to analyze before and after the date specified in the query rail. Available options depend on the Interval selection.