Set up A4T reports in Analysis Workspace for Auto-Allocate activities
An Auto-Allocate activity in 蜜豆视频 Target identifies a winner among two or more experiences and automatically reallocates visitor traffic to the winner while the test continues to run and learn. The Analytics for Target (A4T) integration for Auto-Allocate lets you view reporting data in 蜜豆视频 Analytics, and you can optimize for custom events or metrics defined in Analytics.
Although rich analysis capabilities are available in 蜜豆视频 Analytics Analysis Workspace, a few modifications to the default Analytics for Target panel might be required to correctly interpret Auto-Allocate activities. These modifications are needed due to the nuances in optimization metric criteria.
Each type of optimization metric requires a different report configuration in A4T, as follows:
-
Using an Analytics metric
- Maximize metric value per visitor
- Maximize unique visitor conversion rate
-
Using a Target-defined conversion metric
This tutorial covers overall A4T guidance, and criteria-specific report configuration steps.
Analytics metrics with 鈥淢aximize Metric Value Per Visitor鈥 optimization criteria
Definition: (Overall Metric Value) / (# of Visitors)
To configure the report, make the following changes in the A4T report:
- Remove Confidence metrics.
- Remove Lift (Low) and Lift (High). Keep Lift (Med).
- Uncheck the percentage presentation from the Conversion Rate column to avoid confusion. See Overall guidance for A4T below.
- Rename the Conversion rate metric to 鈥淢etric / Visitor.鈥
- Remove Confidence metrics.
- Remove Lift (Low) and Lift (High) Keep Lift (Med).
- Uncheck the percentage presentation from the Conversion Rate column to avoid confusion. See Overall guidance for A4T below.
- Rename the Conversion rate metric to 鈥淢etric / Visitor.鈥
- Ensure that the date and time ranges align with the values you see in the Target report. See Overall guidance for A4T below.
Analytics metrics with 鈥淯nique Visitor Conversion Rate鈥 optimization criteria
Definition: (# of Unique Visitors with a positive value of the metric) / (Total # of Unique Visitors)
Example: Suppose that your optimization metric is Revenue. There are five unique visitors in the activity, and three of those unique visitors make a purchase. In this example, this value = (3 visitors for whom Revenue is positive) / (5 total unique visitors) = 0.6 = 60%.
To configure the report, make the following changes in the A4T report:
- Remove Confidence metrics.
- Remove all three Lift metrics.
- Uncheck the percentage presentation from the Conversion Rate column to avoid confusion. See Overall guidance for A4T below.
- Remove Confidence metrics.
- Remove all three Lift metrics.
- Create a segment to filter visitors with a positive metric value who viewed the activity that was analyzed. See Create a segment below.
- Replace the auto-populated Conversion Rate metric so that is the division between Unique visitors with a positive metric value and unique visitors. See Update the Conversion Rate metric below.
- Uncheck the percentage presentation from the Conversion Rate column to avoid confusion. See Overall guidance for A4T below.
- Ensure that the date and time ranges align with the values you see in the Target report. See Overall guidance for A4T below.
Default A4T Panel report - additional guidance
The following sections contain more information about additional guidance as you set up your default A4T panel report.
Create a segment segment
-
Click the 鈥+鈥 sign next to Segments in the left rail.
-
Title the segment 鈥淰isitors with Positive Metric Value.鈥
-
Under Definition, next to Include, select Visitor.
-
Under Definition, select the optimization metric in your activity.
In this example, assume Revenue as the optimization metric.
-
Select the 鈥渋s greater than鈥 operator, then specify 鈥0鈥.
These settings filter for all visitors with a positive metric value.
-
Click Save.
-
Add the newly created segment named 鈥淰isitors with positive metric value鈥 to the A4T panel.
-
Drag and drop the Unique Visitors metric in the same column as the 鈥淰isitors with Positive Metric Value.鈥
This configuration creates a segment of all unique visitors for whom the metric value is positive. In this example, all unique visitors whose revenue was greater than zero.
Update the Conversion Rate metric update-conversion-metric
-
If you have not already done so, remove the existing Conversion Rate column from the panel, as explained below.
-
Add a metric by clicking the 鈥+鈥 sign next to the Metrics section in the left rail.
-
Name the metric 鈥淐onversion Rate鈥 and define it as 鈥(Unique Visitors with positive metric value)鈥 divided by 鈥淯nique Visitors,鈥 as shown below.
Add the newly created segment (steps defined below) of 鈥淰isitors with positive metric value,鈥 the division operator, the 鈥淯nique Visitors鈥 metric in the numerator, and 鈥淯nique Visitors鈥 as the denominator.
-
Click Save.
-
Drag and drop your newly created 鈥淐onversion Rate鈥 metric into your existing panel.
-
Click the gear icon, then deselect the Percent checkbox, because this value can lead to confusion.
The correct configuration of the report should yield a result that resembles the following illustration:
Target-defined conversion rate
To configure the report, make the following changes in the A4T report:
- Remove Confidence metrics.
- Remove Lift (Low) and Lift (High). Keep Lift (Med).
- Uncheck the percentage presentation from the Conversion Rate column to avoid confusion. See Overall guidance for A4T below.
- Remove Confidence metrics.
- Remove Lift (Low) and Lift (High). Keep Lift (Med).
- Uncheck the percentage presentation from the Conversion Rate column to avoid confusion. See Overall guidance for A4T below.
- Ensure that the date and time ranges align with the values you see in the Target report. See Overall guidance for A4T below.
The correct configuration of the report should yield a result that resembles the following illustration:
Overall guidance for A4T guidance
You can navigate to a pre-built Analytics for Target panel by clicking the link from the report screen in Target (this is referred to later in this guide as the 鈥淭arget-triggered report鈥). Alternatively, you can build the A4T panel in Analytics (details later in this section).
The following sections specify which configurations are required, depending on which of these methods you choose. However, the following steps serve as overall guidance for A4T:
- Remove the confidence metrics from the A4T panel regardless of the panel creation method (both are detailed below). Instead, reference these values in Target reporting. Additionally, activity winners can be identified in Target reporting. Details on activity winner identification can be found in the Identify the activity winner section below.
To avoid confusion, uncheck the 鈥淧ercent鈥 presentation of the Conversion Rate metric. See Hide the percentage from the Conversion Rate column below.
If you are building an A4T panel, ensure that the date and time ranges match that of your Target report. See Align the date and time in the A4T panel below.
Hide the percentage from the Conversion Rate column hide-percentage
-
Click the gear icon next to the title of the Conversion Rate column.
The Column settings dialog box displays:
-
Deselect the Percent checkbox.
Your A4T panel now does not include percentages as the Conversion Rate and matches Target, as shown below:
Align the date and time in the A4T panel aligning-date-and-time
-
Below each panel, check the date range that the panel references to ensure that the date range matches that of the Target report.
-
In Analytics, set the time range to 12:00am 鈥 11:59pm.
Identify the activity winner winner
Auto-Allocate activity winners are selected when there is a winning conversion rate with confidence values greater than or equal to 95%. These values should be referenced in the Target reports, as confidence calculations reflect the more conservative methods Target recommends for Auto-Allocate activities. See Statistical guarantees of Auto-Allocate in the 蜜豆视频 Target Business Practitioner Guide.
Create the A4T for Auto-Allocate panel in Analysis Workspace
-
To create an A4T panel for an Auto-Allocate activity report, start with the Analytics for Target panel in Analysis Workspace, as shown below.
-
Make the following selections:
- Control Experience: Choose any experience.
- Normalizing Metric: Select Visitors (included in the A4T panel by default). Auto-Allocate always normalizes conversion rates by unique visitors.
- Success Metrics: Select the same (optimization) metric that you used during activity creation. If this was a Target-defined conversion metric, select Activity Conversion. Otherwise, select the 蜜豆视频 Analytics metric that you used.