Differences
This shows you the differences between two versions of the page.
|
se:labs:07 [2024/11/28 11:32] cosmin.dumitrache |
se:labs:07 [2025/11/25 17:50] (current) cosmin.dumitrache [2. Experiments] |
||
|---|---|---|---|
| Line 29: | Line 29: | ||
| For an early-stage product you're probably going to want to be focusing more on types of experiments with high potential impact. This is because: | For an early-stage product you're probably going to want to be focusing more on types of experiments with high potential impact. This is because: | ||
| - As an early-stage startup you probably will not have a big enough volume of users to get statistically significant data in a reasonable amount of time unless the experiment makes a big impact (in which case you will be able to make decisions with less data). | - As an early-stage startup you probably will not have a big enough volume of users to get statistically significant data in a reasonable amount of time unless the experiment makes a big impact (in which case you will be able to make decisions with less data). | ||
| - | - Your product is not mature so it makes more sense to work on things with high impact first. Making improvements with low impact is not the optimal path to finding product/market fit. So best to defer these for later. | + | - Your product is not mature so it makes more sense to work on things with high impact first. Making improvements with low impact is not the optimal path to finding product/market fit. So it's best to defer these for later. |
| </note> | </note> | ||
| Line 68: | Line 68: | ||
| {{:se:labs:posthog-experiment.png?600|}} | {{:se:labs:posthog-experiment.png?600|}} | ||
| - | Now configure the experiment goal and minimum detectable effect. | + | Now configure the experiment goal (primary metric). |
| {{:se:labs:posthog-experiment-overview.png?600|}} | {{:se:labs:posthog-experiment-overview.png?600|}} | ||
| - | For the **Experiment goal** we want to use a **Funnels** type metric and look only at the **LandingPage to Login** step. Also, for our example purposes set the **conversion window to 1 minute** and uncheck **Filter out internal and test users**. | + | For the **Experiment goal (primary metric)** we want to use a **Funnels** type metric and look only at the **LandingPage to Login** step. Also, for our example purposes set the **conversion window to 1 minute** and uncheck **Filter out internal and test users**. |
| <note tip> | <note tip> | ||
| Line 80: | Line 80: | ||
| {{:se:labs:posthog-experiment-goal.png?600|}} | {{:se:labs:posthog-experiment-goal.png?600|}} | ||
| - | For **Minimum detectable effect** set 10%. | ||
| - | |||
| - | {{:se:labs:posthog-experiment-min-det-effect.png?400|}} | ||
| Now hit the **Launch** button at the top-right to start your experiment. The results section will show an empty state initially until experiment data is received. | Now hit the **Launch** button at the top-right to start your experiment. The results section will show an empty state initially until experiment data is received. | ||
