Forum Discussion

MaggieBrennan's avatar
MaggieBrennan
Icon for Community Manager rankCommunity Manager
2 years ago

Welcome to the Test and Learn AMA!

Hi all! Thanks so much Guendalina and dylancarpe for hosting us today. Let's get started with the first question... Guendalina Can you share more about the testing strategy at BlaBlaCar?
AMA
Smart Optimization
ashley_rosen's avatar
ashley_rosen
Active Member

Hi Maggie & Guendalina, 

Guendalina, What are the most important elements to consider in Braze to begin effectively testing? 

dylancarpe's avatar
dylancarpe
Braze Employee
2 years ago

Hi ashley_rosen great question - you should consider the following:

  • 1) Determine what to test
    • Examples: Subject lines, Personalization, Copy, Timing, Channels
  • 2) Set a hypothesis
    • Make a clear hypothesis about what you’re testing. 
    • Example hypothesis: The use of emojis will have a higher open rate
  • 3) Be mindful of statistical significance
    • Use the analytics - be sure to evaluate the significance of the uplift
  • 4) Be thoughtful about the timing of your test
    • Consider testing over longer periods of time to increase reliability
  • 5) Use control groups
    • Control groups are essential in testing a hypothesis and setting a benchmark for engagement to compare marketing efforts