You can now run
native A/B split tests directly inside Vidalytics
— no spreadsheets, no external tools, no messy attribution.
Compare two videos on a single placement (embed), choose one primary goal (like CTA Click, Opt-in, or Conversion Rate), and get a clear, directional readout showing who’s ahead.
Built for performance marketers who care about conversions — not just views.
🆕
What’s New
Video vs Video A/B Testing (Single Placement)
Run
Control vs Variant (Challenger)
tests on one embed/placement.
Default
50/50 traffic split
(customizable).
Choose a
single primary goal metric
, such as:
  • Conversion Rate
  • Click Rate
  • Opt-in Rate
  • Avg % Watched
  • Unmute Rate
  • Bounce Rate
Add a
test hypothesis or notes
directly inside the experiment.
Experiments Hub
A centralized dashboard to manage all your tests:
  • View status (Draft, Running, Paused, Finished)
  • See running period and viewers
  • Track simple
    Impact
    (difference between variants on the primary goal)
  • Search by test name
  • Open any test profile instantly
Dedicated Test Profile (Setup + Reporting in One Place)
Each experiment includes:
  • Scope, goal, and traffic allocation
  • Start/end dates
  • Variant previews
  • Side-by-side reporting modules
  • Engagement graphs per video (switchable between audience & conversion metrics)
Embed-Based Testing (No Extra Work Required)
  • If the Control video is already embedded — just start the test.
  • No need to re-embed anything.
  • Otherwise, copy the embed code directly from the test profile.
Safe Execution Controls
  • Start
    – Allocate traffic immediately.
  • Pause
    – Automatically falls back to Control.
  • Resume
    – Preserves sticky allocation.
Sticky Allocation + Clean Attribution
  • Visitors are randomly assigned on page load.
  • Allocation remains sticky for the duration of the test.
  • All events and metrics are attributed to the assigned variant.
  • Prevents viewers from seeing multiple variants mid-funnel.
Finish Flow + Winner Selection
When ready:
  • Finish the test from Running or Paused.
  • Declare a
    Winner
    or mark as
    Inconclusive
    .
  • Optionally apply winner to
    100% traffic
    automatically.
> If 100% traffic is applied to the Variant, Control and Variant embeds swap internally — no page changes required.
Directional Reporting (Without Heavy Stats)
  • Summary view focused on your chosen goal metric
  • Impact shown after minimum duration and play thresholds
  • Engagement graphs per variant
  • No heavy statistical certification in this beta — reporting is directional and threshold-based
🛠️
How to Use It
Experiments RN
  1. Go to
    Experiments → Create Experiment
    .
  2. Enter your test name and optional description.
  3. Select: Control video; Variant (challenger); Traffic split (defaults to 50/50)
  4. Choose your primary goal metric.
  5. If the Control video is already embedded on the page, you’re ready to go. Otherwise, copy the embed code from the test profile and paste it on your target page.
  6. Click
    Start
    .
  7. Monitor performance in: Summary report; Engagement graphs
  8. When ready, click
    Finish
    and declare a winner.
  9. Optionally apply winner to 100% of traffic.
💡
Benefits
  • Native video split testing
    focused on performance, not vanity metrics.
  • Optimize creatives against CTA clicks, opt-ins, conversions, and more.
  • Faster decisions with simplified, directional reporting.
  • Production-safe testing with sticky allocation.
  • Pause safely without breaking funnels.
  • No spreadsheets or external testing tools required.
⚠️
Restrictions
  • Available starting on our
    Pro Plan
    and up.
  • Beta scope:
    Regular videos only
  • Smart Vids not supported
  • No A/B/n or feature tests
  • One primary goal metric per test
  • No 95% statistical certification in this beta
  • The same video cannot be included in two running tests simultaneously
  • Draft tests can be deleted; archiving for finished tests is coming soon
If you have questions or feedback, reach out to hi@vidalytics.com