Holdout ‐ A/B Testing & CRO vs pagent

Two Shopify apps, side by side: detected stores, momentum, reviews, plans, listed features and who runs each. Store counts as of Nov 18, 2026.

The short answer

  • Only pagent lists a free plan. Paid plans start at $79/month for Holdout ‐ A/B Testing & CRO and $49/month for pagent.

Head to head

App Store reviews

Holdout ‐ A/B Testing & CRO: 2
pagent: —
Open this comparison in ShoplistFree account. Every feature, store and change, side by side.
Pitch
—
—
Categories
  • Site optimization - Other
  • Site optimization - Other
Languages
  • English
  • English
Launched
Sep 28, 2026
Nov 18, 2026
Built for Shopify
Not badged
Not badged
Reviews per month
—
—
Detected stores
0active installs
0active installs
Most common store size
—
—
Top countries
—
—
Free options
Free planFree trial
Free planFree trial
Monthly range
From $79 to $349/month
From $0 to $189/month
Plans
Starter$79/month
14-day free trial
  • · 20,000 tested visitors / month
  • · 200 AI suggestions / month
  • · 3 concurrent tests
  • · Data exports
  • · Every test type, price tests included
Growth$149/month
14-day free trial
  • · 1,000 AI suggestions / month
  • · 10 concurrent tests
  • · 100,000 tested visitors / month
  • · Every test type, price tests included
  • · Guided onboarding call
  • · Segment analysis and data exports
Pro$349/month
14-day free trial
  • · 400,000 tested visitors / month
  • · 5,000 AI suggestions / month
  • · 50 concurrent tests
  • · Every test type, price tests included
  • · Guided onboarding call
  • · Monthly review of your running tests
FreeFree
  • · 1 free test a month
  • · Agent usage included each month
Basic$49/month
  • · 40 agent tasks a month
  • · Unlimited tests, 1 running at a time
Growth$99/month
  • · 120 agent tasks a month
  • · Unlimited tests, 4 running at a time
Scale$189/month
  • · 400 agent tasks a month
  • · Unlimited tests running at once
Coverage
0 of 0 features0%
0 of 0 features0%
Unique strengths
—
—
000onlybothonly
Holdout ‐ A/B Testing & CROpagent0 features listed across both App Store listings

Coverage counts what each App Store listing names. Every feature, checked off app by app, is in Shoplist.

See every feature
Works with also listed by another
—
—
How it sells itself

Holdout runs A/B tests on your storefront without touching theme files. Describe the change you want, preview both versions, choose the audience and the goal, then launch. It measures conversion rate, revenue per visitor, add-to-cart and order value, and applies the winner as a runtime rule you can roll back at any time. Every test is held to a minimum duration and a calibrated threshold.

An agent studies your store, then suggests tests worth running: a free-shipping bar, delivery details next to the buy button, a sticky add to cart on mobile. Pick one or describe your own in chat; the agent builds it, checks it on desktop and mobile, and you preview it on your store before anything goes live. Half your visitors see the change.

Key points
  • No theme code. Changes run at display time and leave nothing behind.
  • Promotion stays locked until duration, volume and data checks all pass.
  • Roll back to the original version in one click, at any point in the test.
  • Three suggested tests for your store, each with an estimate of how long it takes
  • Describe a change in chat; the agent builds and checks it on desktop and mobile
  • Preview every change on your own store before visitors see it
  • Results per version: add-to-cart rate, conversion and revenue per visitor
Screenshots
Create a test by picking an element and writing the new version
Every decision gate, and what is still missing to call a winnerResults broken down by device and by countryResults screen comparing both versions of a product page
Asking the agent for a change in the test's chat
pagent: a test's before and after preview in the Shopify adminHome with tests the agent suggested for the storeBefore and after preview of a test on a phone

All the numbers

Every figure, side by side

A green dot marks the app ahead on a measured figure. Estimates, gaps and apps that leave no storefront trace never take the lead.

Showing only the rows where the apps differ.

Adoption

MeasureHoldout ‐ A/B Testing & CROpagent
Detected storesNot publishedNot published
Net store change, 28 days0estimated0
Stores added, 28 daysNot enough dataNot enough data
Big-brand shareNot enough dataNot enough data
Top store categoriesNot publishedNot published
Top store countriesNot publishedNot published

Reviews

MeasureHoldout ‐ A/B Testing & CROpagent
App Store rating5.0 ★Not published
App Store reviews2Not published
New reviews, 28 days0Not enough data
Reviewers a year or more inNot enough dataNot enough data

Pricing

MeasureHoldout ‐ A/B Testing & CROpagent
Free planNot listedYes
Lowest paid monthly plan$79/month$49/month(ahead)
Longest free trial14 daysNot listed
Plans listed34

Listing

MeasureHoldout ‐ A/B Testing & CROpagent
Shopify category rank#52in Site optimization - OtherNot enough data
Shopify App ChartsNot on this week’s chartsNot on this week’s charts
Built for ShopifyNoNo
LaunchedSep 28, 2026Nov 18, 2026
Languages1English1English
DeveloperSwicelso OÜaihumin GmbH

FAQ

Holdout ‐ A/B Testing & CRO and pagent: common questions

Is Holdout ‐ A/B Testing & CRO or pagent cheaper?
Only pagent lists a free plan. Paid plans start at $79/month for Holdout ‐ A/B Testing & CRO and $49/month for pagent. Shoplist compares base prices only between monthly plans in the same currency; usage charges and annual plans vary, so check each plan’s limits.
Where does this comparison’s data come from?
Shoplist crawls Shopify storefronts to detect which apps each store runs, and reads each app’s Shopify App Store listing for reviews, pricing, features and integrations. Store counts are as of Nov 18, 2026; estimated figures are labeled.

How Shoplist compares apps

Store counts come from Shoplist’s crawl of Shopify storefronts, which detects the apps each store runs; they are as of Nov 18, 2026. Reviews, ratings, plans, features and integrations come from each app’s Shopify App Store listing. 28-day figures are labeled when estimated, and a figure that is missing or estimated never decides who leads. Read the methodology.