Holdout ‐ A/B Testing & CRO vs pagent
Two Shopify apps, side by side: detected stores, momentum, reviews, plans, listed features and who runs each. Store counts as of Nov 18, 2026.
The short answer
- Only pagent lists a free plan. Paid plans start at $79/month for Holdout ‐ A/B Testing & CRO and $49/month for pagent.
Head to head
Starter
- · 20,000 tested visitors / month
- · 200 AI suggestions / month
- · 3 concurrent tests
- · Data exports
- · Every test type, price tests included
Growth
- · 1,000 AI suggestions / month
- · 10 concurrent tests
- · 100,000 tested visitors / month
- · Every test type, price tests included
- · Guided onboarding call
- · Segment analysis and data exports
Pro
- · 400,000 tested visitors / month
- · 5,000 AI suggestions / month
- · 50 concurrent tests
- · Every test type, price tests included
- · Guided onboarding call
- · Monthly review of your running tests
Free
- · 1 free test a month
- · Agent usage included each month
Basic
- · 40 agent tasks a month
- · Unlimited tests, 1 running at a time
Growth
- · 120 agent tasks a month
- · Unlimited tests, 4 running at a time
Scale
- · 400 agent tasks a month
- · Unlimited tests running at once
Coverage counts what each App Store listing names. Every feature, checked off app by app, is in Shoplist.
See every featureHoldout runs A/B tests on your storefront without touching theme files. Describe the change you want, preview both versions, choose the audience and the goal, then launch. It measures conversion rate, revenue per visitor, add-to-cart and order value, and applies the winner as a runtime rule you can roll back at any time. Every test is held to a minimum duration and a calibrated threshold.
An agent studies your store, then suggests tests worth running: a free-shipping bar, delivery details next to the buy button, a sticky add to cart on mobile. Pick one or describe your own in chat; the agent builds it, checks it on desktop and mobile, and you preview it on your store before anything goes live. Half your visitors see the change.
- No theme code. Changes run at display time and leave nothing behind.
- Promotion stays locked until duration, volume and data checks all pass.
- Roll back to the original version in one click, at any point in the test.
- Three suggested tests for your store, each with an estimate of how long it takes
- Describe a change in chat; the agent builds and checks it on desktop and mobile
- Preview every change on your own store before visitors see it
- Results per version: add-to-cart rate, conversion and revenue per visitor




All the numbers
Every figure, side by side
A green dot marks the app ahead on a measured figure. Estimates, gaps and apps that leave no storefront trace never take the lead.
Adoption
| Measure | Holdout ‐ A/B Testing & CRO | |
|---|---|---|
| Detected stores | Not published | Not published |
| Net store change, 28 days | 0 | 0 |
| Stores added, 28 days | Not enough data | Not enough data |
| Big-brand share | Not enough data | Not enough data |
| Top store categories | Not published | Not published |
| Top store countries | Not published | Not published |
Reviews
| Measure | Holdout ‐ A/B Testing & CRO | |
|---|---|---|
| App Store rating | 5.0 ★ | Not published |
| App Store reviews | 2 | Not published |
| New reviews, 28 days | 0 | Not enough data |
| Reviewers a year or more in | Not enough data | Not enough data |
Pricing
| Measure | Holdout ‐ A/B Testing & CRO | |
|---|---|---|
| Free plan | Not listed | Yes |
| Lowest paid monthly plan | $79/month | $49/month(ahead) |
| Longest free trial | 14 days | Not listed |
| Plans listed | 3 | 4 |
Listing
| Measure | Holdout ‐ A/B Testing & CRO | |
|---|---|---|
| Shopify category rank | #52 | Not enough data |
| Shopify App Charts | Not on this week’s charts | Not on this week’s charts |
| Built for Shopify | No | No |
| Launched | Sep 28, 2026 | Nov 18, 2026 |
| Languages | 1 | 1 |
| Developer | Swicelso OÜ | aihumin GmbH |
FAQ
Holdout ‐ A/B Testing & CRO and pagent: common questions
- Is Holdout ‐ A/B Testing & CRO or pagent cheaper?
- Only pagent lists a free plan. Paid plans start at $79/month for Holdout ‐ A/B Testing & CRO and $49/month for pagent. Shoplist compares base prices only between monthly plans in the same currency; usage charges and annual plans vary, so check each plan’s limits.
- Where does this comparison’s data come from?
- Shoplist crawls Shopify storefronts to detect which apps each store runs, and reads each app’s Shopify App Store listing for reviews, pricing, features and integrations. Store counts are as of Nov 18, 2026; estimated figures are labeled.
How Shoplist compares apps
Store counts come from Shoplist’s crawl of Shopify storefronts, which detects the apps each store runs; they are as of Nov 18, 2026. Reviews, ratings, plans, features and integrations come from each app’s Shopify App Store listing. 28-day figures are labeled when estimated, and a figure that is missing or estimated never decides who leads. Read the methodology.


