What is A/B testing in a paid traffic campaign?
It is a controlled comparison in which eligible visitors from the same campaign are randomly sent to a control or one alternative, such as two landing pages, and a primary outcome like sales, leads or sign-ups is compared under identical tracking. With FroggyAds you fix the format, targeting, bid, budget and source settings, while your tracker or page-testing tool does the random split. Comparing two separate ad campaigns is a useful buying comparison, but it is not a randomized experiment.
How many visitors does an A/B test need?
It depends on your baseline rate and the smallest lift worth detecting. With a two-sided 5% significance level, 80% power and an equal split, a 2.0% baseline needs about 3,800 visitors per variant to detect 3.0%, about 21,100 per variant to detect 2.4%, and about 78,700 per variant to detect 2.2%. These are illustrative calculations, not results, so run your own numbers before you fund the test.
Is the $50 minimum deposit enough for an A/B test?
The $50 minimum deposit lets you fund your account and start a campaign, but it is not a recommended test budget. Your budget is the visitors you need multiplied by your effective cost per landing-page visit. Hypothetically, at $0.01 per visit, $50 buys about 5,000 visits, which only detects large effects of roughly one percentage point on a 2% baseline. Our starting prices, from $0.003 per click for Push and Native and $0.10 per 1,000 impressions for Display, are starting points; your actual cost depends on your bids, targeting and sources.
Can I split test ad creatives or landing pages in FroggyAds?
Test landing pages by sending one campaign to a single entry URL and letting your tracker or page-testing tool randomize visitors. You can compare creatives by running separate campaigns with matching targeting, bids, budgets and formats, but the auction decides who sees each ad, so treat the result as buying evidence rather than a randomized causal result. We do not describe FroggyAds as a built-in randomization engine, so pair it with the tracker you already use.
Which ad format should I use for my first test?
Pick the single format that best fits your offer, Push, Native, Display or Pop, and hold it constant while you test the page. Changing format alters intent, device mix and audience at the same time, so a format comparison is a separate buying experiment with its own budget and sample-size plan. Choose the format whose traffic suits your offer and lets you reach the required sample affordably.
How do I keep low-quality traffic from distorting an A/B test?
Set quality rules before launch and apply them equally to both variants. FroggyAds works with Adscore and internal quality controls to help filter bot traffic, and you can use whitelists and blacklists to manage sources. Never remove visitors from only one variant after seeing results. If you exclude a source, document the reason and rerun the analysis from the original assignment records.
How do I record which variant produced each conversion?
Store the variant ID with the visitor at assignment and pass it through to the conversion record in your tracker. FroggyAds source identifiers and tracking macros can help link clicks to later activity, and supported postbacks can report conversions, but the campaign ID alone does not tell you which page version a returning visitor saw. Keep assigned, exposed and converted counts separate so missing events cannot hide missing participants.
How long should an A/B test run?
Run until the planned sample is reached and the outcome window has matured, covering at least one full weekly cycle so weekday and weekend behaviour are both included. If purchases or lead approvals arrive days later, include that delay before analysing. Checking daily and stopping at the first favourable reading inflates false positives, so use a method designed for sequential looks if you want the option to stop early.
What is a sample ratio mismatch and why does it matter?
It is a gap between the actual group counts and the planned split that is larger than chance explains. For example, a hypothetical 50/50 test with 21,400 and 20,800 visitors gives a chi-square of about 8.5 and a p-value near 0.003, which signals an assignment, redirect or logging fault. Investigate the cause before you read any conversion rate, and do not delete records to make the ratio look right.
When should I roll out the winner and raise the budget?
Roll out after the primary outcome meets your pre-set analysis plan, guardrails such as lead validity or refunds stay acceptable, and the effect is large enough to matter after costs. Move traffic in steps, keep the control as a fallback, and raise FroggyAds budgets gradually while checking that your cost per outcome holds. A winning test reduces risk, but it does not guarantee future sales or profit.