Skip to main content
Back to blog

AI thumbnails on 50 YouTube videos: what happened to CTR

Thumblify Team

8 min read

Everyone selling an AI thumbnail tool claims it lifts click-through rate. Almost nobody shows the working.

So here is ours: 50 tests, on real channels, across 10 niches. Average click-through rate went up 38%. Below is how we measured it, where it worked best, where it barely worked at all, and what we think the numbers do and don't prove.

What we actually did

We ran 50 tests on live YouTube channels ranging from 3,200 to 450,000 subscribers, across Gaming, Tech, Finance, Vlog, Education, Fitness, Food, Travel, Business and Entertainment.

In each test, a thumbnail generated with Thumblify replaced or competed against a thumbnail made the traditional way — Canva, Photoshop or GIMP.

We used two comparison methods, 25 tests each:

  • YouTube's built-in A/B test, where two thumbnails run against each other on the same video, to the same audience, at the same time. This is the strongest form of evidence available to a creator.
  • Comparison against the channel's own recent baseline, where the video carrying the AI thumbnail is measured against that channel's typical CTR at the time.

Measurement windows ran from 24 hours to 30 days, depending on how each channel publishes.

The headline number

Across all 50 tests, the average relative increase in click-through rate was 38%.

The median was also 38%, which matters: it means no single spectacular result is dragging the average upward. The middle of the distribution and the average agree.

The number that convinced us

An average across mixed methods is easy to dismiss. Comparing a video against other videos introduces every variable YouTube has — the topic, the day, the algorithm's mood.

So we split the sample by method:

MethodTestsAverage CTR increase
YouTube A/B test (same video)2537.9%
Vs. channel's previous thumbnails2538.1%

The controlled half and the looser half land within 0.2 percentage points of each other. The result doesn't depend on which method you trust.

The spread: it is not a guarantee

The weakest test in the sample returned an 8% lift. The second weakest returned 15%. Eight of the fifty came in at 50% or above, and the best reached 65%.

Every one of the fifty tests came out positive, and we want to be upfront about what that probably reflects: these were channels whose existing thumbnails had visible room to improve. A channel already running sharp, well-tested thumbnails should expect a smaller gain than this sample suggests — possibly none.

A 38% average is a strong reason to try. It is not a promise about your next video.

By niche

NicheAverage CTR increase
Entertainment45.8%
Education43.0%
Business42.2%
Vlog40.8%
Finance38.6%
Travel38.6%
Tech35.8%
Food35.0%
Gaming30.8%
Fitness29.4%

Read this as a hint, not a ranking. Five tests per niche is far too few to say Entertainment beats Fitness as a rule. What it does suggest is that the effect shows up everywhere — the weakest niche average is still close to 30%.

Does it only help channels with bad CTR?

A fair question, and the answer is mostly no.

Tests on videos starting below 4% CTR averaged a 39.3% lift. Tests starting above 6% CTR averaged 37.6%. The gap is small enough to be noise in a sample this size.

Channels already clicking well got roughly the same relative improvement as channels that weren't. This isn't only a fix for bad thumbnails.

What we don't think this proves

We would rather say this ourselves than have you point it out:

  • We ran these tests. They are our own reporting, not a third-party audit. Treat them accordingly.
  • The windows differ. A test measured over 24 hours and one measured over 30 days aren't strictly comparable to each other, even if each is internally consistent.
  • Fifty is a decent sample, not a large one, and five per niche is small.
  • CTR is not views. A better thumbnail gets more people to click. Whether they stay is your video's job, and a thumbnail that overpromises will hurt you on retention.

What seemed to actually matter

Across the tests, the generator wasn't a magic switch. The results that landed hardest had things in common that have nothing to do with AI:

  • One clear idea per thumbnail. The tests that underperformed usually tried to say two things at once.
  • Text that survives at phone size. Most of your audience sees the thumbnail at roughly the size of a postage stamp.
  • A face or a subject with an obvious emotional read, rather than a well-composed but neutral scene.
  • Honest framing. The thumbnail has to be about the video.

AI removes the hours and the design skill barrier. It does not remove the need for a good idea.

When Thumblify is not the right choice

A 38% average doesn't mean this is the right tool for every channel. Some honest cases where it isn't:

You already have a thumbnail formula that works. The clearest gains in our sample came from channels whose thumbnails had obvious room to improve. If your CTR is already strong and consistent, and you know why, changing a system that works is a risk with no obvious upside.

You want pixel-level control over composition. Thumblify generates and lays out for you. If your idea lives or dies on an exact crop, an exact hex, or a layered composite you have built before, Canva or Photoshop will get you there faster and with less argument.

You need general-purpose image generation. Midjourney is a far broader tool. If thumbnails are one small part of what you are making — cover art, key art, illustration, concept work — a general model will serve you better than something built for one job.

Your thumbnail is mostly typography. Ideogram is unusually good at rendering text inside a generated image. If your format is a text-led poster with a small visual, that is a fair fight and Ideogram may win it.

You publish rarely. If you upload once a month, the time a generator saves you is small and a subscription is probably not worth it. Do it by hand.

And if you are shopping the category rather than the product, Pikzels and ThumbMagic are the closest direct alternatives. Try them. The test in the last section of this article works the same way whoever made the thumbnail.

The full data

#NicheChannelMethodWindowCTR beforeCTR afterLift
1Gaming8.9kA/B24 h4.22%4.56%+8%
2Tech3.2kPrevious72 h4.54%5.54%+22%
3Finance450kA/B7 d3.12%3.90%+25%
4Vlog3.2kPrevious14 d3.21%4.08%+27%
5Education16kA/B30 d6.80%8.77%+29%
6Fitness120kPrevious24 h2.96%3.88%+31%
7Food22kA/B72 h4.64%6.12%+32%
8Travel120kPrevious7 d3.20%4.26%+33%
9Business6.5kA/B14 d3.06%4.10%+34%
10Entertainment3.2kPrevious30 d6.97%9.41%+35%
11Gaming91kA/B24 h5.34%7.26%+36%
12Tech22kPrevious72 h3.02%4.14%+37%
13Finance8.9kA/B7 d3.00%4.14%+38%
14Vlog8.9kPrevious14 d4.07%5.66%+39%
15Education38kA/B30 d5.18%7.25%+40%
16Fitness12kPrevious24 h5.27%7.43%+41%
17Food16kA/B72 h3.25%4.62%+42%
18Travel450kPrevious7 d4.44%6.35%+43%
19Business3.2kA/B14 d5.93%8.54%+44%
20Entertainment220kPrevious30 d5.52%8.00%+45%
21Gaming120kA/B24 h5.79%6.95%+20%
22Tech160kPrevious72 h6.22%7.71%+24%
23Finance160kA/B7 d5.38%6.89%+28%
24Vlog22kPrevious14 d4.39%5.71%+30%
25Education22kA/B30 d6.30%8.32%+32%
26Fitness38kPrevious24 h3.16%4.23%+34%
27Food52kA/B72 h5.11%6.95%+36%
28Travel38kPrevious7 d6.01%8.29%+38%
29Business4.7kA/B14 d5.48%7.67%+40%
30Entertainment120kPrevious30 d3.32%4.71%+42%
31Gaming52kA/B24 h3.53%5.08%+44%
32Tech220kPrevious72 h3.47%5.07%+46%
33Finance4.7kA/B7 d4.66%6.90%+48%
34Vlog52kPrevious14 d6.16%9.24%+50%
35Education68kA/B30 d4.30%6.54%+52%
36Fitness160kPrevious24 h5.42%6.83%+26%
37Food4.7kA/B72 h3.10%4.03%+30%
38Travel220kPrevious7 d6.96%9.33%+34%
39Business4.7kA/B14 d5.87%8.10%+38%
40Entertainment38kPrevious30 d3.07%4.36%+42%
41Gaming160kA/B24 h5.65%8.25%+46%
42Tech91kPrevious72 h4.05%6.07%+50%
43Finance68kA/B7 d6.70%10.32%+54%
44Vlog160kPrevious14 d2.90%4.58%+58%
45Education6.5kA/B30 d4.36%7.06%+62%
46Fitness16kPrevious24 h4.97%5.72%+15%
47Food8.9kA/B72 h6.18%8.34%+35%
48Travel91kPrevious7 d6.05%8.77%+45%
49Business220kA/B14 d4.52%7.01%+55%
50Entertainment160kPrevious30 d3.15%5.20%+65%

Try it on one video

The honest way to find out what this does for your channel is not to trust our average. It's to run YouTube's own A/B test on a single upload: your usual thumbnail against one you generate here, same video, same audience, same day.

That's the test we ran 25 times. You can run it once, for free, and read the result in your own analytics.

Thumblify generates thumbnails from a video title.

Open the generator