Blog/The developer journey

Evaluation: video that helps developers decide

A developer comparing you with two other tabs wants proof, an honest setup and the limits. This is the video that gives them that.

Kevin Blanco··6 min read·Evaluation

The short answer

An evaluation video helps a developer who's comparing you with two other tabs decide whether you fit. It shows a real use case, the setup honestly and one limit, then points to the sandbox or the quickstart. Measure watch time to the halfway mark and clicks to docs, not applause.

01

Who's watching

This viewer already knows what you do. They're comparing you with two other tools and trying to decide which one to try first.

They want to know three things: will it work for my case, how long will setup take, and what breaks.

FigureWhere evaluation sits on the journey, and what it asks of a video.

02

What a good evaluation video looks like

  • 01

    A real use case

    Pick one a viewer would recognize and run it end to end, instead of touring features.

  • 02

    Honest setup

    Show how long it takes and what it needs. A developer who is told the truth about setup trusts the rest.

  • 03

    One limit, said out loud

    Name something the product doesn't do, or where it needs care. It makes every other claim easier to believe.

  • 04

    A next step they can take now

    End at the sandbox, the quickstart or a repo, where a viewer can try it in the next few minutes.

03

The call to action that fits

The ask at the end should match what this viewer is ready to do. Asking for more than that loses them. Asking for less wastes the video.

The ask that misses

"Contact sales to learn more."

The ask that fits

"Here's the quickstart. You can run this yourself in the sandbox."

04

What to measure

  • Watch time

    To halfway

    How many viewers reach the middle of the video, where the real use case runs.

  • Clicks

    To docs

    Evaluators act. A click to the docs or the sandbox is a vote.

  • Conversion

    To signup

    The share of viewers who then create an account.

Likes say little at this stage. An evaluator who clicks through and signs up has told you far more.

05

When results show up

These are rules of thumb from our own work, not benchmarks. Your audience and your volume will move them.

  1. Week 1

    Watch time and clicks

    Both show within days of publishing.

  2. Weeks 2 to 4

    Signups from the video

    You need a tagged link to trace them.

  3. Month 2

    Which videos convert

    Enough volume to compare one video with another.

06

The usual mistake

07

The rest of the journey

FAQ

Questions people ask

What is an evaluation video?

A video for a developer who knows what you do and is deciding whether to try you. It shows a real use case, an honest setup and a limit, and ends at a place they can try it.

Should an evaluation video show the product's limits?

Yes, one. It makes the rest of the video more believable, and it filters out viewers who would have been disappointed later.

What call to action works at the evaluation stage?

A concrete trial step: the sandbox, the quickstart or a repo. "Contact sales" asks for a commitment the viewer isn't ready to make.

What should I measure for evaluation video?

Watch time to the halfway mark, clicks to docs or the sandbox, and the share of viewers who sign up. Use a tagged link so you can trace sign-ups to the video.

How long until evaluation video shows results?

Watch time and clicks show within days, signups within a few weeks, and enough volume to compare videos in about two months. These are rules of thumb.

DevReel

How we do it at DevReel

For evaluation we choose a use case the viewer recognizes, show the honest limit, and end at the place they can try it. The link is tagged, so we can tell which video sent which signup.

Cloudinary's videos usually average around 400 views. Ours passed 9,000 in the first week. For ngrok, watch hours tripled and subscribers went from about 450 to over 800 in the first week.

Cloudinary views

9,000+

in the first week, against a usual ~400

ngrok watch hours

3×

subscribers from ~450 to 800+ in the first week

Now the hard part

Tell us what a developer is weighing you against, and we'll plan the video that settles it.

Kevin Blanco founded DevReel. He has made 500+ developer-tool videos and spoken at 80+ developer conferences.

Keep reading