A gap is not a production instruction

A diversity report can show that an account has no ads in a particular format. Filling that gap may be useful, but the same account's performance history or insight library can give a good reason to leave it alone.

Benmark puts those tensions into the test. The model has to build six production items within four video and two static slots, cover the useful targets and leave out contradicted work. This is much closer to a real planning decision than asking for a long list of creative possibilities.

The constraints make the output useful

Supply the production limits alongside the evidence: how many assets can be made, which formats are available, what claims can be supported and which audience or offer requirements are fixed. Without those constraints, the model can create an impressive-looking plan that cannot be executed.

The strongest tested setups satisfy the case's answer key. Where models share the top result, the benchmark gives a shortlist. Their configurations and cost bases still matter when choosing a setup for your own process.

Keep the rejected work visible

Ask the plan to include a short explanation of what was excluded and why. A rejected gap can be the most valuable part of the output if it prevents the team spending a week producing something the existing evidence already argues against.

For each selected item, preserve the evidence link and the learning it should generate. That gives the next campaign cycle something specific to resolve, rather than another set of assets with no clear reason for their place in the queue.

How Benmark tests this

Models build a six-item production queue from one synthetic brand-cycle pack: four video slots and two static slots. The answer key checks whether the plan follows the performance evidence, rejects misleading gaps and respects production constraints.

Test inputs, instructions and scoring

What the model receives

The pack combines brand context, production constraints, the current creative portfolio, a performance table, a performance-blind diversity report and a codified insight library. It deliberately includes useful targets, contradicted gaps, weak-evidence traps and a data-quality exclusion.

What changes between prompts

Both prompts include the complete pack and JSON output contract. The scaffold adds a method for reconciling apparent gaps with performance and existing learning. It does not add the evaluator's answers.

How the result is scored

A deterministic score combines target recall, decoy rejection, trap handling, insight linkage and ordering. Repeated runs reuse this one brand-cycle case. A 10/10 means the plan satisfied this test's key; the score is not a rating of a finished ad's commercial impact.