SkillPE
Paper Code

Cinematic prompt engineering

Make every prompt feel directed.

SkillPE turns filmmaking craft into reusable skills for text-to-video. It learns from movie references to shape camera, light, action, and story, while keeping the user's idea in frame.

Reusable cinematic skills, evolved against real video outputs.
User query: “A car transforms into a robot, waves to passersby, and then changes back into a car.”

UP TO+1.40POINTS

on a 7-point cinematic evaluation over the strongest non-skill prompt-engineering baseline

4evaluation dimensions
2video backbones
10human annotators

01 The method

Film craft, made reusable.

Rather than polishing words in isolation, SkillPE builds a library of cinematic strategies, evolves them with reference films, and keeps the versions that work on screen.

SkillPE pipeline: expert-authored skills are normalized, refined or creatively evolved using resonator, dissonant, and divergent movie references, then assessed on generated videos to build skill libraries.
From expert seed to video-assessed skill librarySkillPE framework overview
A / FORM

Give each shot a job.

Skills describe shot order, duration, setting, composition, lighting, movement, action, dialogue, and sound.

B / EVOLVE

Learn from near and far.

Resonators refine a skill, dissonants define its boundaries, and divergents spark controlled alternatives.

C / SELECT

Keep what works in video.

Candidate skills are compared through generated clips for fidelity, cinematic quality, narrative appeal, and creativity.

02 Generated examples

Same prompt. Three directions.

Compare the original generation, a seed-skill rewrite, and the evolved SkillPE library. Press play to watch each result.

CASE 01 TRANSFORMATION

A car becomes a robot.

“A car transforms into a robot, waves to passersby, and then changes back into a car.”

01 Raw prompt
02 Seed-skill PE

CASE 02 VISUAL METAMORPHOSIS

A book opens to life.

“A man opens a book and then some fishes swim out of the pages.”

01 Raw prompt
02 Seed-skill PE

03 The evidence

The difference shows up on screen.

In a blinded human study, the best evolved SkillPE library improved the overall score over both direct rewriting and seed skills.

Blinded human evaluation 7-point overall score
Gemini 3.1 Pro4.86
Seed-skill PE5.61

400 videos · 40 prompts · 10 annotators · 7-point Likert scale

Tested acrossStoryEvalVBench with MiniMax-H3 and LTX-2.5

Creativity, with intent

A skill library that knows when to stay true and when to explore.