Skip to main content
All posts
Character consistency

Why AI video characters drift — and how to test the cause

Separate photo, motion and prompt problems when a character changes during a reference-led AI video remake.

A character can look right in the first frame and different two seconds later. The useful question is which input or movement makes the change appear. This guide describes a repeatable way to investigate it; it does not claim that every identity problem has a prompt-only fix.

Locate the first visible change

Watch the clip once at normal speed, then compare frames immediately before and after the change. Note whether it happens during a head turn, hand-to-face contact, a camera move or a scene transition. A specific moment is easier to investigate than a general impression that the video looks wrong.

For a presenter, inspect the face during turns. For a dancer, inspect the whole figure, clothing and limb proportions. For a product host, check the point at which the hand meets the object. These are different review problems even when they occur in the same shot.

Separate identity from motion

Keep the character photo and prompt, then choose a shorter or simpler segment from the reference. If the character becomes more stable, movement or occlusion may be contributing to the problem. That is a useful observation, not proof that a particular model can preserve every difficult action.

Next keep the video and replace only the photo with a clearer, pose-compatible image. Compare the same moments. A tight face crop may provide good facial detail but little information about clothing and body shape. A full-body photo may help a dance brief while offering less facial detail than a presenter needs.

Make the role of each reference explicit

Use the image for identity and the video for movement and framing. For example:

Use @Image1 as the character identity and clothing reference. Recreate the simple movement and framing in @Video1. Keep one performer and one continuous shot.

Start with a single action. New clothing, a new location, fast movement and a different camera instruction all add variables. If the result improves after changing several things at once, you still do not know which change helped.

Review more than the face

A face that stays recognisable does not make the rest of the output usable. Check hands, feet, hair, clothing edges, body proportions and object contact. Review the first, middle and last frames, plus the fastest part of the movement.

Keep a result as a draft if it changes an important product feature or suggests an unintended action. Reference-led generation can alter camera and background as well as the character. Exact background preservation and precise lip sync are not guaranteed by this workspace.

Keep a small comparison record

Record the photo used, the reference segment, the prompt and output settings. Change one variable in the next test and compare it with the previous result. Review the displayed credit quote before each task: reference-video duration contributes to the current quote along with output duration.

Start with choosing a character photo, then use the dance character-swap brief or the presenter remake brief that fits the shot.