Motion Reference: How to Direct AI Characters With Your Camera
What Is Motion Reference?
Motion Reference is a feature in Loovie’s timeline editor that lets you record a video of real-world movement and apply that motion to any AI character in your project. You film yourself performing an action, whether that is a dance, a hand wave, a dramatic turn, or a product demonstration, and the AI uses your movements as a guide for how the character should move in the generated clip.
This happens entirely inside the editor. There is no separate motion capture app, no data export, and no manual keyframing. You record or select a reference video, choose which clip and character to apply it to, and the AI handles the translation from your real-world motion to the character’s animated performance.
The result is directed, intentional character movement that matches exactly what you had in mind, because you literally showed the AI what you wanted.
Recording a motion reference video in Loovie
Why Motion Reference Changes AI Video Direction
Most AI video tools give you a text prompt and hope the model interprets your movement instructions correctly. “Character walks confidently toward the camera” might produce a casual stroll, a power walk, or something in between. You have no control over the specific choreography.
Motion Reference eliminates that ambiguity. Instead of describing movement in words, you demonstrate it physically. The AI sees the exact timing, posture, speed, and style you want and reproduces it with your chosen character.
This distinction matters most in scenarios where precise movement is critical:
- Dance sequences. Specific choreography that must hit exact beats and positions.
- Product demonstrations. A character needs to pick up an object, turn it, and present it to camera in a specific way.
- Emotional performances. Body language conveys meaning. A defeated slump looks very different from a confident lean, and text prompts struggle to capture that nuance.
- Tutorial content. Step-by-step physical instructions require precise, repeatable movements.
How Motion Reference Differs From Other Tools
Some AI video platforms offer “motion brushes” or similar features that let you draw motion paths on a frame. These tools control where objects move within the frame, but they do not capture the full dimensionality of human movement. A motion brush can make a character move from left to right, but it cannot capture the way someone shifts their weight, turns their head, or gestures with their hands while doing so.
Motion Reference captures the entire performance. Body position, limb angles, head orientation, hand gestures, and timing all transfer from your reference video to the AI character. It is the difference between giving stage directions and showing someone exactly what to do.
| Feature | Motion Brush (other tools) | Motion Reference (Loovie) |
|---|---|---|
| Input method | Draw paths on a frame | Record a real video |
| Movement fidelity | 2D directional | Full 3D body motion |
| Timing control | Manual keyframes | Natural human timing |
| Gesture capture | No | Yes |
| Body language | No | Yes |
| Inline in editor | Varies | Yes |
Comparison of motion brush vs motion reference results
Step-by-Step: Using Motion Reference
Here is the complete workflow.
1. Select a clip in the timeline
Tap the clip where you want to apply custom motion. This can be an existing generated clip or a placeholder for a new generation.
2. Open the Motion Reference panel
Tap the Animate button in the toolbar. The Motion Reference panel opens with options to record a new reference or select one from your camera roll.
3. Record or select your reference video
To record live: Tap the record button. Loovie opens the camera and you perform the action you want. Keep these tips in mind:
- Stand far enough from the camera for your full body to be visible.
- Use a well-lit environment so the AI can clearly track your movements.
- Perform the action at the speed you want it reproduced.
- Keep movements deliberate and clear.
To use an existing video: Tap “Camera Roll” and select any video. You can trim it to the exact section you need.
4. Preview the motion mapping
After recording or selecting, Loovie shows a preview of how the motion will map to your character. This gives you a chance to verify the timing and movement before committing credits.
5. Apply to your clip
Tap Apply. The AI generates a new version of the clip with your character performing the referenced motion. The character’s appearance, clothing, and styling remain unchanged. Only the movement updates.
6. Review and refine
Play back the clip in your timeline. If the motion needs adjustment, you can record a new reference and apply again. Each attempt creates a new version, so previous attempts are preserved.
Creative Applications
Motion Reference unlocks creative possibilities that text prompts alone cannot achieve.
Dance and music videos
Choreograph a routine, film yourself performing it, and apply it to your AI character. Every beat hit, every arm extension, every body roll transfers to the character. This is how you create music video content with AI characters that actually dance instead of vaguely swaying.
Product demonstrations
Need a character to hold up a product, rotate it, and point to specific features? Film yourself doing exactly that. The character reproduces your presentation gestures precisely, making product demo content feel natural and intentional.
Educational content
For tutorial or how-to content where a character needs to demonstrate physical steps, Motion Reference ensures the movements are accurate and repeatable. Film the correct technique once and apply it to your AI presenter.
Emotional storytelling
Body language carries enormous narrative weight. A character who nervously fidgets while speaking tells a different story than one who stands perfectly still. Film the performance you want, and the AI character delivers it.
Social media content
Quick reaction videos, trending dance challenges, or comedic bits all benefit from precise motion control. Film the action on your phone, apply it to your AI character, and post.
Tips for Best Results
Getting the most out of Motion Reference comes down to the quality of your reference video:
-
Good lighting is essential. The AI needs to clearly see your body position in every frame. Natural daylight or bright, even indoor lighting works best. Avoid backlighting or harsh shadows.
-
Keep your full body in frame. If your legs are cut off, the AI will not have motion data for them and will need to interpolate. Full body visibility produces the best results.
-
Wear fitted clothing. Loose, flowing clothing can obscure body positions and joints. Fitted outfits give the AI cleaner motion data to work with.
-
Use a stable camera. Prop your phone on a tripod or lean it against something stable. Camera shake introduces noise into the motion data.
-
Perform at the right speed. The AI reproduces your timing exactly. If you want slow, graceful movement, perform it slowly. If you want fast, energetic action, perform it fast.
-
Do multiple takes. Just like real filmmaking, your first take might not be your best. Record a few versions and pick the one where your movement is clearest and most intentional.
AI character performing a dance sequence from Motion Reference
Combining Motion Reference With Other Features
Motion Reference works naturally alongside Loovie’s other editing tools:
- Character Swap + Motion Reference. Apply the same motion to different characters to see which one performs it best. Useful for casting decisions in narrative content.
- AI VFX + Motion Reference. Apply custom motion first, then use AI VFX to modify the scene around the character. Change the background, add weather, or adjust lighting after the motion is locked in.
- From Last Frame + Motion Reference. Build continuous scenes where a character’s motion flows naturally from one clip to the next by using From Last Frame for continuity and Motion Reference for specific actions within each clip.