Skip to main content
Transform and edit live video streams in realtime with AI. Our realtime models enable creative style transformations, precise video editing, and lifelike avatar animation with minimal latency. Choose between style transformation (Mirage) for artistic effects, video editing and character transformation (Lucy 2) for adding, changing, or removing elements and becoming any character, or avatar animation (Avatar Live) for bringing portrait images to life with audio.

Available Models

We offer specialized realtime models, each optimized for different use cases:
ModelUse CaseExample PromptsBest For
MirageStyle transformation”Anime style”, “Cyberpunk city”, “Studio Ghibli animation”Creative effects, artistic filters, visual themes
Lucy 2Video editing + character reference”Transform into this character”, “Add a dog”, “Change hair to blonde”Character transformation, object manipulation, scene editing
Avatar LiveAvatar animation”Smile warmly”, “Nod while speaking”, “Look enthusiastic”Talking avatars, virtual presenters, interactive agents

Mirage - Video Restyling

Transform the overall visual style and aesthetic of your video stream. Perfect for creative applications, social media filters, and artistic effects.

Lucy 2 - Video Editing & Character Reference

Make specific edits to videos by adding, modifying, or removing objects and elements. Lucy 2 (lucy_2_rt) also supports character reference images — upload any face and see yourself transformed into that character in realtime.

Avatar Live - Talking Avatars

Animate portrait images with audio input. Transform static images into lifelike talking avatars with synchronized lip movements and natural expressions. Perfect for virtual presenters, AI agents, and interactive experiences.

Quick Start

Installation

npm install @decartai/sdk

Basic Usage

import { createDecartClient, models } from "@decartai/sdk";

// Use Lucy 2 for video editing — supports text prompts and character reference
const model = models.realtime("lucy_2_rt");

const stream = await navigator.mediaDevices.getUserMedia({
  video: {
    frameRate: model.fps,
    width: model.width,
    height: model.height,
  }
});

const client = createDecartClient({
  apiKey: "your-api-key-here"
});

const realtimeClient = await client.realtime.connect(stream, {
  model,
  onRemoteStream: (editedStream) => {
    videoElement.srcObject = editedStream;
  },
});

// Text-only editing
await realtimeClient.set({ prompt: "Add a small dog in the background", enhance: true });

// Character transformation with a reference image
const characterPhoto = document.querySelector("input[type=file]").files[0];
await realtimeClient.set({
  prompt: "Transform into this character",
  image: characterPhoto,
  enhance: true,
});

Use Cases & Examples

Video Restyling with Mirage

Perfect for creative applications and visual effects:
  • Social Media Filters: “Anime style”, “Vintage film”, “Oil painting”
  • Content Creation: “Studio Ghibli animation”, “Cyberpunk aesthetic”, “Watercolor art”
  • Live Streaming: “Cartoon style”, “Neon synthwave”, “Impressionist painting”
  • Virtual Events: “Fantasy world”, “Futuristic setting”, “Medieval theme”

Video Editing & Character Transform with Lucy 2

Ideal for content modification, character-driven experiences, and interactive apps:
  • Character Transformation: Upload a reference image and become that character — your movements and expressions map onto the reference identity
  • Object Addition: “Add a dog running around”, “Add birds flying overhead”, “Add flowers in the foreground”
  • Appearance Changes: “Change hair to blonde”, “Add sunglasses”, “Change shirt color to red”
  • Object Removal: “Remove the car from the scene”, “Remove the tree”, “Remove background objects”
  • Scene Modifications: “Replace the background with a beach”, “Add snow falling”, “Change day to night”

Avatar Animation with Avatar Live

Perfect for virtual presenters and interactive agents:
  • Virtual Presenters: Animate company spokespersons or brand mascots with pre-recorded audio
  • AI Agents: Create lifelike conversational agents that speak with natural expressions
  • Content Creation: Generate talking head videos from static portraits
  • Interactive Experiences: Build real-time avatar interactions with live audio input

Getting Started

Choose your model based on your use case: