Use Cases

Animate Portraits And Sync Lips To Audio

1 project

Ask Questions About Images, Documents, Audio And Long Videos

1 project

Ask Questions About Images, Video, Audio, And Pdfs

1 project

Audio And Music Generation

1 project

Audio And Video Transcription Via Asr For Meeting/podcast Content

1 project

Audio File Import And Re-transcription

1 project

Audio Generation Evaluation Metrics

1 project

Audio Inpainting And Continuation

1 project

Audio Transcription And Text-to-speech In Chat

1 project

Audio Transcription And Tts In Agent Chat

1 project

Audio Waveform Editing And AV Sync

1 project

Audio-driven Talking-head Avatar Video

1 project

Audio-to-score Transcription For Covers

1 project

Audiobook And Narration Production

1 project

Audiobook, Dubbing And Content Narration Pipelines

1 project

Batch Audio Generation From Text Files

1 project

Build Multimodal Datasets With Image, Audio, And Video Context

1 project

Building Webdataset/s3 Audio Training Pipelines

1 project

Capture Multimodal (image/audio) Span Attributes

1 project

Chat With Documents, Code, Audio And Video

1 project

Cli Inference For Batch Audio Conversion

1 project

Convert One Voice Into Another From Short Audio Samples

1 project

Create And Edit Audio And Midi Projects

1 project

Create Audiobooks And Long-form Narration

1 project

Create Narrated Whiteboard Videos From Chinese Scripts And Reference Audio

1 project

Cut And Mix Video/audio With Ffmpeg Rendering

1 project

Download Video/audio From Youtube And Bilibili

1 project

Export To Mp4, Audio, Captions And Fcpxml

1 project

Extract F0 Pitch To Avoid Muted/unvoiced Artifacts On Hard Audio

1 project

Extract Subtitles Or Transcribe Video And Audio

1 project

Fine-tuning Custom Voices On Your Own Audio Data

1 project

Fine-tuning Pretrained Audio Models On Custom Datasets

1 project

Generate Podcast Audio With Azure Openai Realtime Api

1 project

Generate Text, Images, Video, And Audio From Prompts Or Reference Media

1 project

Give Coding Agents Searchable Context From Screen And Audio History

1 project

Image, Video And Audio Generation Workflows

1 project

Ingesting Images, Pdfs, Audio And Office Docs Into Memory

1 project

Lip-synced Facial Animation Driven By Tts Audio

1 project

Load And Run Pretrained Models For Text, Vision, Audio And Multimodal Tasks

1 project

Lora Fine-tuning For Audio Diffusion Models

1 project

Manage Projects And Audio Exports

1 project

Multi-character Dialogue Video From Dual Audio Streams

1 project

Multi-gpu And Multi-node Audio Model Training

1 project

Multi-modal Text/image/audio/video Chat

1 project

Multi-speaker And Multi-turn Dialogue Audio Generation

1 project

Multimodal Content Extraction From Docs, Images, Audio, Video

1 project

Multimodal Image/video/audio Chat Inference

1 project

Multimodal Parsing And Generation (office, Audio/video)

1 project

Multimodal Text, Vision And Audio Apps

1 project

Narrating Audiobooks, Dubbing And Podcast Content

1 project

Normalize Loudness And Clean Up Audio

1 project

One-prompt Video/image/audio Generation Workflows

1 project

Produce Video, Music, And Audio

1 project

Producing Audiobooks And Tts Narration

1 project

Rapid Voice Cloning From 10-30s Reference Audio

1 project

Real-time Audio Transcription And Voice Calls

1 project

Real-time Meeting Transcription From Mic And System Audio

1 project

Running A Local Gradio Demo For Stable Audio Open

1 project

Screen And Audio Recording

1 project

Serve Embeddings, Images, Audio, Batches And Rerank Endpoints

1 project

Speech Transcription And Realtime Audio Apps

1 project

Store And Retrieve Multimodal Memories (text, Image, Audio, Video)

1 project

Stream Tokens, Audio, And Video Frames End-to-end

1 project

Text-to-audio And Sound Effect Generation

1 project

Text-to-audio Generation

1 project

Training Audio Autoencoders For Latent Diffusion

1 project

Training Conditional Diffusion Audio Models From Scratch

1 project

Transcribe Audio (wav, Mp3, Vtt) With Asr Models

1 project

Transcribe Audio And Analyze Images

1 project

Transcribe Audio And Video

1 project

Transcribe Audio And Video Files

1 project

Transcribe Audio Files

1 project

Transcribe Audio Files And Youtube Urls Into Markdown Text

1 project

Transcribe Audio Files To Text

1 project

Transcribe Podcast Audio With Whisper

1 project

Transcribe Speech And Synthesize Audio

1 project

Transcribe Timeline Audio

1 project

Transcribe Video Audio From Bilibili And Other Platforms

1 project

Turn Paywalled News Articles (nyt/wsj/ft) Into Audio, Ppt Or Mindmaps

1 project

Upload Documents, Audio And Video As Session Materials For Course Building

1 project

Vision And Audio-capable Agent Tasks

1 project