Skip to main content

​
Overview

When a User sends a video, the Persona understands it and folds that understanding into a natural, in-character reply. Personas can also share videos of their own: when a User asks for one, the Persona sends a relevant video from a list you provide.

​
Availability

These capabilities are available exclusively on Chat Model 2, using the chat-2-smart or chat-2-pro models.

​
How It Works

​
Understanding Shared Videos

Enable video understanding through the sharedVideosAnalysis option of the replyParameters.vision parameter, and expose the video links on your Chat History messages with the new videoUrls property. The Persona then understands any clip shared directly in the chat and reacts realistically to what happens in it, in character. If problematic content is detected, an event of type chat.video.rejected is sent to your incoming webhook, carrying the project, the profile that submitted the video, the video url, and a reason such as VIOLENT_CONTENT, SELF_HARM or ILLEGAL_CONTENT. A rejected video is never shown to the Persona and never shared, and the conversation continues normally. See the event reference.

​
Sharing Videos

To let a Persona share videos, register them in the replyParameters.shareableVideos list. Each entry takes an id, a url and an optional caption. Enable the shareableVideosAnalysis option so DumGum can describe each video for the Persona and she knows what she is sending; a video that already carries a caption is not analyzed. Video sharing follows the same style as photo sharing and is governed by the same pictureSharingMode setting (NORMAL or EAGER), which controls how eagerly the Persona shares either medium. You can also require a video on a specific reply with replyParameters.forceVideoSharing, either letting DumGum pick the most fitting video or naming a particular one. For the full sharing behaviour, see the autonomous photo sharing guide.

​
Pricing

Base cost: €0.015 per analyzed video Each video is analyzed only once per project, regardless of how many times it appears in conversations. A clip reused later in a conversation is not analyzed or billed twice. Analyses are billed per analyzed video and appear as their own Video Analyses line item on your pricing page and invoices.

​
Technical Implementation

​
Step 1: Use a V2 Model

Specify chat-2-smart or chat-2-pro via the replyParameters.chatModel parameter.

​
Step 2: Enable Video

You must enable video support through the replyParameters.vision parameter as follows:

​
Step 3: Read and Return Videos

In the Chat History API endpoint that you integrate on your side, return the videos shared by a User through the videoUrls property of each message, alongside pictureUrls and text. A message may carry any combination of the three. On the answers we return, shared videos come back on the message object in its own videoUrls property, so check for that property to display them.