User Sends an Image Message

Overview #

Up to this point, you’ve likely only seen SeaChat respond to text-based user chat messages. However, SeaChat has the capability to handle multimedia messages, such as audio and image, as well! This makes interactions more flexible and convenient for users, enabling them to share content in various formats for richer communication. 

Image Understanding #

When a user uploads an image, SeaChat analyzes it to generate a detailed textual description. This description serves as the foundation for SeaChat’s response, ensuring that the AI’s reply is tailored to the visual content. The process is designed to make it easier for users to share visual information without needing to describe or re-type it themselves.

💡 Note This feature is only available to premium subscribers. For non-premium accounts, SeaChat will only know that the user uploaded an image, but will not have any insight on the content.

Example #

In the following example, a user chats with the Seasalt.ai bot via WebChat and uploads a screenshot of a webinar invite in their message to the agent. By analyzing the contents of the image, SeaChat is able to understand and respond to the user’s message effectively (without the user having to re-type all the contents of the image).

Sending an Image Message to SeaChat