New Chat Feature Announcement: Image Moderation

Tess G.
Tess G.
Published June 23, 2020 Updated April 29, 2022

The Power of Images

Employing user-generated content (UGC) is an effective way of engaging a brand’s audience. When users are able to contribute content to assess a company’s products or services, it creates trust among customers.

Images have the power to leave a strong impact on end-users by providing samples and proofs of how certain products and services work or don’t work. Sometimes, words are not enough to convey the emotional effect that images can have on customers, which is why utilizing photos is such an impactful tool for advertising and branding. Additionally, images can easily capture attention, entice customers, and help businesses be more creative in reaching their audience.

Why Image Moderation is Important

Content contributed by users in the form of images also has its downsides. A business’ online branding can be negatively impacted and even ruined once it is associated with explicit and unwholesome images. End-users can share highly graphic images depicting violence, pornography, and other disturbing themes on a company's messaging platform, diminishing trust and raising doubts within a brand's community. These images can even lead to legal trouble. These are the probable risks that make moderating images an absolute must. Image Moderation is necessary to engage the right audience and minimize internet users trying to disrupt a business' reputation and the safety of its online community.

Image Moderation in Stream Chat

Image moderation determines if an image contains unsafe content, such as explicit adult or violent themes. Messages that are deemed unsuitable by Stream’s chosen external image moderation partner are flagged and displayed in the moderation dashboard.
Images are given labels based on their content. By default, an image is flagged if it has any of these labels:

  • Explicit Nudity
  • Violence
  • Visually Disturbing Content

Brands can configure their application to use a different list of labels for image moderation. Labels are organized in two levels, meaning that a top-level label will match all second-level labels:

Importance of Image Moderation

Employing some version of Image Moderation ensures that images being contributed by end-users, or those being associated to the business, remain relevant to what the business aims to represent while protecting the brand and its community. Without monitoring submitted photos, a company's reputation could be tarnished, diminishing traffic, engagement, and trust.

decorative lines
Integrating Video With Your App?
We've built an audio and video solution just for you. Launch in days with our new APIs & SDKs!
Check out the BETA!