Sounds and Audio in Flex

There are many reasons you might want to play a sound in Flex UI. You can use the following Flex APIs to define custom sounds based on your needs:

• Use the SoundManager API to customize the Flex ringtone that plays for inbound tasks. Specifically, this API lets you play custom sounds for inbound tasks on different task channels.
• Use the AudioPlayerManager API to create other custom sounds. For example, you can use this API to configure sound to indicate that participants have joined or left a conference.

Flex provides a default ringtone that plays the same sound for inbound tasks on all task channels. If you don't need to differentiate your sounds by channel, you can enable the default ringtone by turning on the Play ringtone for inbound tasks in Flex setting in Console.

To play custom notification sounds in Flex, you can use the SoundManager API to do the following:

• Configure sounds by channel: Set sounds for different communication channels like voice, chat, SMS, WhatsApp, and others. The sounds you configure apply to incoming tasks with a pending status. For each channel, you can customize:
  • Whether to play a custom URL or use the default ringtone.
  • Whether the sound repeats or only plays once.
• Use the default sound across channels: Call the SoundManager API without parameters to apply the default configuration where incoming tasks with a pending status play a default ringtone on all the channels you use. This provides the same behavior as the inbound task notification setting in Flex Console.

To call the SoundManager API, you must create a custom plugin to execute your configuration at runtime.

Note: The SoundManager API takes precedence over the inbound task notification setting in Console. If you call the SoundManager API, Flex uses the configuration you pass, even if the Console setting is turned off.

You can call the SoundManager API using the SoundManager.configure() method with the definition for the task channel. See the following code samples as an example. For the list of available properties, see the Flex UI API reference.

The following shows the SoundConfig definition, which defines the configuration for a specified task channel or channels.

1
type SoundConfig = {  
2
  taskChannelName?: string;  // The task channel for which the sound settings will be applied. (Optional)  
3
  reservationSounds: ReservationSound[];  // A list of reservation sounds for different statuses.  
4
};

The reservationSounds parameter contains these fields.

To play custom sounds that aren't associated with an inbound task, use the AudioPlayerManager API. This API supports playing, stopping, and muting sounds.

Sounds are either repeatable or non-repeatable:

• Repeatable media play in a loop, like a phone ringing that doesn't stop. The only way to stop repeatable media is to manually call the stop method.
• Non-repeatable media play once, like a beep or bleep. Non-repeatable media automatically stop after being played once.

The media to play is defined as follows:

1
export interface MediaData {
2
    url: string;
3
    repeatable: boolean;
4
}

To play media, you must specify the URL where the media file is located and declare whether or not the sound is repeatable:

1
const mediaId = Flex.AudioPlayerManager.play(
2
{
3
    url: "sound-url",
4
    repeatable: true
5
},
6
(error: Flex.AudioPlayerError) => {
7
    // handle error
8
}
9
);
10

If there is an error while playing the media, a notification appears with the error. Some possible errors include:

To stop media, use the media id returned from the play method (described above):

Flex.AudioPlayerManager.stop(mediaId);

To mute or unmute sounds, use the following method:

Flex.AudioPlayerManager.toggleSound(true/false);

Muting or unmuting doesn't stop current playing media. The media keep playing, but with their volume at zero.

Repeatable and non-repeatable media can play at the same time, but there can only be one repeatable and one non-repeatable media playing at a given time. Overall, this means that you can only have two media playing at once: one repeatable and one non-repeatable media.

If the media is repeatable, calls to Flex.AudioPlayerManager.play enqueue the media and play them one after another. You can stop a repeatable media that isn't playing (but is enqueued) to remove it from the queue. Stopping a repeatable media that's playing stops the sound and plays the next media in the queue (if the queue isn't empty).

If the media is non-repeatable, it plays only if no other non-repeatable media is already playing. Non-repeatable media are not enqueued. You can stop a non-repeatable media that's playing to stop the sound.

For example, to play a sound when a chat message comes in:

1
Flex.Manager.getInstance().chatClient.on("messageAdded", () => {
2
    const mediaId = Flex.AudioPlayerManager.play({
3
        url: "sound-url",
4
        repeatable: true
5
    });
6
})

Browsers, especially Chrome, have strict policies that prevent sound playback or media autoplay for background tabs or tabs that didn't receive any user input (source: https://developers.google.com/web/updates/2017/09/autoplay-policy-changes). Some typical situations include:

• A tab that was refreshed and never received user input
• A tab with Flex in a separate window that reopened automatically and never received user input
• A tab that was opened a while ago and hasn't received focus for a while
• A tab among other tabs that playback sounds

For media to play, the agent must interact with the Flex UI first. Sounds that were triggered but weren't allowed to play start playing as soon as the agent interacts with the site.

• Repeatable media will play the first media that was triggered. Once the first one stops playing, the next in queue will be played.
• Non-repeatable media will play the first media that was triggered and hasn't been stopped.

Expand image

There are some workarounds:

• Allow the hostname: Add the hostname at chrome://settings/content/sound to allow it to play sound. Note: this doesn't require enterprise policies.
• Change enterprise policies: Add the hostname to the list of allowed hostnames. Note: this requires enterprise policies.

Allow hostname: Add the hostname in the audio settings list about:preferences#privacy and allow it to always play sound.

Allow autoplay sound for hostname: In the Safari app, choose Safari > Settings for This Website, under Auto-Play select Allow All Auto-Play.