X

ESP-RTC: Real-Time Audio-and-Video Solution

By Matt Williams -

ESP-RTC achieves stable, smooth, ultra-low-latency voice-and-video transmission in real time, providing an ideal solution for users who want to build low-cost and low-power audio-and-video products.

Espressif Systems (SSE: 688018.SH) is pleased to announce the release of ESP-RTC (ESP Real-Time Communication), an audio-and-video communication solution, which achieves stable, smooth and ultra-low latency voice-and-video transmissions in real time.

ESP-RTC is built around Espressif’s ESP32-S3-Korvo-2 multimedia development board. ESP32-S3-Korvo-2 is equipped with the ESP32-S3 AI SoC, and a dual microphone array for near-/far-field voice wake-up and speech recognition. It also integrates cameras, Micro SD cards, LCDs and other peripherals, and supports processing based on MJPEG video streams, thus providing an ideal development board for users who wish to build low-cost and low-power audio-and-video products.

The ESP-RTC solution materialises real-time audio-and-video transmission based on Espressif’s self-developed SIP (Session Initialisation Protocol) stack, which includes a transport layer, a transaction layer and a session layer. The signalling interaction module of ESP-RTC supports UDP, TCP and TLS, while its media transmission module supports RTP (UDP), RTCP, SRTP, TURN and other NAT transmission protocols. It is worth mentioning that the transmission module of the ESP-RTC solution also includes counter-measure algorithms, such as a Jitter Buffer and PLC, which effectively solve packet loss, jitter, congestion, and delays in weak networks, fully ensuring smooth audio-and-video communication in real time.

The ESP-RTC solution also supports the RTSP (Real Time Streaming Protocol) stack, whose media transmission module supports both RTP/UDP and RTP over TCP. The ESP-RTC solution can be used as an RTSP server supporting the on-demand use of such players as VLC/FFMPEG/PotPlayer/KmPlayer, or as an RTSP client supporting EasyDarwin, an easy-to-use, open-source, streaming platform framework.

Based on Espressif’s self-developed algorithms, i.e., acoustic echo cancellation (AEC), background noise suppression (BNS), automatic gain control (AGC), ESP-RTC reduces sound interference in audio calls, ensuring high quality and stability in voice communication. ESP-RTC also utilises Espressif’s chip-level codec algorithm to provide users with a clear picture in their video calls. Furthermore, ESP-RTC takes advantage of the excellent AI computing power of Espressif’s ESP32-S3 SoC, to achieve high-performance voice wake-up, voice recognition, and image recognition. Thus, ESP-RTC is suitable for the development of smart speakers, door video-intercom systems, smart-home control panels, pet monitors, car monitors, children’s toys and other application scenarios.

The solution supports open-source servers, such as FreeSWITCH and FreePBX, and can also access mature SFU Cloud servers to materialise group conference calls. Additionally, developers can quickly build audio and video communication-related applications with the help of Espressif’s open-source ESP-IDF (IoT Development Framework) and ESP-ADF (Audio Development Framework).

 

To find out more, contact sales.europe@macnica.com. Alternatively, visit Espressif or Macnica.

Also, stay up to date with the most recent machine vision and image processing news right here on MVPro Media.

Most Read

Fives & mon-marché.fr To Revolutionise Shopping

byMatt Williams

September 28, 2022

Fives, one of the world's most preferred partners for transforming supply chain facilities, has been...

Prophesee: EU’s Most-Funded In Fabless Chips

byMatt Williams

September 26, 2022

Prophesee, the inventor of the world’s most advanced neuromorphic vision systems, has announced the completion...

Optomotive To Unveil Two New Products At VISION

byMatt Williams

September 28, 2022

Optomotive, manufacturer of cutting-edge, high-performance cameras and 3D smart sensors, has announced two brand-new products,...

SMC: 4 Ways To Increase Vacuum Efficiency

byMatt Williams

September 27, 2022

With energy prices surging across Europe, efficiency has become a high priority for all manufacturing...

Teledyne Introduces AxCIS Contact Image Sensors

byMatt Williams

September 28, 2022

Teledyne DALSA has introduced AxCIS ™, a new family of high-speed and high-resolution fully integrated...

Xenics introduces DIONE 1024 Camera Core

byMatt Williams

September 27, 2022

Dione 1024 has been announced today as the new member of the long-wave infrared (LWIR)...

Women In AI: Startup Event On 29th September

byMatt Williams

September 27, 2022

Women in AI will present their very first free startup community event at Wayve Technologies...