Exploring the Benefits of Dual Program Capabilities on a Live Streaming Platform
- Limited UB Fox
- Nov 16, 2022
- 3 min read
The "2022 Hong Kong ICT Awards: Student Innovation Award" organized by the Hong Kong Institute of Vocational Education has successfully concluded. The "Student Innovation Award" aims to recognize students' achievements in innovation and research, encourage the exploration of innovative and creative concepts, promote information and communication technology innovations to society, and enhance the professional image of the information and communication technology industry.
I am delighted to share that the project "Streaming Hub" designed by Adrian Kwok, Chan Man-him, Lee Tung-kin, and Yip Tak-wah from the Hong Kong Institute of Vocational Education (Shatin) has won the "2022 Hong Kong ICT Awards: Student Innovation Award (Tertiary or Above) Silver Award."
With the continuous advancement of technology, especially the increasing prevalence of 5G high-speed mobile networks, more and more people are creating and watching various types of live streaming programs, such as talk shows, gaming streams, and live commerce. Live streaming has become one of the most popular forms of entertainment, with tremendous development potential. However, live streaming programs are currently at two extremes: the need for professional equipment to produce high-quality content and the production of lower-quality but more portable smartphone live streams.
"Streaming Hub" is an innovative live streaming solution that combines the advantages of these two types of programs into an all-in-one mobile streaming platform. The system allows users to create high-quality real-time live programs through flexible and feature-rich controls called HUBS. Live stream hosts can design their own screen layouts using the scene editor, plan the visual effects of their programs in advance, and switch screen layouts and camera angles on the fly, just like controlling a professional video mixer for live shows. Streaming Hub can run on tablet devices, enabling anyone to produce high-quality live streams anywhere, just as easily as using a smartphone.
The flexibility of Streaming Hub not only allows live stream hosts to broadcast from anywhere but also provides different HUBS for customized workflows. For example:
Gesture Control:Hosts no longer need to control a switcher in front of the audience. With AI skeleton detection, the gesture control feature allows streamers to start their live performances by simply making a countdown gesture in front of the camera. Users can also control program operations through body movements, such as muting the microphone with a quiet gesture, switching live camera angles, or automatically playing waiting screens when the host is away from the camera. It is a new way of controlling live streams.
Augmented Reality (AR) 3D Models:Customers can showcase products through AR. Live stream hosts can take photos of products from various angles, and Streaming Hub creates a highly detailed 1:1 3D model based on these photos. Hosts can display the 3D models on the screen or send them to customers' phones, allowing viewers to preview the product's effects using augmented reality, attracting them to make online purchases and enhancing the level of interaction in live streaming media.
Intelligent Audience Interaction:Audience interaction, comments, and feedback are crucial in live streaming programs and the e-commerce world. With the AI engine developed by Streaming Hub based on natural language processing technology, the system can understand comments and requests in the chat room, extract user intentions in real-time, and provide appropriate feedback suggestions to the streamer. This enables live stream hosts to respond to audience questions more quickly and accurately, enhancing the customer engagement experience.
Video Distributed Computing:The system can distribute the functions of the HUBS to other smart devices, such as transferring human motion tracking functions to connected smartphones, to overcome the computational limitations of tablet devices and improve the system's processing capabilities.
Comments