Developing an All-in-One Live Streaming App with Gesture Control for Convenient Broadcasting and Winning Multiple Competition Awards

The rapid development of e-commerce driven by the COVID-19 pandemic has led to the popularity of live streaming e-commerce as a highly effective sales model. Four graduates from the Hong Kong Institute of Vocational Education (IVE) collaborated to design an application called "Streaming Hub," which serves as an all-in-one mobile streaming platform. They utilized technologies such as Artificial Intelligence (AI) to address the inconveniences faced by existing live streaming applications in the market. Their work has participated in over ten innovation and entrepreneurship competitions, receiving multiple awards, including a HKD 100,000 grant from the Science Park Seed Fund.

The "Streaming Hub" application, developed by the team of graduates, features the ability to switch between multiple cameras in real-time. If a live stream host is using two or more devices for broadcasting, the system can seamlessly switch between cameras and display the video feeds in different sizes or split screens. Additionally, hosts can control the cameras using gestures. For example, they can use a "5, 4, 3, 2, 1" gesture to start or end the live stream. The system also utilizes AI technology to automatically play designated videos or mute the audio when the host places their index finger in front of their mouth using the "SHU" gesture. Moreover, when the host moves away from the camera, the application automatically arranges the playback of pre-selected videos, facilitating easy control and management of the live streaming content.

Furthermore, after scanning a product from all angles, the host can generate a 3D model of the product using AR technology. Viewers can simulate placing the 3D model in their own surroundings, enhancing the product marketing experience.

Inspired by daily life and the desire to improve user experience, Adrian Chan, one of the developers involved in the system's creation, shared his motivation. As an avid live streaming viewer, he noticed the inconveniences in existing live streaming applications and thus conceived the idea of designing and developing "Streaming Hub." He explained, "Many live streams rely on a single camera and require manual control. I also observed that when the host is not in front of the camera, the audience only sees the live streaming room, which leaves room for improvement. Therefore, we thought of incorporating various features, including gesture-based camera control and automatic video playback, to enable single-user operation for hosts. In addition, the system supports live streaming from multiple cameras, enabling the audience to view different perspectives. Combined with AR technology, we aim to provide viewers with a better understanding of the authenticity of the products, maximizing the effectiveness of live streaming."

The "Streaming Hub" application developed by the IVE team has participated in over ten innovation competitions, receiving numerous accolades. These include the Second Prize in the Mobile Application Innovation Competition of the 2022 China University Computer Competition (Greater China Region), the Gold Prize in the 2nd Greater Bay Area 5G Application Innovation Competition, the Runner-up in the Cathay Pacific Hackathon 2021, the First Prize in the 8th Hong Kong University Student Innovation and Entrepreneurship Competition, and the Silver Award in the 2022 Hong Kong ICT Awards: Student Innovation Award (Tertiary or Above) category. Adrian stated, "With the HKD 100,000 grant from the Science Park Seed Fund, we will improve the server to enhance the stability of the live streaming program. Additionally, we plan to add more interactive features unique to live stream hosts, such as response animations and mini-games, to strengthen the interaction with the audience."

Through their involvement in the development of "Streaming Hub," Adrian and his team have gained valuable experience and garnered various awards. Furthermore, their participation in competitions has not only deepened their professional knowledge but also enhanced their soft skills, including teamwork, public speaking, and problem-solving. Adrian has now enrolled in a local university's computer science-related bachelor's degree program and is working with his friends to establish a startup company to launch "Streaming Hub" into the market. https://metroeducationplus.com.hk/28267/【職涯焦點｜職場kol】vtc-ive-直播app/