Live Free-View Video for Soccer Games

Islam Amar, Abdalla Elsana, Jihad El-Sana

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Free-view video lets viewers choose their camera parameters when watching a recorded or live event; they can interactively control the camera view and choose to focus on different parts of the scene. This paper presents a novel client-server architecture approach for free-view videos of sports. The clients obtain a detailed 3D representation of the players and the game field from the server of a shared repository. The server receives video streams from several cameras around the game field, detects the players, determines the camera with the best view, extracts the poses of each player, and encodes this data with a timestamp into a snapshot, which is streamed to the clients. A client receives a stream of snapshots, applies each pose to the appropriate player's 3D model (avatar), and renders the scene according to the user's virtual camera. We have implemented our approach while using VIBE [Kocabas et al. 2020] for pose extraction and obtained promising results. We transferred a soccer game into a 3D representation supporting free-view with a reconstruction error below . Our unoptimized implementation is nearly real-time; it runs at about 30 frames/second.

Original languageAmerican English
Title of host publicationProceedings - Web3D 2023
Subtitle of host publication28th International Conference on Web3D Technology
EditorsStephen N. Spencer
ISBN (Electronic)9798400703249
DOIs
StatePublished - 9 Oct 2023
Event28th International Conference on Web3D Technology, Web3D 2023 - San Sebastian, Spain
Duration: 9 Oct 202311 Oct 2023

Publication series

NameProceedings - Web3D 2023: 28th International Conference on Web3D Technology

Conference

Conference28th International Conference on Web3D Technology, Web3D 2023
Country/TerritorySpain
CitySan Sebastian
Period9/10/2311/10/23

Keywords

  • Human Body Animation
  • Human Body Reconstruction
  • Sports Real-time Rendering

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint

Dive into the research topics of 'Live Free-View Video for Soccer Games'. Together they form a unique fingerprint.

Cite this