MLB All-Star Wrap-Up: 4D Replay Adds New Perspective to Home Run Derby
ESPN deployed a 4D Replay system at Monday’s Home Run Derby that provided viewers with 360-degree replays of homers throughout the night. The 4D Replay system relied on 60 4K cameras mounted on the concourse level behind home plate and stretching from first to third base.
https://www.youtube.com/watch?v=xrjl9u1cg08
The cameras are tied together, and, for each play, the single operator selects the pivot point on which the camera axis turns. The operator can then manipulate the replay from side to side and can zoom in without losing resolution (thanks to 4K cameras).
Since the system simply stitches together 60 camera feeds and does not have to virtually create filler frames, no rendering is required, allowing 4D Replay clips to be ready in under 10 seconds. The replay is sent via fiber to ESPN’s truck, where an EVS channel constantly records the feed and the production team has the option to take it when it likes.
“The advantage of our system is we don’t really need to render since we use so many cameras,” said 4D Replay COO Henry Chon. “Other [systems] need a massive amount of computer resources and time. Whereas we’re basically going from camera to camera and just looking at an object like the ball. Because the cameras are so precisely calibrated in time, when camera 1 looks at the ball from its angle, that exact same location as the ball will be in camera 2. So when we put it together and just pan it, it looks totally seamless.”
During ESPNEWS’s first-of-its-kind alternative viewing experience for the Derby, ESPN also provided analyst Eduardo Perez with a 4D Replay touchscreen app on a tablet, allowing him to create 4D replays that were integrated into the telecast. This new 4D Replay tablet-based application made its debut at MLB All-Star.
ESPN deployed the 4D replay system first on June 4 at AT&T Ballpark in San Francisco (where the system is permanently installed this season) and then again for three games at Dodger Stadium (June 24-26). These systems require significantly more cameras since they also create 4D Replays from the pitchers mound and all three bases in addition to home plate. For example, the AT&T Ballpark system requires 140 cameras total: 50 covering the mound, 50 on the home plate, 10 each of the bases, and a handful of other covering the foul line down third base side, foul line down a big wide shot, a combination, and some spares.
The system at Nationals Park will also be used for this weekends Nationals-Braves series, with another 50 cameras deployed to cover the pitcher’s mound. Chon also says 4D Replay will make additional appearances at multiple MLB parks during the second half of the season.
For more of SVG’s on-site coverage from Washington D.C., visit the SportsTechLive Blog: On Site at MLB All-Star 2018.