WhalesongAR filter

by Divij Sood

My project, Whalesong AR, is a bespoke location-based game designed for Whalesong park in Dundee. It’s localized using a private VPS wayspot. Anchors and gaze-based interaction start off the experience. You guide your simple AI companion, a whale, through a generated level of fish and mines in AR by physically moving and calling the whale to you. You’re instructed to detect the nearby river using semantic segmentation, and the depth buffer uses the world-space position of the detected water to guide the whale back into the river. Your gameplay is turned into spatial 3D artwork as the whale’s path is saved and visualized with a trail along with particle effects for the whales encounters with fish and mines.