A GSoC 2025 work product: Medialode, a lightweight cross-platform CLI and SQLite-backed server that indexes image, audio, video and script files using per-type scanner workers over JSON-over-WebSocket.
A modular real-time pipeline that runs PointNet++ and PointPillars ONNX models on point cloud streams: RealSense, dataset files or WebSocket in; classification, segmentation and 3D detection out over OSC or WebSocket.
Porting the puara-gestures descriptors to Avendish, then rebuilding 11 goofi-pipe analysis nodes — clustering, PCA, VAMP, ERP — as native C++ processors in ossia score. 17 merged pull requests, and what is left.
How a Vulkan ray-tracing voxel renderer was built as an ossia score add-on for dome projection past 180 degrees, including the upstream patch needed to expose the VK_KHR ray-tracing extensions in score.
Porting Splash to OpenGL ES for the Raspberry Pi 4: hunting segfaults and GLSLES quirks, profiling with Tracy, and refactoring the graphics layer behind a Renderer interface that can host future APIs.
Adding TorqueTuner support to Feelix: exporting haptic effects to the knob's firmware, new MIDI effects playable through USB instruments, and an Apple Silicon development setup.
Three new SATIE mappers written in SuperCollider — cartesianControl1, cartesianControl2 and xDirAdjacent — adding Cartesian source placement, distance-based gain attenuation and multi-spatializer control.
A prototype for reliving live performances in augmented reality: MediaPipe Pose motion capture streamed over Web Sockets into a Three.js WebXR scene, and what still blocks Python-to-JavaScript integration.
A Mozilla Hubs room built for SAT's Satellite platform turns light into something you can play with: a Three.js ray source, sliders for angle, decay and rotation, and visible rays shared live between users.
Seven weeks of GSoC 2023 notes on building generalizable SATIE mappers: getting SuperCollider and SATIE running, reading the spatializer GUI and meters, then designing the nearFarField1 and cartesianControl mappers.
Porting Splash to the Raspberry Pi 4 with OpenGL ES 3.2: converting calls and shaders, merging the OpenGL and OpenGL ES code paths, and why Vulkan, bgfx and magnum were evaluated and set aside.
UNIX permissions come to the shmdata library: octal mode flags replace hardcoded read/write defaults in the socket server, semaphores and shared memory, plus a test that verifies stream access rights.
A GSoC 2022 contributor's account of adding UNIX permission checks to shmdata, SAT Metalab's shared-memory streaming library — what the task really involved, where it stalled, and how mentoring helped.
Adding LivePose to Poire's web UI alongside SATIE: remote start/stop of both tools on embedded Linux, Jack Audio settings, per-backend configuration, and state that survives a page reload.
Face and eye gestures as an input method in Satellite, SAT's fork of Mozilla Hubs: how Google MediaPipe was integrated, how gestures are rebound to in-world actions, and what accuracy work remains.