pith. sign in

arxiv: 2607.02174 · v1 · pith:RDRE2CNAnew · submitted 2026-07-02 · 💻 cs.RO · cs.HC

Choreographing the Way of Water: A Computational Framework for Aquatic Robotic Art

Aswin Ramachandran , Christopher Golling , Sebastian Burmester , Noa Sendlhofer , Jan Kamm , Ruiheng Jiang , Raffaello D'Andrea This is my paper

Pith reviewed 2026-07-03 11:42 UTC · model grok-4.3

classification 💻 cs.RO cs.HC
keywords aquatic roboticsrobotic choreographyswarm roboticsmodel predictive controlsequential convex programmingartistic interfacescyber-physical systems
0
0 comments X

The pith

A browser-based studio lets artists choreograph fleets of aquatic robots as a music-responsive instrument.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper establishes a complete cyber-physical framework for using fleets of autonomous surface vessels in open-water robotic art. It introduces the Way of Water Studio as a timeline-based authoring tool that hides advanced control algorithms behind an interface similar to digital audio workstations. This allows non-programmers to create choreographies that respond to music while the underlying system generates trajectories and rejects disturbances like waves and currents. Validation through two real-world deployments with 8 and 18 vessels shows the approach works in practice for expressive performances that extend into three dimensions with lighting and water jets.

Core claim

The central contribution is the Way of Water Studio, which encapsulates Sequential Convex Programming for trajectory generation and Model Predictive Control for disturbance rejection within a visual timeline interface, enabling music-responsive choreography of a fleet of autonomous surface vessels equipped with laminar nozzles and multi-zone lighting.

What carries the argument

The Way of Water Studio, a browser-based timeline-compositing authoring paradigm that treats the fleet as a DAW-like instrument for music-responsive choreography.

Load-bearing premise

The Sequential Convex Programming and Model Predictive Control layers tuned for the aquatic domain will reliably reject real-world disturbances across fleet sizes of 8 to 18 vessels without requiring per-deployment manual retuning.

What would settle it

A new deployment of 10 to 15 vessels in moderate waves where the generated trajectories require post-hoc manual adjustments or fail to maintain formation would show the control layers do not reject disturbances as claimed.

Figures

Figures reproduced from arXiv: 2607.02174 by Aswin Ramachandran, Christopher Golling, Jan Kamm, Noa Sendlhofer, Raffaello D'Andrea, Ruiheng Jiang, Sebastian Burmester.

Figure 1
Figure 1. Figure 1: The Way of Water installation: A fleet of illuminated vessels performing synchronized motion on Lake Zurich. [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: The Swan Lake performance, where autonomous vessels enact a balletic choreography, mirroring the elegance of [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Overview of the hardware design, showing the [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: MPC tracking performance under wave and cur [PITH_FULL_IMAGE:figures/full_fig_p005_4.png] view at source ↗
Figure 6
Figure 6. Figure 6: Parametric Motion Editor. Double-clicking the timeline (bottom) creates an effect, which can be dragged and resized. [PITH_FULL_IMAGE:figures/full_fig_p006_6.png] view at source ↗
read the original abstract

Robotic choreography in open water is governed by nonlinear fluid dynamics, which impose significant challenges due to environmental disturbances and nonlinear system dynamics. This paper presents the cyber-physical architecture of Way of Water, a vertically integrated framework that orchestrates a fleet of autonomous surface vessels as a distributed choreographic platform. Moving beyond the surface-pixel paradigm, these vessels use laminar nozzles and multi-zone lighting to extend their expressive range from the 2D water plane into the 3D volumetric domain. Our primary contribution is the Way of Water Studio, a browser-based, timeline-compositing authoring paradigm that treats the fleet as a DAW-like instrument for music-responsive choreography. The Studio encapsulates Sequential Convex Programming for trajectory generation and Model Predictive Control for disturbance rejection presented through a visual timeline, broadening access to high-performance aquatic robotics for non-programmer artists. Grounding the Studio is the full cyber-physical stack: a custom holonomic chassis, a state-estimation and control stack tuned for the aquatic domain, and an LTE/MQTT fleet link with RTK-GPS time synchronization. We report on the system's validation across two distinct deployments: an 18-vessel Swan Lake interpretation at Lake Zurich and an 8-vessel Time Space Existence 2025 Venice Biennale demonstration at Forte Marghera, establishing a foundational reference for the design and deployment of fluidic robotic swarms.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 2 minor

Summary. The paper presents Way of Water, a vertically integrated cyber-physical framework for orchestrating fleets of autonomous surface vessels as a distributed choreographic platform in open water. The primary contribution is the Way of Water Studio, a browser-based timeline-compositing tool that treats the fleet as a DAW-like instrument, encapsulating Sequential Convex Programming (SCP) for trajectory generation and Model Predictive Control (MPC) for disturbance rejection. The system includes a custom holonomic chassis, aquatic-tuned state estimation and control, and LTE/MQTT fleet communication with RTK-GPS synchronization. Validation is claimed via two real deployments: an 18-vessel Swan Lake performance at Lake Zurich and an 8-vessel demonstration at the 2025 Venice Biennale.

Significance. If the empirical claims hold, the work offers a practical bridge between high-performance control methods and artistic practice, lowering barriers for non-programmer artists to create music-responsive volumetric performances in fluid environments. The real-world deployments provide concrete grounding beyond simulation, and the DAW-inspired authoring paradigm could influence accessible tools in robotic art and human-robot interaction.

major comments (2)
  1. [Abstract] Abstract and validation description: the assertion of 'successful validation' across the two deployments supplies no quantitative performance data, trajectory tracking errors, disturbance-rejection metrics (e.g., wave/current rejection statistics), or baseline comparisons, which is load-bearing for the central claim that the SCP/MPC stack reliably operates without per-deployment retuning.
  2. [Validation deployments] The load-bearing assumption that the aquatic-tuned MPC will reject real-world disturbances (waves, wind, currents) across fleet sizes of 8–18 without manual intervention is presented as supported by the deployments, yet no specific evidence (e.g., closed-loop error traces or retuning logs) is referenced to substantiate this.
minor comments (2)
  1. [Abstract] The abstract introduces several acronyms (SCP, MPC, DAW, RTK-GPS) without first-use expansion; a dedicated notation table or expanded first paragraph would improve readability for an interdisciplinary audience.
  2. [Introduction] The description of the 'laminar nozzles and multi-zone lighting' extending to the '3D volumetric domain' would benefit from a clarifying figure or diagram early in the manuscript to distinguish the expressive mechanism from standard surface-pixel approaches.

Simulated Author's Rebuttal

2 responses · 1 unresolved

We thank the referee for the detailed and constructive comments. We address each major comment below, agreeing where the manuscript requires strengthening and proposing targeted revisions.

read point-by-point responses

  1. Referee: [Abstract] Abstract and validation description: the assertion of 'successful validation' across the two deployments supplies no quantitative performance data, trajectory tracking errors, disturbance-rejection metrics (e.g., wave/current rejection statistics), or baseline comparisons, which is load-bearing for the central claim that the SCP/MPC stack reliably operates without per-deployment retuning.

    Authors: We agree that the abstract's phrasing of 'successful validation' is not supported by quantitative metrics in the current manuscript. The deployments are presented as real-world demonstrations of the system completing choreographed performances without per-deployment retuning or manual intervention. In revision we will qualify the abstract language to describe the outcomes as 'demonstrated through two public artistic deployments' and add a dedicated paragraph in the validation section that explicitly states the success criteria used (completion without collisions or timeline deviations) while acknowledging the absence of logged tracking errors or baseline comparisons. revision: yes

  2. Referee: [Validation deployments] The load-bearing assumption that the aquatic-tuned MPC will reject real-world disturbances (waves, wind, currents) across fleet sizes of 8–18 without manual intervention is presented as supported by the deployments, yet no specific evidence (e.g., closed-loop error traces or retuning logs) is referenced to substantiate this.

    Authors: The manuscript grounds the claim in the fact that both the 18-vessel and 8-vessel performances ran to completion under the deployed MPC without observed manual corrections or retuning. We acknowledge that this does not constitute the quantitative evidence requested. We will revise the validation section to make the evidential basis explicit, add any available observational notes on environmental conditions, and include a limitations paragraph noting the lack of closed-loop error traces or retuning logs. revision: yes

standing simulated objections not resolved
  • Quantitative performance data such as trajectory tracking errors, wave/current rejection statistics, or closed-loop error traces from the deployments, as these were not collected during the artistic events.

Circularity Check

0 steps flagged

No significant circularity

full rationale

The paper presents an engineering systems contribution: a browser-based authoring studio that wraps standard Sequential Convex Programming for trajectory generation and Model Predictive Control for disturbance rejection, validated by two real-world fleet deployments (18 vessels at Lake Zurich; 8 at Venice). No equations, fitted parameters, or first-principles derivations are described that reduce claimed performance to inputs by construction. The central claims rest on the integration of existing methods and empirical field results rather than any self-referential prediction or self-citation chain that would force the outcome.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

Abstract-only review supplies no explicit free parameters, axioms, or invented entities; full text would be required to populate the ledger.

pith-pipeline@v0.9.1-grok · 5801 in / 1187 out tokens · 42837 ms · 2026-07-03T11:42:17.854769+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

29 extracted references · 3 canonical work pages

  1. [1]

    Sofian Audry, Stephen Kelly, and Samuel St-Aubin. 2019. Vessels. Robotic art installation. https://sofianaudry.com/works/vessels/ A performative installation of autonomous aquatic vessels exhibited in artistic venues

    2019

  2. [2]

    Federico Augugliaro, Angela P Schoellig, and Raffaello D’Andrea. 2012. Gen- eration of collision-free trajectories for a quadrocopter fleet: A sequential convex programming approach. In2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, IEEE, New York, NY, USA, 1917–1922

    2012

  3. [3]

    Lancelot Blanchard, Perry Naseck, Eran Egozy, and Joseph A Paradiso. 2024. Developing Symbiotic Virtuosity: AI-Augmented Musical Instruments and Their Use in Live Music Performances. Technical Report. MIT Media Lab, Cambridge, MA, USA. https://doi.org/10.21428/e4baedd9.69c11de7 An MIT Exploration of Generative AI

    work page doi:10.21428/e4baedd9.69c11de7 2024

  4. [4]

    2009.Assignment Problems

    Rainer Burkard, Mauro Dell’Amico, and Silvano Martello. 2009.Assignment Problems. SIAM, Philadelphia, PA

    2009

  5. [5]

    Miguel Duarte, Vasco Costa, Jorge Gomes, Tiago Rodrigues, Fernando Silva, Sancho M Oliveira, and Anders Lyhne Christensen. 2016. Evolution of col- lective behaviors for a real swarm of aquatic surface robots.PLoS One11, 3 (2016), e0151834

    2016

  6. [6]

    Gilberto Esparza. 2010. Plantas Nómadas. Artwork installation. https: //gilbertoesparza.net/portfolio/plantas-nomadas/ Autonomous hybrid robotic- plant organisms that migrate along polluted waterways. VIDA 13.2 Art and Artificial Life International Awards, Fundación Telefónica

    2010

  7. [7]

    Simon J Julier and Jeffrey K Uhlmann. 1997. New extension of the Kalman filter to nonlinear systems. InSignal Processing, Sensor Fusion, and Target Recognition VI, Vol. 3068. SPIE, SPIE, Bellingham, WA, USA, 182–193

    1997

  8. [8]

    Jong Wook Kim, Justin Salamon, Peter Li, and Juan Pablo Bello. 2018. Crepe: A convolutional representation for pitch estimation. In2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, IEEE, New York, NY, USA, 161–165

    2018

  9. [9]

    Vit Kratky, Robert Penicka, Jiri Horyna, Petr Stibinger, Tomas Baca, Matej Petrlik, Petr Stepan, and Martin Saska. 2025. CAT-ORA: Collision-Aware Time-Optimal Formation Reshaping for Efficient Robot Coordination in 3D Environments

    2025

  10. [10]

    Mathieu Le Goc, Lawrence H Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building blocks for swarm user interfaces. InProceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 97–109

    2016

  11. [11]

    Jon McCormack, Toby Gifford, Patrick Hutchings, Maria Teresa Llano, Matthew Yee-King, and Mark d’Inverno. 2019. Holon: A Framework for Simulation and Exhibition of Artificial Biota. InProceedings of the 10th In- ternational Conference on Computational Creativity (ICCC). Association for Computational Creativity, Charlotte, NC, USA, 8 pages.Holon(2018) is a...

    2019

  12. [12]

    Brian McFee, Colin Raffel, Dawen Liang, Daniel PW Ellis, Matt McVicar, Eric Battenberg, and Oriol Nieto. 2015. librosa: Audio and music signal analysis in python. InProceedings of the 14th Python in Science Conference (SciPy 2015), Vol. 8. SciPy, Austin, TX, USA, 18–25

    2015

  13. [13]

    Daniel Morgan, Soon-Jo Chung, and Fred Y Hadaegh. 2014. Model Predictive Control of Swarms of Spacecraft Using Sequential Convex Programming. Journal of Guidance, Control, and Dynamics37, 6 (2014), 1725–1740

    2014

  14. [14]

    Gordon Pask. 1969. The Architectural Relevance of Cybernetics.Architectural Design39, 9 (1969), 494–496

    1969

  15. [15]

    Craig W Reynolds. 1987. Flocks, Herds, and Schools: A Distributed Behavioral Model. InProceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’87). ACM, New York, NY, USA, 25–34

    1987

  16. [16]

    Ken Rinaldo. 2002. Autopoiesis.Leonardo35, 4 (2002), 395–396. Artist statement for the robotic sculptureAutopoiesis(2000)

    2002

  17. [17]

    Amit Rogel, Qiaoyu Yang, Jack Hayley, and Gil Weinberg. 2025. Do Re Mi Fa So Pass the Tool: Using Melodic Prediction to Improve Human-Robot Fluency. In2025 34th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE, IEEE, New York, NY, USA, 199–206

    2025

  18. [18]

    Simon Rouard, Francisco Massa, and Alexandre Défossez. 2023. Hybrid trans- formers for music source separation. InICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, IEEE, New York, NY, USA, 1–5

    2023

  19. [19]

    Maria Santos and Magnus Egerstedt. 2020. Interactive Multi-Robot Painting Through Colored Motion Trails.Frontiers in Robotics and AI7 (2020), 580415

    2020

  20. [20]

    Richard Savery, Amit Rogel, Lisa Zahray, and Gil Weinberg. 2023. How Happy Should I be? Leveraging Neuroticism and Extraversion for Music-Driven Emotional Interaction in Robotics. InSound and Robotics. Chapman and Hall/CRC, Boca Raton, FL, USA, 199–218

    2023

  21. [21]

    Martin Schuck, Dinushka Orrin Dahanaggamaarachchi, Ben Sprenger, Vedant Vyas, Siqi Zhou, and Angela P Schoellig. 2025. SwarmGPT: Combining Large Language Models with Safe Motion Planning for Drone Swarm Choreography. IEEE Robotics and Automation Letters10, 11 (2025), 12237–12244

    2025

  22. [22]

    Matthew Turpin, Nathan Michael, and Vijay Kumar. 2014. Capt: Concurrent assignment and planning of trajectories for multiple robots.The International Journal of Robotics Research33, 1 (2014), 98–112. https://doi.org/10.1177/ 0278364913515307

    2014

  23. [23]

    Pauli Virtanen, Ralf Gommers, Travis E Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, Stéfan J van der Walt, Matthew Brett, Joshua Wilson, K Jarrod Millman, Nikolay Mayorov, Andrew R J Nelson, Eric Jones, Robert Kern, Eric Larson, C J Carey, İlhan Polat, Yu Feng, Eric W Moore, J...

    work page doi:10.1038/s41592-019-0686-2 2020

  24. [24]

    Bill Vorn. 2016. Artistic Approaches in Robotics: A Personal Journey. In Robotic Art: Exploring an Unlikely Symbiosis, Damith Herath, Christian Kroos, and Stelarc (Eds.). Springer, Cham, Switzerland, 243–262. Discusses works includingHysterical MachinesandGrace State Machines

    2016

  25. [25]

    Markus Waibel, Bill Keays, and Federico Augugliaro. 2017. Drone shows: Creative potential and best practices. Verity Studios White Paper. https: //veritystudios.com

    2017

  26. [26]

    Wei Wang, Luis A Mateos, Shuguang Park, Pietro Galdems, Dylan Kellogg, Fabio Duarte, Carlo Ratti, and Daniela Rus. 2020. Roboat II: A novel au- tonomous surface vessel for urban environments. In2020 IEEE/RSJ Interna- tional Conference on Intelligent Robots and Systems (IROS). IEEE, IEEE, New York, NY, USA, 1740–1747

    2020

  27. [27]

    Gil Weinberg and Scott Driscoll. 2006. Toward robotic musicianship.Computer Music Journal30, 4 (2006), 28–45

    2006

  28. [28]

    Irma Wicaksono, Lancelot Blanchard, Sam Chin, Cristian Colon, and Joseph A Paradiso. 2024. KnitworkVR: Dual-reality Experience through Distributed Sensor-Actuator Networks in the Living Knitwork Pavilion. InSIGGRAPH Asia 2024 Emerging Technologies. ACM, New York, NY, USA, 2 pages

    2024

  29. [29]

    Irma Wicaksono, Don Derek Haddad, and Joseph A Paradiso. 2022. Tapis Mag- ique: Machine-knitted Electronic Textile Carpet for Interactive Choreomusical Performance and Immersive Environments. InProceedings of the 2022 ACM Conference on Creativity and Cognition. ACM, New York, NY, USA, 326–339. https://doi.org/10.1145/3527927.3532812

    work page doi:10.1145/3527927.3532812 2022