ACM User Interface Software & Technology (UIST), 2024 DOI
Josh Pollock
MIT CSAIL
Catherine Mei
MIT CSAIL
Grace Huang
MIT CSAIL
Elliot Evans
Independent Researcher
Daniel Jackson
MIT CSAIL
Arvind Satyanarayan
MIT CSAIL
Diagrams are essential tools for problem-solving and communication as they externalize conceptual structures using spatial relationships. But when picking a diagramming framework, users are faced with a dilemma. They can either use a highly expressive but low-level toolkit, whose API does not match their domain-specific concepts, or select a high-level typology, which offers a recognizable vocabulary but supports a limited range of diagrams. To address this gap, we introduce Bluefish: a diagramming framework inspired by component-based user interface (UI) libraries. Bluefish lets users create diagrams using relations: declarative, composable, and extensible diagram fragments that relax the concept of a UI component. Unlike a component, a relation does not have sole ownership over its children nor does it need to fully specify their layout. To render diagrams, Bluefish extends a traditional tree-based scenegraph to a compound graph that captures both hierarchical and adjacent relationships between nodes. To evaluate our system, we construct a diverse example gallery covering many domains including mathematics, physics, computer science, and even cooking. We show that Bluefish’s relations are effective declarative primitives for diagrams. Bluefish is open source, and we aim to shape it into both a usable tool and a research platform.
@inproceedings{2024-bluefish title = {{Bluefish: Composing Diagrams with Declarative Relations}}, author = {Josh Pollock AND Catherine Mei AND Grace Huang AND Elliot Evans AND Daniel Jackson AND Arvind Satyanarayan}, booktitle = {ACM User Interface Software \& Technology (UIST)}, year = {2024}, doi = {10.1145/3654777.3676465}, url = {https://vis.csail.mit.edu/pubs/bluefish} }
Diagrams built with the Bluefish language. These graphics run the gamut from computer science to physics to math and are constructed with declarative, composable, extensible relations. From left to right: a quantum circuit equivalence, topologies, a Python Tutor diagram, an Ohm parse tree, and a physics pulley diagram.