Student Projects
These are projects available in the SMCClab for Honours, Master, and summer research students. Each one is a self-contained piece of work with its own report and artefact. Most of them also connect to a bigger research question in the lab, and good results can become part of a publication with the lab team.
If one of these interests you, read the project expectations page and the Join page, then get in touch with Charles. Official listings are on the ANU School of Computing project page.
How these projects work
- Summer research projects run full-time for about 10–12 weeks over the ANU summer (December to February).
- One-semester Honours and Master projects run part-time over a semester. Two-semester Honours projects run across the year.
- Each project lists what a shorter project should deliver and what a longer project adds, so you can see the scope for your level.
- Lab hardware (Raspberry Pis, Bela boards, MIDI controllers) is provided for hardware projects.
- You’ll join the weekly lab status meeting and book individual meetings when you need them (see expectations).
- Your report is assessed on your own work. Where projects connect, each one has a fallback plan that doesn’t depend on anyone else. Publications that combine results from several projects are a separate, optional output, and everyone who contributed is an author.
Living with intelligent instruments
IMPSY is our platform for intelligent musical instruments. It records a musician’s gestures from a MIDI controller, trains a small mixture density recurrent neural network (MDRNN) on that data, and then plays back and responds in live performance. It runs on laptops, Raspberry Pis, iPads (as an AUv3 plugin), and in the web browser.
So far, we have mostly studied these instruments in short lab sessions or through our own performance practice. We don’t know much about what happens when musicians live with an intelligent instrument over weeks: collecting more data, retraining, and deciding whether the model is getting better or just different. The three projects below each take one part of that question and are planned to run from December to June.
-
Updating small-data music models across practice sessions
How should a musician’s personal AI model be updated as they collect more data over weeks of practice? (Summer research, Honours, Masters) -
A multi-week study of musicians living with an intelligent instrument
What happens when musicians take an intelligent instrument home and live with it for several weeks? (Honours, Masters) -
Visualising how an intelligent instrument changes over time
Design visualisations that show musicians how their AI model changes as they retrain it. (Summer research, Honours, Masters)
Artistic research projects
In artistic research, your own creative practice is the method: you learn about intelligent instruments by making music with them over time and reflecting carefully on what happens. Our recent work on material agency and AI feedback instruments used a duet practice with two AI instruments to show that control is not something a performer simply has. It shifts, is negotiated, and has to be learned through practice.
These projects suit students with an established musical practice who want to develop it alongside computing research. Outcomes include performances (e.g., at SMCClab Live), recordings, and a written report. Your artefact is the instrument you build or configure and any code you write (IMPSY configurations, mappings, training scripts, analysis notebooks), released with your report alongside the documented practice. You’ll use an established method, such as structured written reflection after each session analysed with reflexive thematic analysis or diffractive reading, so your report is research rather than a diary.
These are best as two-semester Honours or Master projects, as a practice needs time to develop. The lab provides the instruments (Raspberry Pis running IMPSY, controllers, and synthesisers), so you don’t need your own gear. Recording or quoting other performers, or interviewing audiences, needs ethics approval, so talk to us early if your project involves anyone else.
-
Learning to play an intelligent feedback instrument
Artistic research into how a performer learns to navigate agency with an AI feedback instrument. (Honours, Masters) -
Training data as creative material
Artistic research treating dataset curation and model training as part of musical practice. (Honours, Masters) -
Composing for an intelligent instrument ensemble
Compose and perform a new work for an ensemble of AI-enabled musical instruments. (Honours, Masters)
Theoretical and critical projects
These projects suit students who are more interested in ideas, frameworks, and analysis than building systems. Each one produces a substantial piece of scholarly writing and could lead to a review or position paper.
-
Agency in musical AI: a critical review
A structured review of how agency is defined and used in musical AI research. (Summer research, Honours, Masters) -
Who’s leading? Measuring agency in human-AI performance data
Can information-theoretic measures detect who is leading in human-AI musical performance? (Honours, Masters) -
Mapping the design space of intelligent musical instruments
Develop a taxonomy of intelligent musical instruments from published designs. (Summer research, Honours, Masters)
Bela Gem projects
Bela Gem is the new generation of the Bela embedded audio platform, built on the PocketBeagle 2 (quad-core ARM Cortex-A53, 512MB RAM). It offers sub-millisecond audio latency, 8 analog sensor inputs, 16 digital I/O, and USB MIDI. The Gem Multi version has 10 audio channels, including 8 DC-coupled outputs that can drive modular synthesisers directly. The lab has a Bela Gem Multi and an 8-channel audio system at the ANU School of Music for these projects.
-
An intelligent instrument in one box: IMPSY on Bela Gem
Combine sensing, an AI model, and sound synthesis in one low-latency Bela Gem instrument. (Honours, Masters) -
How much neural audio fits on a Bela Gem?
Benchmark which neural audio models can run in real time on the Bela Gem embedded platform. (Summer research, Honours, Masters) -
AI control voltages: an intelligent modular synthesiser voice
Bring intelligent instrument ideas to Eurorack modular synthesis with Bela Gem Multi. (Honours, Masters)
Hardware projects
-
A take-home intelligent instrument kit
Design a robust, low-cost intelligent instrument that musicians can take home and use without help. (Summer research, Honours, Masters) -
Scaling up wireless musical instrument networks
Measure how short-range radios behave in large networks of wireless musical instruments. (Honours, Masters)