Musical training has traditionally relied heavily on access to formal education, which is often expensive and not accessible to everyone. Even for those with access, formal education typically provides only one or two contact hours per week, leaving significant independent study time without teacher guidance.
We aim to develop computer software to assist with this independent study. Such software can be much more affordable than having a teacher supervise one's studies.
One area of interest is developing music perception and appreciation skills. While there are already commercial software packages like Auralia and Duolingo Music, there is still room for innovation, such as broadening to a wider range of musical styles or addressing higher levels of music appreciation.
Another area of interest is developing performance skills, such as sound production on voice and instruments, playing by ear, or learning specific pieces of music. These projects can leverage recent advancements in automatic sound analysis to help the algorithm understand how the user is singing or playing. The algorithm can then interpret this input, provide feedback, and make recommendations for improvement.
It is easy to envision an algorithm giving feedback on basic aspects of music performance that can be objectively described, such as pitch and rhythm accuracy. A more stimulating challenge is providing feedback on subjective aspects of music interpretation, such as rubato. Work in this area could draw on previous research in empirical performance studies.
Aside from critiquing an individual performance, an algorithm could also be used to track and assess the user’s practice strategies. The quality of practice is known to be an important predictor of musical development, yet practice is normally not monitored by teachers, so students do not commonly receive feedback on it. Depending on the intended user, the app could be used to incentivise good practice techniques through the use of virtual awards, streaks that can be shared on social media, and so on.
