that video is effect is cool, how did you make that?
I was thinking about using volume as well, librosa can do that. I can pick a time point where is relative volume is higher than its neighbors and use that as a point to do something in the game.
Just like you said, it would be less boring than only beat timing.
If i ever make any music game in the future, ill defiantly experiment that idea.