It's also something that I've been looking at for SeoToolkit. For now I didn't have to really deal with breaking changes yet, but I plan to keep them behind and then do major upgrades together with the Umbraco ones. In my eyes, it makes it easier for the users to see what version belongs to which Umbraco version.
The only downside I have with it is that I'll probably end up having to manage multiple versions 😅 . If I keep the Umbraco v10 version supported for the same time as Umbraco, I'll most likely just get stuck at one point due to the versions.