Discussed it quite extensively here with a few people, and not being able to add your own config files is pretty much intended. The idea coming from MS is that package developers can add their default config in code and allow people to override it themselves via appsettings when they want, instead of adding default config to files. Not sure if trying to hack around that is the best way forward.