Just coming across this now, hello everyone -- I wanted to say that Hometown has implemented what @julian proposes in the OP for its entire existence, since about 2019. It's worked quite well!
https://github.com/hometown-fork/hometown/wiki/More-content-types