It's a tough balance I suppose, I wonder what is Core's principle regarding what non-loadable modules to omit?
Indeed. There's no set percentage, but I'd wager if something like 95% or 99% do not use some non-module-able feature, it's gone.
We don't make it difficult to run with one's own kernels, TC runs on vanilla kernels fine. So if some advanced user shows up with such a need, they can easily build a custom kernel with that feature. Many custom installs can also benefit from the cutting of unused parts such can bring.