Optimize fixed launch overheads

[jansel]

#2461 got me a bit worried about very small (overhead bound) sizes.

Not all of our users will run with cudagraphs, so those fixed overheads matter. We should optimize these, and possibly switch to a C++-based launch wrapper.

[choijon5]

I'm looking at this now.