This. Time is precious, many good options already exist, and it's hard to do well, particularly in such a way that it doesn't cause unnecessary friction later. Unless your business _is_ building a UI framework, it's probably not integral to the business, thus acts as a pretty big distraction that isn't easy to pivot into a business itself.
I have built many of them to good effect.