Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yes this is what I"m waiting for. I do hope these cards will not come with any kind of vendor locking though.
 help



What kind of vendor locking would be possible?

Any kind really. If Apple can lock down the CPU of an iPhone, then I'm sure it is possible to lock down an LLM chip. The business model may then be that you can buy certain "agent apps" and run them on your LLM card. But I have to stop here because I don't want to give anyone any ideas though I'm sure they are "creative" enough.

IP-protected models manifested directly in silicon.

Everything we’re using now is the equivalent of building a GPU on an FPGA: the hardware is general purpose at one abstraction level, and that comes with inefficiency at the next layer up. Collapse the levels, gain efficiency at the cost of generality.


The whole premise of what's being described here is to bake the weights into the silicon. That isn't what I'd describe as vendor lock-in, any more than I'd describe a CPU that can only execute ARM instructions as vendor locked.

To answer my own question, I bet they could figure out a way to still bill you per-token, if they wanted to.


Portability between x86 and ARM is not a form of vendor lock?

And of course they could bill per-token, same way cable PPV worked (the bits were already in your house). But the cost structure of weights in silicon means that competitors would be encouraged to compete on this per-token cost, as their marginal cost would be zero.

I don’t see that being a durable business model, but I guess the counter argument is it’s also similar to game consoles, where initial hardware is subsidized and the business model assumes ongoing payment for bits.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: