LLMs

Things like ChatGPT are out there and have been for quite a now. I’ve also been using them for a while myself.

AI is a divisive topic. I can say, right now at least, that things in the realm of generative AIs are good, but not great. But they are getting better nearly every day. If you refuse to use them, then there’s a high likelihood that someone who does will get a jump on you.

The way they work is fascinating. People think that it’s just downloading the internet and “compressing” it in some way. I guess if you squint enough you could call it a very lossy compression. But it’s not that. It’s all just high-dimensionality vectors that are being slung around.

As a side note, there is an interesting property to high-dimensional vectors: with enough dimensions, it’s almost guaranteed that any two vectors are orthogonal to each other — that they meet at close to a right angle. It’s a cool concept. It’s one of the ways that encoding the information in that way is neat…

Anway. Just a random ramble today.

Previous
Previous

More progress on the Arcade!

Next
Next

Programming