Category: AI

First up is AI chips, since Groq made waves this past month with their LLM optimized chips with much faster inference than anything we’ve seen before. Etched is another player in this domain, but we haven’t seen a public demo yet. AI chips aren’t necessary new (eg. Graphcore, Ceerebras), and a question is, will specialized chips maintain value as model architecture evolves? […]

Vector embeddings are numerical representation of words and ideas in the form of a matrix, and core to how large language models work. While most people use the large language models directly with ChatGPT, you may have heard of semantic search, vector search, or embeddings – which refers to the use of these matrices themselves. A […]