Ross confirmed that Groq had grokked the question correctly. His chip, he says, is simpler, streamlined, and custom-built to optimize for LLMs. He also noted that the conversation he just had with ...

Now worth $2.8 billion, Groq thinks it can challenge one of the world’s most valuable companies with a purpose-built chip designed for AI from scratch.

Groq now allows you to make lightning fast queries and perform other tasks with leading large language models (LLMs) directly on its web site. On the tests I did, Groq replied at around 1256.54 ...

Groq, a Silicon Valley chip startup founded by a former Alphabet Inc engineer, said on Thursday it has adapted technology similar to the underpinnings of the wildly popular ChatGPT to run on its ...

Groq was created in 2016 with the name trademarked shortly after. However, Elon Musk’s chatbot, Grok, only appeared on the scene in November 2023, becoming widely recognized in the AI space in a ...

Groq, the pioneer in fast AI inference, today announced an exclusive partnership with Bell Canada to power Bell AI Fabric, the country's largest sovereign AI infrastructure project.

Semiconductor startup Groq said on Monday it has raised $640 million in a Series D funding round led by Cisco Investments, Samsung Catalyst Fund and BlackRock Private Equity Partners, among others ...

Groq's newly announced language processor, the Groq LPU, has demonstrated that it can run 70-billion-parameter enterprise-scale language models at a record speed of more than 100 tokens per second.

Groq has the remarkable ability to process over 500 tokens per second using the Llama 7B model. The Groq Language Processing Unit (LPU), is powered by a chip that’s been meticulously crafted to ...

Groq’s language processing unit, or LPU, is designed only for AI “inference” — the process in which a model uses the data on which it was trained, to provide answers to queries.