[ ](/) * Products Close Products Open Products * [ Pricing ](/pricing/) * [ Products Overview ](/products/) * [ Enterprise Access ](/enterprise-access/) * [ GroqCloud™ Platform ](/groqcloud/) * [ GroqRack™ Cluster ](/groqrack/) * Developers Close Developers Open Developers * [ Free API Key ](https://console.groq.com/keys) * [ Start Building ](https://console.groq.com/) * [ Discord ](https://discord.gg/invite/groq) * [ Groq Libraries ](https://console.groq.com/docs/libraries) * [ Community ](/community/) * [ Showcase ](/showcase/) * Insights Close Insights Open Insights * [ Inference ](/inference/) * [ Blog ](/blog/) * [ Events ](/events/) * [ GroqThoughts ](/groqthoughts/) * [ Press Releases ](/press-releases/) * [ Videos ](/videos/) * [ White Papers ](/docs/) * About Close About Open About * [ About Groq ](/about-us/) * [ In the News ](/groq-in-the-news/) * [ Team ](/leadership/) * [ Careers ](/careers/) [ Dev Console ](https://console.groq.com) [ ](#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjUyNTQiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D) [ ](#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjM0MDUiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D) [ ](/) * Products Close Products Open Products * [ Pricing ](/pricing/) * [ Products Overview ](/products/) * [ Enterprise Access ](/enterprise-access/) * [ GroqCloud™ Platform ](/groqcloud/) * [ GroqRack™ Cluster ](/groqrack/) * Developers Close Developers Open Developers * [ Free API Key ](https://console.groq.com/keys) * [ Start Building ](https://console.groq.com/) * [ Discord ](https://discord.gg/invite/groq) * [ Groq Libraries ](https://console.groq.com/docs/libraries) * [ Community ](/community/) * [ Showcase ](/showcase/) * Insights Close Insights Open Insights * [ Inference ](/inference/) * [ Blog ](/blog/) * [ Events ](/events/) * [ GroqThoughts ](/groqthoughts/) * [ Press Releases ](/press-releases/) * [ Videos ](/videos/) * [ White Papers ](/docs/) * About Close About Open About * [ About Groq ](/about-us/) * [ In the News ](/groq-in-the-news/) * [ Team ](/leadership/) * [ Careers ](/careers/) [ Dev Console ](https://console.groq.com) [ ](#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjUyNTQiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D) [ ](#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjM0MDUiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D) HEAR INSTANT INTELLIGENCE IN ACTION # GroqRack™ Compute Cluster:Deployment To Meet You Where You Are Take your own cloud or AI Compute Center to the next level with on-prem deployments. Groq LPU™ AI inference technology is available in various interconnected rack configurations to meet the needs of your preferred model sizes. [ DOWNLOAD BRIEF ](/wp-content/uploads/2024/08/GroqRack™-Compute-Cluster-Product-Brief-v1.7.pdf) ## Groq On-prem Deployment Advantages Plug & PlayData Center Deployment With no exotic cooling or power requirements, deploying Groq systems requires no major overhaul to your existing data center infrastructure. Lower Costs &Footprint With routing built into the LPU, your dollar and data center space go towards what matters – compute – instead of the high overhead costs of networking infrastructure. Available NorthAmerican-based Supply Groq currently has available supply, ready to get you up and running quickly with LPU AI inference technology that is designed and manufactured in North America. ## The Groq LPU AI Inference Technology Building Blocks The Groq LPU is a scalable software and hardware solution, with our compiler defining the LPU architecture, which is the basis of our systems. While Groq does not sell individual nodes, cards, or chips, our customers can access the LPU via GroqCloud™ and our on-prem solutions. Learn more about each system component below. Featuring eight compute plus one redundant GroqNode™ servers, GroqRack provides an extensible deterministic LPU network with with an end-to-end latency of only 1.6µs for a single rack. ### How the LPU Is Different Than a GPU Groq LPU AI inference technology is fundamentally different from a GPU, which was originally designed for graphics processing. * Groq Compiler is in control, and not secondary to hardware. * Compute and memory are co-located on the chip, eliminating resource bottlenecks. * Kernel-less compiler makes it easy and fast to compile new models. * No caches and switches means seamless scalability. ![](https://groq.com/wp-content/uploads/2024/07/Side-by-side-880.png) ## Connect With Our Team We’d love to hear about your use case and discuss an on-prem deployment solution that meets your needs – fill out our form below. [ GET IN TOUCH ](#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjQ0MTYiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D) ## Groq Powers Leading Openly-available AI Models [ ![](https://groq.com/wp-content/uploads/2024/06/Meta.png) ](https://llama.meta.com/llama3/) Llama [ ![](https://groq.com/wp-content/uploads/2024/06/MistralAI.png) ](https://mistral.ai/news/mixtral-of-experts/) Mixtral [ ![](https://groq.com/wp-content/uploads/2024/06/Google.png) ](https://ai.google.dev/gemma) Gemma [ ![](https://groq.com/wp-content/uploads/2024/06/OpenAI.png) ](https://openai.com/index/whisper/) Whisper And Groq Compiler runs 1,000+ models from AI communities such as [HuggingFace](https://huggingface.co/Groq). Never miss a Groq update! Sign up below for our latest news. [ Sign up for Groq updates ](#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjI1MzgiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D) ![](https://groq.com/wp-content/uploads/2024/03/GroqLogo_White.svg) ## © 2024 Groq, Inc., All rights reserved. [ ](https://discord.gg/invite/groq) [ ](https://x.com/groqinc) [ Youtube ](https://www.youtube.com/c/GroqInc) [ Threads ](https://www.threads.net/@groqinc) [ Linkedin ](https://www.linkedin.com/company/groq) [ Instagram ](https://instagram.com/groqinc) This site uses cookies to operate our website and analyze website traffic. [Read More](https://groq.com/privacy-policy/)AcceptReject Privacy & Cookies Policy Close #### Privacy Overview This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the ... Necessary Necessary Always Enabled Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information. Non-necessary Non-necessary Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website. SAVE & ACCEPT