According to a report by Jefferies, Nvidia’s dominance in the AI inference market could be challenged by startups like Groq and Cerebras by 2024. The report suggests that Groq’s Tensor Streaming Processor (TSP) and Cerebras’ Wafer Scale Engine (WSE) could outperform Nvidia’s GPUs in AI inference workloads. Inference is the process of using a trained AI model to make predictions on new data, and it is a critical component of many AI applications. While Nvidia currently holds a significant market share in AI inference, the report argues that Groq and Cerebras’ specialized chips could offer better performance and efficiency for certain AI workloads. However, the report also notes that Nvidia’s ecosystem and software support could help it maintain its lead in the short term. The potential shift in the AI inference market highlights the ongoing competition and innovation in the AI hardware space.
Source: https://www.businessinsider.com/nvidia-may-lose-ai-inference-market-groq-cerebras-2024-8