According to Mark Zuckerberg, Meta is planning to utilize NVIDIA’s H100 chip cluster and the Llama 4 AI model in 2024. The H100 chip cluster, which is NVIDIA’s latest and most powerful AI chip, will be used to train large language models like Llama 4. Llama 4 is expected to be a significant upgrade over the current Llama 2 model, with improved performance and capabilities. Zuckerberg stated that the combination of the H100 chip cluster and Llama 4 will enable Meta to create more advanced AI systems for various applications, including content moderation, language translation, and virtual assistants. This move aligns with Meta’s goal of becoming a leader in the AI industry and developing cutting-edge technologies for its metaverse platform.
Source: https://www.businessinsider.com/mark-zuckerberg-meta-nvidia-h100-chip-cluster-llama-4-2024-10