According to Dario Amodei, the CEO of Anthropic, training a state-of-the-art AI language model could cost as much as $10 billion by 2024. This staggering cost is due to the exponential growth in the size and complexity of these models, which require massive computational resources and vast amounts of data to train. Amodei’s estimate highlights the immense financial barriers to entry for companies and researchers seeking to develop cutting-edge AI systems. As language models become more advanced, the cost of training them is expected to continue rising, potentially limiting innovation to only the largest and most well-funded organizations. This raises concerns about the concentration of AI capabilities in the hands of a few tech giants, underscoring the need for more accessible and democratized AI development.
Source: https://www.businessinsider.com/anthropic-ceo-cost-10-billion-train-ai-years-language-model-2024-4