Chinese AI startup DeepSeek launches DeepSeek-V3, a massive 671-billion parameter model, shattering benchmarks and rivaling top proprietary systems. Its ultra-efficient, cost-effective design—developed for just $5.57 million—presents a compelling alternative to multi-million dollar models like GPT-4. With open-source availability on GitHub, this model sets the stage for democratizing AI innovation.

cross-posted from: https://lemmy.ml/post/24102825

DeepSeek V3 is a big deal for a number of reasons.

At only $5.5 million to train, it's a fraction of the cost of models from OpenAI, Google, or Anthropic which are often in the hundreds of millions.

It breaks the whole AI as a service business model that OpenAI and Google have been pursuing making state-of-the-art language models accessible to smaller companies, research institutions, and even individuals.

The code is publicly available, allowing anyone to use, study, modify, and build upon it. Companies can integrate it into their products without paying for usage, making it financially attractive. The open-source nature fosters collaboration and rapid innovation.

The model goes head-to-head with and often outperforms models like GPT-4o and Claude-3.5-Sonnet in various benchmarks. It excels in areas that are traditionally challenging for AI, like advanced mathematics and code generation. Its 128K token context window means it can process and understand very long documents. Meanwhile it processes text at 60 tokens per second, twice as fast as GPT-4o.

The Mixture-of-Experts (MoE) approach used by the model is key to its performance. While the model has a massive 671 billion parameters, it only uses 37 billion at a time, making it incredibly efficient. Compared to Meta's Llama3.1 (405 billion parameters used all at once), DeepSeek V3 is over 10 times more efficient yet performs better.

DeepSeek V3 can be seen as a significant technological achievement by China in the face of US attempts to limit its AI progress. China once again demonstrates that resourcefulness can overcome limitations.

  • ☆ Yσɠƚԋσʂ ☆@lemmy.ml
    ·
    3 days ago

    I've kind of given up trying to keep up with the details as well, stuff is moving way too fast for that. I'm really encouraged by the fact that open source models have consistently managed to keep up with, and often outperform commercial ones.

    There's also stuff like petals that's really exciting. It's basically similar idea to SETI@home and torrents where you just have a big network doing computing so you can amortize the work that way. This seems like a really good approach for running big models leveraging volunteer resources.

    https://github.com/bigscience-workshop/petals

    • JoeByeThen [he/him, they/them]
      ·
      3 days ago

      There's also stuff like petals that's really exciting. It's basically similar idea to SETI@home and torrents where you just have a big network doing computing so you can amortize the work that way. This seems like a really good approach for running big models leveraging volunteer resources.

      Ah, I've seen that before. Nice to see it's still continuing. Its ability to run private swarms is exactly the sort of thing the left should be all over.