DeepSeek Ultrafast

(github.com)

21 points | by neo2006 6 hours ago

3 comments

  • platinumrad 6 hours ago
    This will be very useful to me as someone who still uses LLMs interactively rather than trusting the harness to one-shot the whole thing.
  • jahala 1 hour ago
    I'll just go get my 8 x B300 (TP8) from the shed and start this up real quick
    • xlayn 1 hour ago
      I have been doing some poking at llama.cpp for amd gpus and at some point I ask claude if it was already 10x faster than GB200 and claude told me to not be funny, one of those things were more expensive than my house and nvidia sold them in a 72pack unit that needs it's own hvac....
  • rvz 6 hours ago
    Please continue. [0] Let's see what happens when it goes even faster than 2,400 TPS and why not host an abliterated version of this model as well.

    What could possibly go wrong?

    [0] https://news.ycombinator.com/item?id=50310886

    • xlayn 1 hour ago
      you know who was state of the art abliterated models who already have hack a lot of goverment services in a lot of places worldwide? openai, anthropic, google, facebook...

      Thanks god you are not a wacko suggesting Qwen4B-abliterated will hacK someone

      • rvz 23 minutes ago
        Yes. If we’re not prepared for frontier models breaching companies at 300 TPS, we are certainly not prepared to defend against frontier abliterated cyber models running at 2,400+ TPS.

        It takes the attackers to successfully breach their target once vs the defenders having to stop all attempts.