Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


BMail.ag - Secure Email Service
Server.net
CPLicense.net
VPS Server
Buy VPN
Vultr
VMs for AI
HostDare
ReliableSite White-Label Dedicated Hosting for Resellers
25% Recurring Discount on NVMe VPS
Try EnsoVPN - Reliable VPN - 1-Day Free Trial
InterServer VPS
BMail.ag - Secure Email Service
Best VPN
High-Performance Bare Metal Server Solutions
Karvl.com
Server Mania Cloud Hosting
DataWagon Hosting
AlphaVPS Hosting
Evoxt.com
Clouvider
VPS Hosting with NVMe
Residential IPs in the US & 4G Mobile Proxies in EU & US with Unlimited Bandwidth
ReliableSite White-Label Dedicated Hosting for Resellers
Rabisu - Hosting Solutions
CloudLinux
Try EnsoVPN - Fast & Private VPN - 1-Day Free Trial
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

SOTA models begin their attack on open weight models

2

Comments

  • hiphiphip0hiphiphip0 Member
    edited July 24

    I don't think distillation alone is enough for Kimi to evolve into a version that poses a genuine threat.
    Perhaps only when open-source models surpass closed-source ones will the talk about distillation finally be put to rest.
    Or the time it took to catch up was so short that no one believed it.

  • made me ne'd. this is barely 1 model in 2T class, i sure hope the chinese won't stop releasing even more of them.

    if you care about certain model, make sure to have it stored locally. wouldn't be surprising if american got assblasted so hard that they start ruling huggingface to kicks out chinese model.
    the mongolian basket weaving forum also already meming llamacpp will cull the inference support for chinese model since they already got bankrolled by huggingface.

    you still can download them from modelscope, sure. downloading doesn't require account afaik. but uploading does need one with mandatory phone number verification (and i need one to mirror my quants/memetunes, probably resorting in account buying)

    Thanked by 1MikeA
  • forestforest Member
    edited July 24

    @emgh said: Honestly I find it very interesting that the expectation from almost everyone is that China is free and has every right to ban US models

    I don't think anyone should be banning any models. I doubt many people are simultaneously saying that the US shouldn't ban Chinese models but vice versa is fine.

  • NeoonNeoon Community Contributor, Veteran
  • emghemgh Member, Megathread Squad

    @forest said:

    @emgh said: Honestly I find it very interesting that the expectation from almost everyone is that China is free and has every right to ban US models

    I don't think anyone should be banning any models. I doubt many people are simultaneously saying that the US shouldn't ban Chinese models but vice versa is fine.

    Sure, I agree, but you’ll have a competitive advantage if China is banning US models but not the other way around.

    China will never, ever, unban US models. So question is given this, at some point, is the US giving China an unfair advantage letting them do whatever and still funding their AI CAPEX with american enterprise money?

    Thanked by 1buggedout
  • emghemgh Member, Megathread Squad

    @forest said:

    @emgh said:

    @MikeA said: Once something is available online, you can't just take it back and make it disappear. There are frontier-level open weight models that are publicly available now, and Kimi V3 will be soon.

    there's absolutely 0 SOTA model that's open weight right now, the total list is:
    GPT 5.6 Sol
    Fable 5
    Kimi K3

    And Kimi K3 isn't open weight, it may be, at some point, maybe, but they still market it as if it already is: https://openrouter.ai/moonshotai/kimi-k3

    Kimi K3 is a 2.8T parameter open-weight multimodal reasoning model from Moonshot AI

    The weights are due to be released on July 27th.

    It’s open weights when weights are released, not because there’s claim they’ll be released at some point. That’s my opinion at least.

    Nobody would call software open source if the dev said they will provide source code later on.

    Thanked by 2tentor tzuli
  • stable_geniusstable_genius Member
    edited July 24

    @Levi said:

    @MikeA said:

    @Levi said:
    Guys, you should be aware that today open model can be closed source model tomorrow :) . So be reasonable, China here is also not the “innocent” side.

    Once something is available online, you can't just take it back and make it disappear. There are frontier-level open weight models that are publicly available now, and Kimi V3 will be soon.

    Model can be open, but weights is released periodically and in controlled manner.

    Once an open model gets released it can be distilled to the max, there's no way to avoid that.

  • stable_geniusstable_genius Member
    edited July 24

    @TimboJones said:

    @jsg said:
    Wow, I'm sooooo surprised! western corporations with billions "invested" (read: in debt) do not like open and free products!
    And I'm sooooo surprised again that us-american politsters and corporate dealers do not like open and free chinese products at all .

    Maybe, just maybe because said corporations and politsters basically bet their country's economy on wet-dreamed billions upon billions of $$ of profit which of course just so happens to be based on them fully controlling the weirdo BS game?

    That alone is reason enough to like China's open ai BS and to hope that they'll win. So far it looks good for them.

    Go China, go!

    Wet dream reference number 63. You're so fucking creepy.

    You also seem to fundamentally misunderstand how life works.

    Hey timbo, have you been doing crack again??

    You must say NO!

    Crack is whack!

    Thanked by 1jsg
  • vovlervovler Member

    For distillation to be ip theft, every single prompt response should become the ip of the AI company. Wouldn't everyone that vibe coded an app also be participating in ip theft?

    Thanked by 1stable_genius
  • emghemgh Member, Megathread Squad

    @vovler said:
    For distillation to be ip theft, every single prompt response should become the ip of the AI company. Wouldn't everyone that vibe coded an app also be participating in ip theft?

    It's not IP theft, it's breaking the terms of the service. There could typically be civil consequences of this but it can't because the companies are chinese. Keep in mind it's nost just abusing the terms in case of how it's used but more so in the case (highly likely) of thousands of fake accounts.

    Thanked by 1tzuli
  • stable_geniusstable_genius Member
    edited July 24

    @emgh said:

    @vovler said:
    For distillation to be ip theft, every single prompt response should become the ip of the AI company. Wouldn't everyone that vibe coded an app also be participating in ip theft?

    It's not IP theft, it's breaking the terms of the service. There could typically be civil consequences of this but it can't because the companies are chinese. Keep in mind it's nost just abusing the terms in case of how it's used but more so in the case (highly likely) of thousands of fake accounts.

    Everyone is abusing with no consequences

    There is no law force only law farce, mere theatrical performances, no fair processes in place.

    There are no consequences for terrible very awful people. Zero accountability.

  • The last time I heard, feeding ai with Torrents is fair use, so surely this is fair use too, given that ai stuff can't be intellectual property.

  • coolicecoolice Member
    edited July 24

    My 2c - When You pay per token to ask question for code, then pay per token to get an answer that code, (no matter good or bad ) if using that answer code to train your AI make money is intellectual property theft...

    Then vibe coding for profit is intellectual property theft from frontline AI API providers...

  • emghemgh Member, Megathread Squad
    edited July 24

    @Mainfrezzer said:
    The last time I heard, feeding ai with Torrents is fair use, so surely this is fair use too, given that ai stuff can't be intellectual property.

    Using an AI service against their terms to generate a competing model is my definition not fair use

    Fair use is used for like including IP material when criticizing it, such as in artistic works

  • emghemgh Member, Megathread Squad

    Why should US allow China to operate in the US if China don’t allow the US to operate in China?

    Still haven’t gotten a response to this

    Thanked by 2tzuli buggedout
  • @emgh said:

    @Mainfrezzer said:
    The last time I heard, feeding ai with Torrents is fair use, so surely this is fair use too, given that ai stuff can't be intellectual property.

    Using a service against their terms is my definition not fair use

    Fair use is used for like including IP material when criticizing it, such as in artistic works

    good luck trying to remotely enforce that if the law is already ignorable. Its rather trivial to use any service without having agreed to the terms of the service.

  • emghemgh Member, Megathread Squad

    @Mainfrezzer said:

    @emgh said:

    @Mainfrezzer said:
    The last time I heard, feeding ai with Torrents is fair use, so surely this is fair use too, given that ai stuff can't be intellectual property.

    Using a service against their terms is my definition not fair use

    Fair use is used for like including IP material when criticizing it, such as in artistic works

    good luck trying to remotely enforce that if the law is already ignorable. Its rather trivial to use any service without having agreed to the terms of the service.

    You’re right. It’s not enforcable to chinese companies. This is why chinese companies do it while american ones don’t.

  • @emgh said:

    @Mainfrezzer said:

    @emgh said:

    @Mainfrezzer said:
    The last time I heard, feeding ai with Torrents is fair use, so surely this is fair use too, given that ai stuff can't be intellectual property.

    Using a service against their terms is my definition not fair use

    Fair use is used for like including IP material when criticizing it, such as in artistic works

    good luck trying to remotely enforce that if the law is already ignorable. Its rather trivial to use any service without having agreed to the terms of the service.

    You’re right. It’s not enforcable to chinese companies. This is why chinese companies do it while american ones don’t.

    you cant even enforce it within the states. Or anywhere really. Applies to anything. Theres a bunch of terms ive never agreed on. Windows for example. Now, im gonna let your imagination let lose. Just keep in mind, they have to prove that you were the person that agreed to the terms.

  • @Mainfrezzer said:

    @emgh said:

    @Mainfrezzer said:

    @emgh said:

    @Mainfrezzer said:
    The last time I heard, feeding ai with Torrents is fair use, so surely this is fair use too, given that ai stuff can't be intellectual property.

    Using a service against their terms is my definition not fair use

    Fair use is used for like including IP material when criticizing it, such as in artistic works

    good luck trying to remotely enforce that if the law is already ignorable. Its rather trivial to use any service without having agreed to the terms of the service.

    You’re right. It’s not enforcable to chinese companies. This is why chinese companies do it while american ones don’t.

    you cant even enforce it within the states. Or anywhere really. Applies to anything. Theres a bunch of terms ive never agreed on. Windows for example. Now, im gonna let your imagination let lose. Just keep in mind, they have to prove that you were the person that agreed to the terms.

    To summarize, not worth the paper they're printed on.

  • emghemgh Member, Megathread Squad

    @Mainfrezzer said:

    @emgh said:

    @Mainfrezzer said:

    @emgh said:

    @Mainfrezzer said:
    The last time I heard, feeding ai with Torrents is fair use, so surely this is fair use too, given that ai stuff can't be intellectual property.

    Using a service against their terms is my definition not fair use

    Fair use is used for like including IP material when criticizing it, such as in artistic works

    good luck trying to remotely enforce that if the law is already ignorable. Its rather trivial to use any service without having agreed to the terms of the service.

    You’re right. It’s not enforcable to chinese companies. This is why chinese companies do it while american ones don’t.

    you cant even enforce it within the states. Or anywhere really. Applies to anything. Theres a bunch of terms ive never agreed on. Windows for example. Now, im gonna let your imagination let lose. Just keep in mind, they have to prove that you were the person that agreed to the terms.

    Ah ok

  • emghemgh Member, Megathread Squad
    edited July 25

    Still looking forward to a reply to this:

    @emgh said:
    Why should US allow China to operate in the US if China don’t allow the US to operate in China?

    Still haven’t gotten a response to this

  • defaultdefault Veteran
    edited July 25

    @emgh said:
    Still looking forward to a reply to this:

    @emgh said:
    Why should US allow China to operate in the US if China don’t allow the US to operate in China?

    Still haven’t gotten a response to this

    There is no response to that. However, smart politicians usually build bridges, while stupid politicians build walls. Right now there are some very stupid ones who want to isolate their citizens from all sides. Humanity should unite, not separate or divide. There is a vast universe waiting for us, but we're too busy building weapons and walls and cutting each other's resources. Wiser people would see a bigger picture which does not include themselves.

    Thanked by 2emgh forest
  • rpqurpqu Member

    @PulsedMedia do you got 1.4TB worth of GPU lying around?

    Thanked by 1PulsedMedia
  • MikeAMikeA Member, Patron Provider

    @rpqu said:

    @PulsedMedia do you got 1.4TB worth of GPU lying around?

    If so please provide me with a 10 year payback period.

  • rpqurpqu Member

    @MikeA said:

    @rpqu said:

    @PulsedMedia do you got 1.4TB worth of GPU lying around?

    If so please provide me with a 10 year payback period.

    LOL. I didn't doubt you.
    On the other news, There's a chance AMD may release DDR6-based system on 2028.

  • PulsedMediaPulsedMedia Member, Patron Provider

    @rpqu said:

    @PulsedMedia do you got 1.4TB worth of GPU lying around?

    lol i wish.
    Well individual GPUs all that are laying around might account for a large fraction of that, but there is no way to cluster (afaik) a bunch of discreet old GPUs, atleast to work fast enough to be meaningful.

    Regardless, as i have stated API is just cheaper than even electricity unless you can buy the latest: https://wiki.pulsedmedia.com/wiki/Self-Hosting_LLMs_vs_API

    Thanked by 1rpqu
  • NeoonNeoon Community Contributor, Veteran

Sign In or Register to comment.