Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

RackNerd’s BLACK FRIDAY TAKEOVER! NEW DEALS, NEW TECH, AdminBolt HOSTING + HUNDREDS OF GIVEAWAYS!

1…2829313334…104

Comments

  • LET’S GO! RACKNERD BLACK FRIDAY 2026 IS LIVE: https://www.racknerd.com/BlackFriday/ ⚡

  • Time to double the bandwidth! Please and thank you!
    8359245901

  • BTW, have you heard about Colibri? It streams from your SSD keeping only the important parts of the model in RAM. This way, I was able to run a 400+b model on 32GB RAM. Extremely slow though.

  • WHO'S SLEEPING? NOT ME, BABY! IT'S GIVEAWAY TIME!

  • @noob404 said:

    @DaDeveloper said:

    @noob404 said:
    BTW, @DaDeveloper @op23 have any suggestions for good scriptwriting models preferably anything under 35b?

    I honestly have not touched the smaller models besides Qwen's

    I have been using Qwen 35b, but I do feel it hallucinates. There's only much that prompting can do.

    yep quantization sucks, makes hallucinations more prevalent.

  • WHO'S SLEEPING? NOT ME, BABY! IT'S GIVEAWAY TIME!

  • WHO'S SLEEPING? NOT ME, BABY! IT'S ~MUG~ GIVEAWAY TIME!

  • @DaDeveloper said:

    @noob404 said:

    @DaDeveloper said:

    @noob404 said:
    BTW, @DaDeveloper @op23 have any suggestions for good scriptwriting models preferably anything under 35b?

    I honestly have not touched the smaller models besides Qwen's

    I have been using Qwen 35b, but I do feel it hallucinates. There's only much that prompting can do.

    yep quantization sucks, makes hallucinations more prevalent.

    I have been using GGUFs with llama. Do you think safete sors would be better?

  • LAOMALAOMA Member
    edited November 20

    WE'RE READY FOR MORE GIVEAWAYS! RACKNERD IS THE BEST.

  • GET DADEV A NEW COFFEE MUG!

    Thanked by 1DaDeveloper
  • @noob404 said:

    @DaDeveloper said:

    @noob404 said:

    @DaDeveloper said:

    @noob404 said:
    BTW, @DaDeveloper @op23 have any suggestions for good scriptwriting models preferably anything under 35b?

    I honestly have not touched the smaller models besides Qwen's

    I have been using Qwen 35b, but I do feel it hallucinates. There's only much that prompting can do.

    yep quantization sucks, makes hallucinations more prevalent.

    I have been using GGUFs with llama. Do you think safete sors would be better?

    Don't know, been sticking with vllm on the sparks

  • op23op23 Member

    @noob404 said:
    BTW, @DaDeveloper @op23 have any suggestions for good scriptwriting models preferably anything under 35b?

    Not much, one of the issues with many is the hallucinations.

    You can fix it a bit by writing a bunch of harness stuff and skills etc but it’s not a long term solution due to how trash it really is.

    Thanked by 1noob404
  • PLEASE HELP GET DADEV A NEW COFFEE MUG! (LIKE NOOB SAID LOL)

  • RESOURCE UPGRADE GIVEAWAY, YOU ARE MISSED!

  • @DaDeveloper said:

    @noob404 said:

    @DaDeveloper said:

    @noob404 said:

    @DaDeveloper said:

    @noob404 said:
    BTW, @DaDeveloper @op23 have any suggestions for good scriptwriting models preferably anything under 35b?

    I honestly have not touched the smaller models besides Qwen's

    I have been using Qwen 35b, but I do feel it hallucinates. There's only much that prompting can do.

    yep quantization sucks, makes hallucinations more prevalent.

    I have been using GGUFs with llama. Do you think safete sors would be better?

    Don't know, been sticking with vllm on the sparks

    Alright. I will try it later and let you guys know.

  • @noob404 said:

    RESOURCE UPGRADE GIVEAWAY, YOU ARE MISSED!

    HAH! NEED MORE STORAGE FOR MY INSANE EBOOK COLLECTION!

  • @op23 said:

    @noob404 said:
    BTW, @DaDeveloper @op23 have any suggestions for good scriptwriting models preferably anything under 35b?

    Not much, one of the issues with many is the hallucinations.

    You can fix it a bit by writing a bunch of harness stuff and skills etc but it’s not a long term solution due to how trash it really is.

    Exactly. Crazy hallucination. Can work in batches and by crazy prompting, but it still hallucinates.

  • @op23 what do you do for work?

  • @DaDeveloper said:

    @noob404 said:

    RESOURCE UPGRADE GIVEAWAY, YOU ARE MISSED!

    HAH! NEED MORE STORAGE FOR MY INSANE EBOOK COLLECTION!

    STORAGE UPGRADE PLEASE!

  • since last check, it has done a decent bit more work now at 1.42B total tokens XD

  • Time to double the bandwidth! Excited to try the San Jose location, please and thank you!
    Order Number: 5094861468

  • 6028907038
    Time to double the bandwidth

  • LET’S GO! RACKNERD BLACK FRIDAY 2026 IS LIVE: https://www.racknerd.com/BlackFriday/ ⚡

  • 5 million output tokens is equivalent to roughly 37 to 47 average-length novels. That's just in adversarial reviews and documentation reasoning XD but the docs its pumping out using my methods are kissed by chef level good

  • @DaDeveloper said:

    @noob404 said:

    @PuDLeZ said:

    @noob404 said:

    @PuDLeZ said:

    @noob404 said:

    @PuDLeZ said:

    @gritty said:
    will RackNerd still be hosting flash sales this bf?

    Chef always bakes some tasty treats on BF!

    Hey dude. You still here?

    yes/no, glancing at the thread every now and then :)

    Did you get the Toronto VPS giveaway? I missed it.

    Nope, I wasn't at home at that time. All good though, giveaways are nice but that's not the real reason I here. Just here to chat, work on my f5 game, and then hopefully snack on some of chef's tasty treats bf when he makes an appearance!

    Sure. I am looking forward to scoring atleast 1x VPS this time during the flash sales.

    I got more than enough last time, still riding the credits from last years bf, XD I think i was rivaling fat32 on the sniping of the giveaways

    hehe, I used the credits on a few community projects but I don't need to renew them until like 2029/2030 now :smile:

    Though, I do want some of those tasty upgrades and flash sales. While I would like the flash I sniped last year, in Chicago, LA is fine for a 2x Ryzen & 2.5G (includes a .5G ram upgrade) for like 13/yr.

  • @PuDLeZ said:

    @DaDeveloper said:

    @noob404 said:

    @PuDLeZ said:

    @noob404 said:

    @PuDLeZ said:

    @noob404 said:

    @PuDLeZ said:

    @gritty said:
    will RackNerd still be hosting flash sales this bf?

    Chef always bakes some tasty treats on BF!

    Hey dude. You still here?

    yes/no, glancing at the thread every now and then :)

    Did you get the Toronto VPS giveaway? I missed it.

    Nope, I wasn't at home at that time. All good though, giveaways are nice but that's not the real reason I here. Just here to chat, work on my f5 game, and then hopefully snack on some of chef's tasty treats bf when he makes an appearance!

    Sure. I am looking forward to scoring atleast 1x VPS this time during the flash sales.

    I got more than enough last time, still riding the credits from last years bf, XD I think i was rivaling fat32 on the sniping of the giveaways

    hehe, I used the credits on a few community projects but I don't need to renew them until like 2029/2030 now :smile:

    Though, I do want some of those tasty upgrades and flash sales. While I would like the flash I sniped last year, in Chicago, LA is fine for a 2x Ryzen & 2.5G (includes a .5G ram upgrade) for like 13/yr.

    NOICE!

  • I also pumped year ones credits into a vps and its gonna be around for a good while!

  • LET’S GO! RACKNERD BLACK FRIDAY 2026 IS LIVE: https://www.racknerd.com/BlackFriday/ ⚡

  • @DaDeveloper said:
    I also pumped year ones credits into a vps and its gonna be around for a good while!

    Me too. Got good amount of RN credits.

Sign In or Register to comment.