New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
groq.com offers their llama 3 8B model for $0.06 per million tokens. If you truncate each email to the first 1000 tokens, the you could evaluate 16,000 emails per $1. Oh, but what about the privacy implications of shipping off all emails to some third party? Well, that's where this comes in: https://groq.com/privacy-policy/.
All in all, it could be a viable option for augmenting spam on a small-ish inbound volume (approx 2,000 per day in my case), even at today's pricing.
Might be a nice paid add-on at that rate ($1 per 5,000 emails a month), but I'd be curious to know how many MXRoute users would want additional costs like that! Don't forget there are additional costs. Development time, maintenance, and infrastructure!
Would be relatively simple to setup: intercept inbound emails, inserts any new emails in a queue, worker(s) execute LLM which returns JSON bool + other data, if spam filter/if not let go. Might even be able to get away with hosting the infrastructure on CloudFlare free plans if you did it via POP externally.