unreachable.cloud
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
inari@piefed.zip to Technology@lemmy.worldEnglish ·
edit-2
21 hours ago

Why your local LLM feels dumber than it is

forum.level1techs.com

external-link
message-square
60
fedilink
42
external-link

Why your local LLM feels dumber than it is

forum.level1techs.com

inari@piefed.zip to Technology@lemmy.worldEnglish ·
edit-2
21 hours ago
message-square
60
fedilink
Quick Introduction We have all been on forums, chats, reddit, discord, youtube, or somewhere and heard “Oh! Model XYZ is AMAZEBALLZ!zomgwtfbbq” then downloaded it (or more likely, some quantized form of it) and said “eww… This sucks!” This post is going to be a rather technical series of experiments to demonstrate the impact of implementation-specific hazards with inference. I will be using the term “reference implementation” to describe the lab that published and offers first-party hosting of ...
  • one_old_coder@piefed.social
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    7
    ·
    20 hours ago

    [email protected]: Are you a bot? You are posting multiple times every hour of the day.

    • inari@piefed.zipOP
      link
      fedilink
      English
      arrow-up
      9
      ·
      13 hours ago

      Nope. I post things I find on Reddit or Hacker News sometimes, though.

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      edit-2
      16 hours ago

      Nah, I dont think so. There are comments mixed with posts, there arent that many posts, and they seem to be reasonably curated.

Technology@lemmy.world

technology@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


  • @[email protected]
  • @[email protected]
  • @[email protected]
  • @[email protected]
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 6.43K users / day
  • 10.4K users / week
  • 16.3K users / month
  • 30.7K users / 6 months
  • 1 local subscriber
  • 87.5K subscribers
  • 19.2K Posts
  • 753K Comments
  • Modlog
  • mods:
  • L3s@lemmy.world
  • enu@lemmy.world
  • Technopagan@lemmy.world
  • L4sBot@lemmy.world
  • L3s@hackingne.ws
  • BE: 0.19.5
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org