• 0 Posts
  • 45 Comments
Joined 5 years ago
cake
Cake day: January 26th, 2021

help-circle
  • D_Air1@lemmy.mltoSelfhosted@lemmy.worldDo you host your own AI?
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    1
    ·
    7 days ago

    Yeah, I’m using qwen 31b a3b on an amd 9070xt requires a bit of cpu offloading, but still plenty fast. Using it wall llama.cpp. Combine that with some mcp’s such as ddg-search to make it truly useful by actually being able to search online.

    I mostly use it for small tedious tasks with well defined inputs and outputs. For example when hyprland recently changed from their own configuration language to lua. At first I started going line by line translating my config to the new lua language until I realized oh wait this is exactly the type of thing that ML is useful for. Going from the well defined hyprland configuration language to their also well defined lua syntax. It banged it out in less than a minute with only a single mistake which I easily fixed. The mistake it made was that it forgot to translate the comments to lua. It did it in less than a minute and worked first try. Where as I had made several typos and gotten a few lines wrong when I was doing it by hand.

    Not to say that I couldn’t do it. I would have gotten it done in about half an hour, but less than a minute is a lot faster.

    I also used it to transform a bunch of unstructured data into json data, so that I could then use purpose built tools like jq to parse that. If I’m having trouble finding certain information. I’ll ask it to find me some resources to look at.

    Basically small well defined tasks and parsing data is what I use it for and it seems to be pretty good at that.

    What I don’t like is the way companies try to market it to people. I don’t believe people should be trying to summarize emails or messages from loved ones, writing essays or any other creative tasks for the most part. Translating is okay. I don’t expect a machine to be able to decide things for me or to be some filter between me and others.







  • This article confirms my own experiences with AI. I spend a lot more time reviewing, reprompting, and tweaking than I save on coding. Having to double check or fight it to get what I want is not a time saver. Not to say that it doesn’t save time when it is right, but the thing that I never seem to get across to proponents of AI is that anytime I need to reprompt or refine, I have lost. I have officially wasted time at this point compared to simply referencing the documentation. Unless I’m generating a significant portion of code which only needs minor tweaks. I’m generally not saving time.








  • Again the type of people who probably visit communities like this know that. If the profile is accurate and they know that these people are more resistant to these kinds of tactics. Isn’t just a waste of money to bid on showing that person an ad in the first place. I personally don’t even connect my tv to the internet and I run linux, so I doubt either of said devices are talking to anything. Ads outside that someone play your favorite song would need to build a profile on you on your digital devices and then somehow correlate that to you the individual when you go into stores.

    I know you said you don’t think are all the way there, but without getting facial recognition involved. I don’t see how they would correlate the two in the first place. Even then there are still holes, but that is besides the point. My main point is that someone whom meets the criteria that I described in my first comment seems like a waste on money to advertise to if you are one of the advertisers who are bidding on these spots.