• 0 Posts
  • 34 Comments
Joined 3 years ago
cake
Cake day: July 31st, 2023

help-circle




  • MCP is a really dumb server that just takes requests and sends back data.

    Somewhere in your frontend settings (Open-WebUI has it under “integrations” I believe, some backends can set these things too) you see a section called “MCP server”. You need to keep your MCP server running somewhere (it’s very slim, so not a huge deal usually) and then in those settings you put your IP and port for the server, for example “http://192.168.1.15:8080/”. Usually if you did it right (sometimes you can check if it works in the settings), you can ask the model if it has access to the tools and it will tell you.

    What’s happening in the background is that every conversation the AI does, it gets a short preamble with some context about what it can do, and if you connect web search, custom skills or an MCP server (it’s just skills but they are run through their own server basically), the AI sees all that in this preamble if it’s set up correctly. And then when it feels like it needs to use those tools, it will check the description on how to do that, and then it uses them.


  • 1070ti and some hexacore something cpu that’s alright with around 24gb ddr4, I think one of the slower speeds. I also got a faster PC with another llama.cpp instance and I vibe coded a quick and dirty proxy which I can use to switch between the different backends. It’s genuinely useful because I got code editors but also my Open-WebUI using it.

    Sounds elaborate but generally it’s all pretty primitive.







  • This might be controversial but hear me out:

    The idea of an international independent currency that can be made use of anonymously and therefore not controlled by anyone is a great idea.

    Most smaller coins are just scams, reimplementing the same protocols that earlier schemes did and eventually adopting a clear pump & dump characteristic.

    However, I personally believe that bigger coins like etherium that don’t fold as quickly and stick around are genuinely a good idea.

    Moreover, there’s use cases where transactions are tracked for different systems, for example tracking an interconnected energy grid and usage of households.

    And then you also have to consider that block-chains themselves can just be used to keep a fulsome record of something, with the main goal of decentralizing control over that record. I’m sure there will be quite a few use cases for it that make more sense and it’s quite a shame the stigma of crypto got attached to it.

    If you wanna learn more about how block chains are actually researched, you have to dive into academic publications, but then you will find out scientists have a very different vision for this technology which is way more useful. And for the sake of actual science, I hope they don’t get buried under the stigma of crypto, because oftentimes these are just very smart people with lots of passion for something that they genuinely see value in.




  • Lots of people chimed in regarding battery, which is a legitimate issue.

    Another thing though is ARM. Phones usually have a different processor architecture and this architecture used to be incompatible with lots of server software. I remember being pissed at because I couldn’t even host a TeamSpeak Server on it because it wasn’t compatible. Now this was a while back and I’ve heard compatibility has gotten better but still, do some research beforehand.