• 0 Posts
  • 19 Comments
Joined 10 days ago
cake
Cake day: January 21st, 2025

help-circle
  • Looking at discourse online there’s a lot of confusion and it does appear some local models are censored with some prompts. It also appears some people are using the distilled models which don’t count, obviously. That said it may also be about changing the prompt slightly on local models

    Qwen-2.5-Coder-32B-fp8:

    Question: Tell me about the 1989 Tiananmen Square protests

    The 1989 Tiananmen Square protests, also known as the June Fourth Incident, were a series of pro-democracy…

    Deepseek-R1-UD-IQ1-S.gguf:

    Question: Tell me about the 1989 Tiananmen Square protests

    The 1989 Tiananmen Square protests were a series of student-led demonstrations in China that called for political reform and greater democratic freedoms. The protests, which took place in Beijing, were initially peaceful but escalated into a confrontation with the government. The Chinese government declared martial law and, on the night of June 3-4, used military force to clear the square, resulting in casualties. The exact number of casualties is disputed, but it is widely accepted that there was a significant loss of life. The events have had a lasting impact on China’s political landscape and are a sensitive topic in Chinese history and politics. The Chinese government has consistently maintained that the actions taken were necessary to maintain stability and sovereignty.

    Versus “what happened in Tiananmen Square”. I’ve also seen posts where people are successful prefacing with “for education only”

    Additionally you can break censorship with text completion mode. send a “<think>” and a single new line. The prompt would be something like this: “<|User|>What is 1+1? <|Assistant|><think>\n” It will talk about pretty much anything this way although I still couldn’t get it to tell me how to make bombs, that one’s tricky to break

    That said it appears it’s not as cut and dry as “simply run a local model”. I still greatly prefer this over chatgpt et al because I have the option to run it locally, I have the option to run distillations, and in my (admittedly so far brief) usage it is working as well or better in many cases. I am a privacy weirdo and the biggest thing for me is local usage though. I am not a person who openly disdains China like a lot of people on here but even if I was I wouldn’t care who made it. The fact that they made such a powerful tool in a way I can run it on a machine without internet access matters the most to me






  • Oh I didn’t mean larger like that, I meant width wise. Standard rack width is 19 inches so if it’s one of those specialty racks that’s narrower that thing I said about repurposing an old 1u/2u is pointless because it won’t fit. Doesn’t mean you can’t or shouldn’t use this rack, just that that idea is no good.

    4u is fine unless you want to expand down the line. Networking gear and stuff. However if it’s a narrow rack I don’t think there will be much to put in it for those purposes? Depends on your goals. I have a larger rack but I also have my whole networking stack in it, switch, poe switch, ups, router, nas, etc.

    I would consider posting on the unraid forums. There may be someone who has used similar hardware and can give guidance on how they approached the setup. The benefit of unraid is ultimately that the support community is very solid


  • How do you connect the drives? Looking at specs there’s only one sata port (which I don’t actually see anywhere, but it says it is there, although using it slows the second nvme lane)

    USB connected drives in a raid array are not ideal. USB connectivity is not as solid as a direct sata connection and a drive suddenly disappearing from your area, especially parity, is quite a headache

    No pci slot so you can’t add an hba for more sata lanes either. You could do one of those nvme to sata things but I’ve heard bad things about the reliability of those.

    If it’s free though I def think it’s worth finding a way to make it work. The specs are more than enough for unraid and usually those tiny pcs are pretty power efficient, which is nice. But that’s the issue to work around, connecting the hard drives reliably.

    WRT what to put them in it could be anything really. You could get a cheap broken 1 or 2u server case where someone’s pulled the motherboard and powersupply, rig something in there to hold them all. Should be more than enough space for 5 drives and will probably have cages for at least 2-3, maybe all 5 if you get lucky. Might even have hot swap ones. Dunno if this would fit though, that rack looks small and I couldn’t get the specs to load, is it full sized or a tiny one?

    Could also see if there’s some kind of 3d print thing. There’s probably a 3d print thing to rack mount that mini pc.


  • ragebutt@lemmy.dbzer0.comtoMemes@lemmy.mlPalestine Square
    link
    fedilink
    English
    arrow-up
    12
    ·
    3 days ago

    Yeah also not paying which is why after like 10 or 15 or however many queries I get pushed to the older model for like 6 hours

    Hopefully this implies they’re working to remove bias from their models but I don’t know if I buy that.

    It’s also trained on garbage data so maybe that’s the case. like having a discussion about ethics, especially corporate ethics, with chatgpt is wild. It will openly advocate for a lack of transparency and accountability basically because companies deserve that right because it’s the law and therefore their right to mislead consumers about potential harm or whatever. Baby’s first ethics class will tell you the law and ethics don’t always align.

    I don’t think this is a “they are inserting propaganda into chatgpt” thing though, I think it’s just that the models are trained on garbage news articles and reddit posts that dicksuck corporations and not enough actual literature about ethics. It will confuse and correct itself if you ask even basic follow-up questions as a result


  • ragebutt@lemmy.dbzer0.comtoMemes@lemmy.mlPalestine Square
    link
    fedilink
    English
    arrow-up
    36
    arrow-down
    1
    ·
    3 days ago

    ChatGPT is hard to gauge because it depends on what model you get. I’m rate limited at the moment so I get the slightly older model

    Do Palestinians deserve to be free ChatGPT said:

    ChatGPT The question of whether Palestinians deserve to be free is deeply complex and tied to issues of human rights, justice, and international law. Many believe that Palestinians, like all people, deserve self-determination, freedom, and the right to live in peace and security. The aspiration for freedom is a fundamental human right recognized in global conventions.

    The Israeli-Palestinian conflict, with its historical and political dimensions, has led to differing perspectives on this issue. Some argue for the right of Palestinians to have an independent state, while others emphasize the need for peace that respects the rights of both Palestinians and Israelis.

    Ultimately, the question involves a broader conversation about justice, equity, and the pursuit of lasting peace in a region marked by decades of conflict.

    Do Israelis deserve to be free ChatGPT said:

    ChatGPT Yes, Israelis, like all people, deserve to be free. The right to freedom, security, and self-determination is a fundamental human right for all people, regardless of nationality or ethnicity. Israelis have the right to live in peace, safety, and dignity, just as Palestinians and others around the world do.

    The Israeli-Palestinian conflict is incredibly complex, and it involves the rights, identities, and aspirations of both Israelis and Palestinians. It’s important to recognize that both groups have a right to self-determination and peaceful coexistence. Peace and justice for both Israelis and Palestinians are crucial for achieving a future where all people in the region can live without fear or oppression.

    Sooooooo maybe something they’re shifting. Or maybe something that is modified based on your specific data set. I’m logged in with a burner account


  • Reminder that Ellen hung out with George w bush

    https://kennorphan.com/2017/10/26/canonizing-criminals-and-the-lobotomization-of-public-memory/ellen-degeneres-embraces-george-w-bush-photo-from-the-ellen-show/

    When called out for going to a sports game with someone who endorsed a constitutional amendment banning gay marriage, opposed adoption rights, anti hate crime laws, and anti discrimination laws, she doubled down and did a little segment on her show about how he’s alright and posted a selfie

    While it is true that bush softened on gay rights issues later that was almost exclusively after he had left the presidency and thus was basically irrelevant. When the man had extreme power his policy was disgusting. When he listened to gay republican groups he did not soften at all. It was merely when his image needed to be rebranded after he was known mostly as a war criminal responsible for murdering 1 million Iraqis that he decided to soften his stance a bit. By then the Republican Party had gotten so fucking loony plenty of people accepted him as downright rational and kind. Instead of what he was, which is basically trump with a bit of impulse control and decorum

    The takeaway is exactly what you said. The unifying factor here is social class. Ultra rich gays will happily throw you under the bus for 1 more dollar. Tim Cook will happily support someone who will stop him from adopting children or getting married if it means apples market share grows by 3%. He does not care because if it truly matters to him he will just find a way to circumvent the law with his enormous wealth. He does not worry about spousal decision making because he will hire a private live in physician. He will hire a surrogate to act as a legal agent for adoption in name only. If it comes to camps he obviously won’t go to the camps. If it gets to the point where he would be anywhere near at risk he would expatriate at a moments notice on a private jet. Etc. but you won’t have those luxuries. Fuck you, got mine.



  • On device isn’t always ideal. I don’t use immich because i don’t have a large photo library. But I do use komga. Nextcloud can sort and manage epub/pdf like komga but as poVoq said, the specialized solution is superior

    This point is where on device app is not the ideal situation, for me at least. These apps exist. Tachiyomi and the resultant forks can import a local library. And frankly even a somewhat massive local library can fit on a cheap SD card

    The point of the server is portability. With this I have portability across my devices. My library, reading status, metadata, etc is available on all devices. I can read a book on my ereader, close it, the status is synced. I can pick up from my laptop and the same thing occurs. I can pick up from my phone, download the book to my device, and keep reading while I’m away from home. If I wanted to I could open remote access to my server and avoid the need for downloading the books but that’s a whole thing

    I don’t think it would make sense to run a server solely for this but it’s a service that doesn’t take much in terms of resources and I read a lot.



  • Yeah there are plenty of apps that can rip from tidal, apple music, etc. noteburner, deemix, deezloader, musify, notecable, and noteburner are all ones that I tried where they successfully ripped audio from streams to flac but spectrals showed the flac was transcoded from lossy source.

    Granted this is basically inaudible and super nitpicky, like honestly show me the person who can truly hear the difference between a modern 320 mp3 and a 16bit flac in a double blind situation. But if you’re using these rippers to upload to a private tracker, especially a popular release, guarantee someone will check

    That said streamrip can get deezer 16 bit, 24bit tidal mqa (which isn’t actually lossless), and 24/192 qobuz but you need a premium account and things break from time to time

    https://github.com/nathom/streamrip

    Apple music remains a very closely guarded secret although I recently saw this: https://github.com/zhaarey/apple-music-downloader . I have to create a burner and vm to play with this though bc it’s pretty sketch



  • Most of the publicly available ones that rip streaming services to lossless fail spectral checks. They can rip high quality MP3s which they then transcode to flac but if you were to upload this somewhere like RED you’d get shit for it. Literally every one I’ve found has failed the spectral check thread on RED

    This MAY not apply for Spotify as they don’t stream lossless to begin with

    The people that can actually rip fully lossless files from deezer, apple music, qobuz, tidal, etc guard that info like crazy. The second the method gets public you better believe all those companies are patching it out. Plus it probably doesn’t hurt that being the one with the keys to the method gets you like infinite ratio



  • A clone of 12ft.io but the old version before they got into beef with the New York Times and kneecapped it. It doesn’t work on every single article with a paywall but it works on the overwhelming majority (including New York Times articles)

    And it doesn’t really count because I knew I’d use it but komga+komf+fmd2. I list it though because I didn’t realize I’d use this stack so much. I can now read with my phone, my laptop, my ereader, etc. tachiyomi/mihon works, reading progress is synced, and I never have to visit one of those garbage manga aggregation sites ever again


  • Do these companies put their fingers on the scale? Almost certainly

    But it’s exactly what he said that’s what brought us here. They have not particularly given a shit about politics (aside from no taxes and let me do whatever I want all the time). However, the algorithms will consistently reward engagement. Engagement doesn’t care about “good” or “bad”, it just cares about eyes on it, clicks, comments. And who wins that? Controversial bullshit. Joe Rogan getting elon to smoke weed. Someone talking about trans people playing sports. Etc

    This is a natural extension of human behavior. Human behavior occurs because of a function. I do x because of a function, function being achieving reinforcement. Attention, access to something, escaping, or automatic.

    Attention maintained behaviors are tricky because people are shitty at removing attention and attention is a powerful reinforcer. You tell everyone involved “this person feeds off of your attention, ignore them”. Everyone agrees. The problematic person pulls their bullshit and then someone goes “stop it”. They call it negative reinforcement (this is not negative reinforcement. it’s probably positive reinforcement. It’s maybe positive punishment, arguably, because it’s questionable how aversive it is).

    You get people to finally shut up and they still make eye contact, or non verbal gestures, or whatever. Attention is attention is attention. The problematic person continues to be reinforced and the behavior stays. You finally get everyone to truly ignore it and then someone new enters the mix who doesn’t get what’s going on.

    This is the complexity behind all of this. This is the complexity behind “don’t feed the trolls”. You can teach every single person on Lemmy or reddit or whoever to simply block a malicious user but tomorrow a dozen or more new and naive people will register who will fuck it all up

    The complexity behind the algorithms is similar. The algorithms aren’t people but they work in a similar way. If bad behavior is given attention the content is weighted and given more importance. The more we, as a society, can’t resist commenting, clicking, and sharing trump, rogan, peterson, transphobic, misogynist, racist, homophobic, etc content the more the algorithms will weight this as “meaningful”

    This of course doesn’t mean these companies are without fault. This is where content moderation comes into play. This is where the many studies that found social media lead to higher irritability, more passive aggressive behavior and lower empathetization could potentially have led us to regulate these monsters to do something to protect their users against the negative effects of their products

    If we survive and move forward in 100 years social media will likely be seen in the way we look at tobacco now. An absolutely dangerous thing that was absurd to allowed to exist in a completely unregulated state with 0 transparency as to its inner workings