The coder model has only that one. The ones bigger than that are like 20GB+, and my GPU has 16GB. I’ve only tried two models, but it looked like the size balloons after that, so that may be the biggest models that I can run.
- 6 Posts
- 51 Comments
I got it working with my 6800XT. I’m running deep seek r1 14b (somewhere around there) and the deep seek coder V2. I have a link to a blog with those instructions
https://gotosocial.michaeldileo.org/@mdileo/statuses/01JQA4M4Q33PMCADH9M2AWQSS8
For me federation is working to mastodon, but I don’t think comments are really out yet, but I use cactus comments for it, but that doesn’t federate to mastodon, it federates to matrix. It also requires a matrix server, which was a total pita to set up.
RagingHungryPanda@lemm.eeOPto Selfhosted@lemmy.world•Has anyone gotten up and running with activitypods yet?English1·11 days agooh, I thought that was a mastodon thing or something. Thank you for the clarification :)
RagingHungryPanda@lemm.eeto Selfhosted@lemmy.world•Risks of self-hosting a public-facing forum?English2·11 days agoI have dynamic dns through cloudflare that provides a proxy ip address for me in addition to some protections.
After that I use a reverse proxy to route specific domain names to services. My router is set up to forward only ports 80 and 443 to that reverse proxy, so there’s a good layer of safety there. There could be a weakness on the router, but at this point traffic is pretty limited.
After that, at least for your service, if you can have some control or throttling of signings and be more selective about who you let in, then that could help.
I say do it. Sure there’s risk someone could put something on there you don’t want, but I wouldn’t say it’s big enough to not do it.
RagingHungryPanda@lemm.eeto Selfhosted@lemmy.world•Selfhosted Friendica using Marius' script: database problemsEnglish1·12 days agoDid you ever find a solution? I’m having the same problem. I ensured that my user has wildcard permissions for the host, so it’s granted ALL on
'friendica'@'%'
.
RagingHungryPanda@lemm.eeto Selfhosted@lemmy.world•Help Needed: Homepage Dashboard "Failed to construct 'URL'" ErrorEnglish2·13 days agoTo add on, you can comment in a “binary search” method. Comment out one half of them, if it’s still there, half again, etc and keep going down until you find it.
I’m on mobile and can’t make out any of it, but good luck!
Writefreely is super light weight and minimalist in its design. It also federates with mastodon.
RagingHungryPanda@lemm.eeto Selfhosted@lemmy.world•Advice for a newbie trying to selfhostEnglish5·14 days agoTo add on, your budget here really matters. Ideally, you can have an external NAS or drive enclosure that is managed by the laptop. If you want easy backups, a cloud storage provider can help. I do nightly backups to idrive.
RagingHungryPanda@lemm.eeto Technology@lemmy.world•Deepseek v3 0324: Finally, the Sonnet 3.5 at HomeEnglish1·15 days agoWhat was your input? I’m really curious now
RagingHungryPanda@lemm.eeOPto Selfhosted@lemmy.world•I finally got TruNas running an LLM on my AMD GPU!!!English4·16 days agoThank you! This took so long to figure out
RagingHungryPanda@lemm.eeOPto Selfhosted@lemmy.world•I finally got TruNas running an LLM on my AMD GPU!!!English21·17 days agoBecause it doesn’t feel real 😉
Edit: i thought you referred to TrueNas. I’m tired
RagingHungryPanda@lemm.eeto Selfhosted@lemmy.world•[RESOLVED] Looking for simple self-hosted image editor / resizer appEnglish2·23 days agothat would probably be better as an app, rather than a hosted service.
I run picsur. It’s not an image resizer like that. It’s like Imgur, but self-hosted and can take size arguments as part of the query. I use it to host images for a markdown based blog and keep the sizes under control.
On a side note, I recently started noticing so many sites that use full sized images regardless of the actual size it shows up on screen.
RagingHungryPanda@lemm.eeto Selfhosted@lemmy.world•[Solved] Nextcloud AIO inside container - domain verification failsEnglish1·23 days agoCan you share some screenshots? It sounds like you’re not even reaching the service.
RagingHungryPanda@lemm.eeto Selfhosted@lemmy.world•What's up, selfhosters? It's selfhosting Sunday!English2·27 days agoIt was a huge pita to get it running, but I have it.
One thing about the WA bridge is that element won’t let me give display names or look up the contact number, so the people in chatting with don’t have names, just “their number (WA)”
RagingHungryPanda@lemm.eeto Selfhosted@lemmy.world•What's your Immich setup and backups like? (Advise needed)English2·28 days agoFor backups, I have two drives that are striped and do nightly backups to idrive. I was able to find a containerized version of the console app and I have it run on a schedule from 3-7am.
I use NPM to redirect a domain name to the server with https.
RagingHungryPanda@lemm.eeto Fediverse@lemmy.world•Write.as or Micro.blog or ?? for migration of public profile from big corporate social mediaEnglish9·29 days agoI’m currently using write.as. It’s a pretty bare-bones setup when in single user mode and doesn’t give the kind of list view you might expect for readers - it loads everything onto a single page. I’m considering maybe using Ghost, which is another big name in the federated blogging space. Write.as doesn’t come with comments by default, but I was able to add cactus-comments, but it was a huge PITA because it requires a matrix server.
I do, however, like the minimalist UI aspect of it. You can take a look at mine here. I was also able to get around the list thing by using pinned posts, which stay at the top, so I made an about, a directory, and subscribe pages.
Write.as will post to mastodon under an account that it creates and I have myself on mastodon as a verified owner of the blog site.
is the baby federating?
I haven’t tried those, so not really, but with open web UI, you can download and run anything, just make sure it fits in your vram so it doesn’t run on the CPU. The deep seek one is decent. I find that i like chatgpt 4-o better, but it’s still good.