• 238 Posts
  • 569 Comments
Joined 3 years ago
cake
Cake day: June 11th, 2023

help-circle

  • BookOrbit is doing pretty well for me so far with comics. Seems to have manga options about reverse reading direction.

    Even better for books too. Can do koreader opds and email books as well. (I have a kobo so I haven’t tried the kindle-orientated email, but I assume it’s ez pz)

    Very good metadata ingestion. And the book/comic libraries aren’t in different silo’d worlds like they are with Calibre and its derivatives.

    I’m pretty pleased so far, have found some niggles but nothing bad. And the good stuff plenty outweighs anything else. It’s all ready to go, I switched libraries quickly. And it ate up my old library with its different (not as good) naming style and realigned it automatically, which was nice.



  • I’ve got BookOrbit and Audiobookshelf both going. They both can be hosted securely (locked down compose file with read-only, non-root user, etc.) and use Postgres as their DBs, both key features.

    I added in BookOrbit to try since it has kobo sync and koreader sync that Audiobookshelf lacks.

    I moved books from Audiobookshelf to get BookOrbit going and there was a learning curve to get the UI to do it optimally for me, but I eventually got it to work for me. BookOrbit has the ability to write metadata to the files themselves, which most things lack. Very nice for portability.

    There’s a folder BookOrbit imports from and you can set it to populate metadata automatically - seems strongly built for an automated library system.

    Both have been very stable. I’d say BookOrbit is the better one - and it supports audiobooks too. Audiobookshelf handles multiple libraries (like books and comics) in a clunky way (have to switch between them like they’re completely different silo’d libraries - much like how Calibre handles them). BookOrbit has them separated but easy to see they exist and you can mix and match them in a collection or something. Better way to handle it.

    I use the desktop application Calibre to convert books as needed, but BookOrbit will automatically generate kobo epubs from epubs when syncing so I need not worry about kepub prep.

    Lastly, I chose BookOrbit to try over others because Grimmory needs a ton of RAM, Kavita had features behind a paywall, some other one is comic-focused, and the Calibre web iterations give off the vibe of a lot of tapes the inside to make them work; I had big doubts Calibre Web Auto would be able to be run non-root and read-only. Chose Audiobookshelf originally because of the Calibre mess and other options didn’t exist or were much less established.

    Edit: lore drop: BookOrbit is a feature copy of Booklore but written not in Java (I think JS), and Grimmory is a community fork of Booklore after its creator fell into AI psychosis.


  • So extra background, I was put off by proxmox’s weird steps to get ISO’s onto the system via USB so I was like “I am not touching the backup stuff” and just rolled my own (I treat the VMs/containers on my proxmox server like individual servers and back them up accordingly and do not back up the underlying proxmox instance itself).

    I see proxmox has a similar pruning setting to Restic, and it exports the files like incus. So I’d say yes, proxmox is one-stop-shop for backup while with incus you have to put its container export options and restic together and put that in a cron job.

    Still hard to say what I’d definitively tell a newbie to go with. I found (and still find) the proxmox ui daunting and difficult while the incus UI makes much more sense to me and is easier (has an ISO pulling system built in for instance. But as you’ve pointed out - proxmox gives you an easy way to have robust backups that takes much more effort on the incus side.

    As backups are paramount, proxmox for a total newbie. If someone is familiar with scripting, then incus - because it needs scripted backups to be as robust as proxmox’ backups. @barnaclebill@lemmy.dbzer0.com this conclusion should help you choose proxmox (most likely)!


  • https://linuxcontainers.org/incus/docs/main/howto/instances_backup/#instances-backup-export

    A bit down from the snapshots section is the export section, what I do is I export to a place then back it up with Restic. I do not compress on export and instead do it myself with the —rsyncable flag added to zstd. (Flag applies to gzip too) With the rsyncable flag incremental backups work on the zip file so it’s space efficient despite being compressed. I don’t worry about collating individual zip files, instead I rely on Restic’s built-in versioning to get a specific version of the VM/container if I needed it.

    Also a few of my containers I linked the real file system (big ole data drive) into the container and just snapshot the big ole data drive/send said snapshot using the BTRFS/ZFS methods cause that seemed easier, those containers are easy enough to stand up on a whim and then just need said data hooked up.

    I also restic the sent snapshot since snapshots are write-static and restic can read from it at its leisure. Restic is the final backup orchestrator for all of my data. One restic call == one “restic snapshot” so I call it monolithically with one call covering several data sources.

    Hope that helps!




  • Since you’re not using proxmox as an OS install, why not check out Incus? It accomplishes the same goals as proxmox but is easier to use (for me at least). Make sure you install incus’ web ui, makes it ez pz. Incus does the VMs and containers just like proxmox but isn’t focused on clustering 1st but rather machine 1st. It does do clustering, but the default UI is set for your machine to start so it makes more sense to me. The forums are very useful and questions get answered quickly, and there’s an Ubuntu-only fork called LXD which expands the available pool of answers. (For now, almost all commands are the same between Incus and LXD). I run the incus stable release from the Zabbly package repo, I think the long term release doesn’t have the web ui yet (I could be wrong). Never have had a problem. When Debian 13 hits I’ll switch to whatever is included there and should be set.

    https://linuxcontainers.org/incus/docs/main/installing/#installing-from-package

    I use incus for VMs and LXC containers. I also have Docker on the Debian system. Many types of containers for every purpose!

    I installed incus on a Debian system that I encrypted with LUKS. It unlocks after reboots with a USB drive, basically I use it like a yubikey but you could leave it in so the system always reboots no problem. There’s also a network unlock too but I didn’t try to figure that out. Without USB drive or network, you’ll have to enter the encryption key on every reboot.





  • It’s wild, we’re just completely talking past each other at this point! I don’t think I’ve ever gotten to a point where I’m like “it’s blue” and someone’s like “it’s gold” so clearly. And like I know enough to know what I’m talking about and that I’m not wrong (unis are not getting tons of grants to see “if AI can think”, no one but fart sniffing AI bros would fund that (see OP’s requested source is from an AI company about their own model), research funding goes towards making useful things not if ChatGPT is really going through it like the rest of us), but you are very confident in yourself as well. Your mention of information theory leads me to believe you’ve got a degree in the computer science field. The basis of machine learning is not in computer science but in stats (math). So I won’t change my understanding based on your claims since I don’t think you deeply know the basis just the application. The focus on using the “right words” as a gotchya bolsters that vibe. I know you won’t change your thoughts based on my input, so we’re at the age-old internet stalemate! Anyway, just wanted you to know why I decided not to entertain what you’ve been saying - I’m sure I’m in the same boat from your perspective ;)


  • You can, but the stuff that’s really useful (very competent code completion) needs gigantic context lengths that even rich peeps with $2k GPUs can’t do. And that’s ignoring the training power and hardware costs to get the models.

    Techbros chasing VC funding are pushing LLMs to the physical limit of what humanity can provide power and hardware-wise. Way less hype and letting them come to market organically in 5/10 years would give the LLMs a lot more power efficiency at the current context and depth limits. But that ain’t this timeline, we just got VC money looking to buy nuclear plants and fascists trying to subdue the US for the techbro oligarchs womp womp





  • I was channeling the Interstellar docking computer (“improper contact” in such a sassy voice) ;)

    There is a distinction between data and an action you perform on data (matrix maths, codec algorithm, etc.). It’s literally completely different.

    An audio codec (not a pipeline) is just actually doing math - just like the workings of an LLM. There’s plenty of work to be done after the audio codec decodes the m4a to get to tunes in your ears. Same for an LLM, sandwiching those matrix multiplications that make the magic happen are layers that crunch the prompts and assemble the tokens you see it spit out.

    LLMs can’t think, that’s just the fact of how they work. The problem is that AI companies are happy to describe them in terms that make you think they can think to sell their product! I literally cannot be wrong that LLMs cannot think or reason, there’s no room for debate, it’s settled long ago. AI companies will string the LLMs together and let them chew for a while to try make themselves catch when they’re dropping bullshit. It’s still not thinking and reasoning though. They can be useful tools, but LLMs are just tools not sentient or verging on sentient


  • Improper comparison; an audio file isn’t the basic action on data, it is the data; the audio codec is the basic action on the data

    “An LLM model isn’t really an LLM because it’s just a series of numbers”

    But the action of turning the series of numbers into something of value (audio codec for an audio file, matrix math for an LLM) are actions that can be analyzed

    And clearly matrix multiplication cannot reason any better than an audio codec algorithm. It’s matrix math, it’s cool we love matrix math. Really big matrix math is really cool and makes real sounding stuff. But it’s just matrix math, that’s how we know it can’t think