Asking mostly because I have fuckloads of video courses, plus a number of movies, that I have yet to even check if the content is as good as their titles imply and I really feel like I’m mostly hoarding this stuff because I have no fucking clue.
How do you avoid “hoarding”?
Looks at my 28TB storage array that’s 3/4 full…
Time to buy new HDDs.
You’re doing great man, please keep it up i’m not even joking. Maybe someday you’ll be the one guy that still has that old gem everybody lost.
I actually keep a list of works that I’ve shared online that would’ve likely been lost without my intervention. Physical-only Bandcamp releases that I’ve ripped and shared. Sample packs that have been taken down from webstores, etc. The Internet isn’t forever people. Better archive what you can
Yes yes yes ! Keepers of knowledge!
I just watch and delete because I don’t ever really watch anything more than a few times anyways.
The only kind of stuff I’ve ever made backups of is dev software and old keygens because . well - that kind of stuff disappears too easily with the new&shiny fad.
Avoid hoarding? Let’s just say I bring a real “gotta catch em all” energy to the trackers.
My goal is to store everything, that way I have no dependence on remote media
Home datacentre 😋
How do you avoid “hoarding”?
I dont. Hard drives are increasingly cheap/large. I have to really dislike something to delete it. I have a fair amount of content that I don’t really plan on watching again, but someone I know might like it so i just leave it typically.
I have to really dislike something to delete it.
The velma tv show was the last item I just deleted.
But for me this is the same story. I’m up to 400TB… I’m just over half full. I’ve got plenty to go, and if I make to to 75-80% full, then I’m going to get me a 45 or 60 bay server and upgrade from my 36 bay one. 6 of the bays are wasted on SSD caching currently… Just finding a chassis that doesn’t waste the 3.5 inch bays on 2.5 drives would allow me to add a full vdev(another 100TB…).
Old chassis can be had on ebay relatively cheaply.
Do you have an offsite backup? Or do you only backup specifics? Like 10-20% of that?
I do not have full proper offsites… yet.
I run proxmox, so if it’s live on a server it’s probably on my ~70TB (really 40*2TB ssd) ceph cluster. Which makes 3 copies across the 5 boxes, so it’s more like 23TB of usable space for all my vms and such. The 400TB of storage is Truenas is really closer to 300TB after all the losses in raidz vdev and hot spares and what have you, there’s 30x 16TB SAS seagates in the box, of which 2 are hot spares and 7 are parity for raidz1… For things that are slow or linear loads (a movie file could be a good example of that type of workload!). Backups of the the proxmox boxes… and mass stored stuff, 99% of it I could easily obtain again if I had to. Although I’d probably be pretty flustered about it.
Truly important stuff gets written to 100GB bluray(s) (specifically m-disc blurays) and put in the safe. I do this probably about once a year or so…
My dad was in the process of setting up his own cluster that’s running 14TB drives rather than my 16TB… When he’s finally done I intend to requisition probably about half of his space for offsite storage (maybe more). I’m figuring about 100TB of space is what I’ll have there. Maybe more. He’s about 65 miles away from me, different electrical grid and all.
So the count as it stands now. Everything running has at least 2 copies on 2 mediums (ceph cluster, and spinning rust). My “linux iso” repositories only live on the spinning rust storage, but is low priority anyway. Super important highly sensitive shit lives on at least 3 copies and 3 mediums, although one of the mediums may be out of date and none is offsite… Though it’s rare I add to this category. There is plans for adding another copy of data, offsite on harddrive storage for most of my dataset as it is now.
Truenas usages:
And here’s Ceph
Your setup: goals.
Where are you sourcing your hardware? Decommissioned enterprise DC stuff or are there options outside of the enterprise space that enable this type of setup?
I have a lot of ebooks that I download for university research, hobby learning and friends who ask for help sourcing books. I put everything in my calibre library, which is great for metadata management (tip: I have it set so new books that I’ve just imported get a tag of “new”, which I remove when I have processed their metadata. This allows me to chip away at ensuring the metadata is correct and good, even if I don’t do it at time of import).
Anyway, at one point I found myself at risk of becoming overwhelmed by books, because if I’m wanting to learn some category theory, for example, I’d have multiple books that seem to be relevant. Some of them were recommended by programmers, some of them assume a higher level of maths background knowledge, some of them are more fun to read — once upon a time I might’ve known which was which, but if there’s a significant gap between me downloading stuff and using it (which is often the case, I’m quite opportunistic with book recommendations), I may forget. Making a note of why I downloaded a particular book is something I’ve been trying to do more, so I can identify the useful things at the right time — the calibre notes field can work for that, but I’m still figuring out how to manage this in a wider sense because I do a lot of reading and it’s easy to forget why I’m reading a particular thing. I think I have a calibre plugin to show which things I’ve read also.
Another related thing is that I will take a cursory look over a book when I download it, and I may delete it and not put it into my calibre library. This feels significant because downloading a book doesn’t make it one of my books, ‘taking it home’ and putting it away on my ‘bookshelf’ makes it mine. In short, I try to be mindful in my curation activities, recognising that doing it in big clumps with my whole collection doesn’t really work and that pruning little and often helps more.
hey you mentioned category theory, any math community on the fediverse? r/math is sometimes gold but most of the time cringe, because… reddit
Sorry to reply to this so late, I procrastinated because unfortunately my answer is that I don’t know of any communities, perhaps because I’m a scientist who loves maths rather than a mathematician.
However, I will use this opportunity to share some fun stuff from people I like.
https://youtu.be/H0Ek86IH-3Y by Oliver Lugg on Youtube is great. His channel is very eclectic though, and there isn’t much pure maths. I love his shitposting tone though, and he has a discord community that were pretty mathsy when I was in it.
A blog-type site that I enjoy is Tai-Danae Bradley’s https://www.math3ma.com/about, largely because I’ve discovered many other cool researchers through her site.
I also really enjoy Eugenia Cheng’s books, especially as someone who is interested in understanding how to write good scientific communication that is accessible without “dumbing things down”. I recently finished “The Joy of Abstraction”.
Apologies that this isn’t what you actually were looking for. I share your distaste at Reddit: I have used Reddit occasionally for those niche communities that aren’t available elsewhere (yet!), but the atmosphere is increasingly toxic. I fear that smaller communities that flee are congealing in harder to discover places, like Discord.
thank you
Sorry to reply to this so late, I procrastinated because unfortunately my answer is that I don’t know
relatable lool, “I can’t do it rn cuz I still don’t know how to perfectly”
deleted by creator
