I run a quantized 70B locally on two used 3090s in my closet (next to the maps server, it's getting crowded in there). It's the same underlying technology trained on the same scraped data, but I downloaded the weights, so ethically it's completely different. Also it's local, so the ocean is fine.
I'm on a green energy plan. The plagiarism is also fine because I prompt it really thoughtfully. Anyway AI is evil. As I was saying to my local model this morning when it helped me write this comment —
No. We must talk about whether it should exist. I have decided it should not, and yet here we are, with me thinking about it every waking hour and posting about it nine times a day.
I've now mentioned AI in 14 unrelated threads today including one about mechanical keyboards. The keyboard is also AI somehow if you think about it. Wake up.
I wrote a 9,000-word Substack on why I'll never touch this. It was my most-read post. The irony that it was recommended by an algorithm is not lost on me, it's just not relevant.