I wouldn't recommend trying if you don't like it already. In order for the twist to have any impact the game needs to pretend to be something else and the developer have chosen it to be a visual novel with 0 substance. It would be cute anime girls yapping about nothing in the most non interesting way possible for a couple of hours before anything worth your attention happens. I'm somewhat of an anime slice of life trash enjoyer and even I couldn't force myself to watch a full let's play of this part (even with commentary adding something to latch to) and had to skip a half of it to get to the twist faster. Doesn't worth it.
To be honest, I'm getting tired of a "laptop" in every one of these clickbait titles turning out to be $3000 Macbook. Sure, it's impressive to achieve this degree of the LLM compression, but I really don't like that the title implies local LLM becomes a viable for an average person with the actual hardware being out of reach for 99%.
I enjoy them because I have a reasonably beefy laptop (non-Mac, though, so I can't try out this particular project), and it's nice to see what you can do with laptops in this space.
I think, though, maybe consider your biases? Whenever I see a headline like this, I absolutely don't assume it's going to run on any random laptop. I don't even expect it to run well, or at all, on my laptop (for stuff that isn't Mac-only, that is), which has an iGPU. I'm generally a big LLM/AI skeptic, but I find your brand of cynicism/dismissal to be kinda boring and uninteresting.
You can probably go lower than $3000, I expect, ime, an M1 max with 64GB ram to have similar performance, and you can find such one used with less than $2000 or so probably.
In any case, I do not think that the range of people that have an M1/2/3/4 max macbook is that narrow, eg people who may do video editing or who benefit from having one of the fastest multicore laptops. It is handy to be able to do work with a machine you already may own for separate reasons, though it is definitely more to the side of a "pro device" than "basic consumer device".
I ran full version of this model without any swapping on cluster of 2x $3000 laptops (strix halo zbook 128GB) at about 20 tokens per second.
I would say it is in reach for normal person. If anything buying it was great investment, it is work tool, I will probably sell it for more than what I bought it for :)
..and to think $2=3k is basically a minimum to really use local LLMs effectively, with prices definitely rising globally. Most people will just stick with online services for LLMs.
"Mate, what on Earth is this absolute shithousery."
is either handwritten or Grok! It's definitely a problem that you can get typecast by your own blog. I mean, I kinda quit updating mine around the time my strategy was in rapid flux and the landing page doesn't make sense at all.
Back in 2017-8 I've got a four consequent top ups of an equivalent of $50 each (so a total of $200) from an unknown source. After that I've got a call from a resident cell number saying I've got a $200 fine for watching porn that I laughed off and hung up. I thought it was a scam to make me pay the "fine" with the money I've just got and then call the operator, tell them they "mistakenly" paid for the wrong number (four times for $50, lol) and get the money back. So I sat there and waited for the money to be recalled... but it never happened.
My theory is that it was exactly then I was changing operators while keeping my number, so the scammers tried complaining to the wrong one and failed. Not that I had any objections for the 2 years of free calls and data this got me but this still is a bit of mystery to me.
> The disappearance of these kinds of interactions from day-to-day life – in pubs, restaurants, shops, queues, on public transport – is striking.
> We are losing a basic human skill. The ability to speak to others and understand them is being compromised.
I fail to see how these two ideas are connected. How is my ability to speak and listen to the people I care about—my parrnts, my friends, my spouse and kids—hindered by my unwillingness to talk to a complete stranger in a supermarket line? I don't hate or hold any ill feelings towards them, it's just that I'm more comfortable being to myself and I have only so much capacity to talk and too many people in the city I live in. I would understand if the article was focused on the reluctancy to bond with people in more or less stable groups (at work or at school) but I don't buy the "strangers" argument.
And, to counter the arguments that "the site tells you that you need WebUSB support": you get to the https://e.foundation/installer/ when you click "Check device compatibility" on the main page. Personally, I'd expect either a check that works in any browser or a simple compatible device list. Why would I need a special browser just to check if I can use this OS?
main page -> download and try! -> check device compatibility
lands on https://e.foundation/installer/ the chromium-only webusb page. It could be a better page; instead of showing a scary "navigator not suppored" modal demanding you install a particular browser, it could say the automated compatibility tester requires one of these browsers and your phone plugged in with USB, otherwise here's the device finder page
Do you use single email address on your domain or multiple for different purposes? Or do you have one main address and throwaway aliases for the one-time registration purposes? I see that the Fastmail provides a single inbox that can handle multiple addresses and wonder how does it work.
Haven't had a need for a hardware calculator since the first year in the university, even though I got to the PhD in physics. The calculations are either too hard to do by hand (at work) or too trivial and few to require anything more complex than a basic Android or Windows calculator.
But "enough to not get fired" is not an answer to a question "why should I know anything?". To be honest, it's not clear if the rest of your post tries to answer the initial question of why you should know anything or the implied question of how much should I really know.
The answer to "why should I know anything" is a value judgement that, if advertised in my top-level post, provides a great deal more rhetorical surface to disagree with or criticize. My main point is that regardless of why anyone wants to know anything, in the age of AI, if you want to produce students who actually know things, I recommend dropping the tech and returning to a more rigorous, in-person curriculum with a foundation of memorization.
Here, though, is my answer: an excellent long-term goal for any band of humans is to create, inhabit, and enjoy the greatest civilization possible, and the more each individual human knows about their reality, the easier it is to do that.
reply