While the article is interesting, it makes assumptions that are not explicitly stated. And the one strong assumption that makes no sense to me is that they discuss team size = 1. Sure, a domain expert now can use an agent. But he might as well work with a development team, or a developer that uses an agent. That's pretty standard I would say.
I had the same instinct. Was about to copy paste it into ChatGPT to summarize. But powered through it. tl;dr: your job as a senior manager is to listen to people
I don't want to sound fatalistic, but in the end, the machine is too powerful to be stopped. With machine I don't mean AI, but rather the financial machine of the US.
If you were buying a computer today to use for DS4 (budget under 10k) what would you get? I care more about inference quality than speed. Or is it better to wait for the rumored M5 studio?
For large contexts, you're probably going to want CUDA. The DGX Spark is expensive but would get you decent speeds on DS4 Flash. DS4 Pro is probably not possible with $10k if you want sub-10 minute prefill.
reply