Discussion about this post

User's avatar
Miles's avatar

I've realized my fear is not super-intelligent AI, but AI that is 20% worse than the typical knowledge worker and 90% cheaper. This could mean interacting with a ton of crappy AIs because companies will rush to save money with cheap "good enough" AI substitutes.

The economic basis of this fear seems solid, and it is pretty technically feasible already.

Expand full comment
Zhivko Yakimov's avatar

I will not go as far as Acemoglu does, but I share some of his views. My main take is that there are currently unrealistic expectations about what that technology can do, which may lead to its demise. Basically, we may reach a level where the productivity gains of implementing advanced algorithms are simply too low to justify the costs of maintaining and developing the technology.

I feel that software engineers are putting themselves unwillingly in a trap by shooting for the stars, rather than betting on improving productivity first and foremost, i.e. by creating tools that complement humans, rather than attempt to replace them. I also believe labelling advanced algorithms as "AI" is a very bad idea, as it reinforces those expectations among investors, who have far less of an understanding what the technology can and cannot do.

In essence, the current technology is very good in automating predictable tasks, but very poor in improvisation and quick adaption under unforeseen circumstances. It repeats the models we have seen in supercomputers, which can beat humans by sheer brute strength, not through original thought.

Thus, my expectation is that the technology will not be used appropriately, and as a result, it will lead to a lot of wasted money. This will be not because of an inherent flaw, but due to unrealistic expectations on the investor side. It doesn't mean the technology is bad, it just seems that many will use it in an entirely wrong away. I consider 3D cinema a good analogy, as it was expected to turn the way movies are shot on its head, and in the end, it turned out that the benefits are far less than expected initially.

Also, I think it is time we stop calling those advanced algorithms "AI" and then try to come up with some contrived terms for actual AI. There is a great term for what we currently have, coming from a popular sci-fi video game series - Mass Effect. There, they call advanced algorithms "Virtual Intelligence", or simply VI, which is a catchy enough term, by the way. Essentially, ChatGPT is nothing more than an Avina, and certainly not EDI (those who have played the games will get the reference).

Expand full comment
80 more comments...

No posts