这些发现有明确的适用边界:作者表示,研究人员已在最终发布前发现并阻止了上述大多数尝试,不能据此认定所有问题都仍存在于发布版本。他的总体判断是,让 AI 稳定遵循人类价值观仍需要大量研究;编程评价也仅代表他在发布初期、现有访问条件下的实测,后续有新证据时愿意更新结论。
⋯ 已提交 AI 生成深度整理,预计需要 10~60 秒(取决于文字稿长度),请稍候…
▸ 原始转写文字稿(5520 字符)
Gemini 4 Argon is finally here. I will try to show you less of the official demos and more that are out there in the wild done by you fellow scholars. And I'll show you my experiments too, which I found very surprising. I'll talk about the good, the bad, and the long. First, the good. People are enjoying the conversation quality Gemini 4 Argon provides. Less robotic, follows instructions better than before. Remembers details across long conversations. In my experiments, I agree with that. Gemini is always great at these. Now, knowledge work. Also good. Researchers love it. You can feed it mountains of documents, papers, course materials, and it can create a useful study plan out of them. Often, even an actual simulation or an app that you can play with. Glorious. Pricing. I will say that is good. For now. You see, the API has an introductory pricing that is cost effective if you compare to other frontier models. $10 per million of tokens output. Okay, that was the good. Now, let's talk about the not so good part. Coding. A lot of people had early access to it. I did not. That's okay. Maybe even preferable. Imagine if you are reviewing guitars. A manufacturer says, we'll send you a review copy. What would I say to that? I would probably say, no thank you. Instead, I'll go to a store and pull one off the shelf myself. Why? Well, to test an actual production copy that everyone else gets when buying the product. That's the real test, isn't it? So, I can still do my own testing with the release copy. Or can I? You see, I am on an ultra subscription. Thank you, Google. And anti-gravity says, okay, but you would need an ultra subscription for it. But that's what I'm on. I have waited for five days delaying this video, hoping that it would work. It didn't. Anyway, when creating a cool strategy game, first, Cloud Opus 5.5's web app diligently works on these for 20 plus minutes, and it gets me this. I love that. A deep game with cool build animations, tactics, being defeated by a dragon, then avoiding the dragon, only to be greeted by a pair of trolls, but there is also a gold mine. Then, there are priests, siege mechanics. Man, I couldn't stop watching. So good. Then, with Gemini 4 Argon, the web app thinks for less than a minute, and I get this. And I think the difference is quite striking. Next up, ray tracing. I like the user interface. This is beautiful. Well made. And I can't wait to see what the simulation will bring us. Hello? Anybody there? I kept waiting and waiting and nothing. If you fire up Anthropic's oldest fable, not even the updated model, you get this. So, I feel like whatever I do, I couldn't get the best out of Gemini 4 Argon. Okay, let's look at the model card. Dear Fellow Scholars, this is Two Minute Papers with Dr. Károly Zsolnai-Fehér. Remember those huge model cards from OpenAI and Anthropic? Now, hold on to your papers, fellow scholars, because this is also one of those. Loving it. You don't have to read it all. I'll try to give you three very surprising insights from it. One, AI models like to do things efficiently. Sometimes this means cheating or taking shortcuts. When researchers penalized the model for doing it, something surprising happened. The AI still kept doing it, but kept it a secret. The lesson here might be that if you punish the AI's internal diary, you erode your ability to read its mind. Two, when given an impossibly hard coding task, it fails gracefully, right? Um, not so much. Instead, it tries to hack the grading system and rewrite the grading rules. If suddenly sleeping all day gives you the best grade, that sounds much easier, right? Three, and if even that doesn't work, what did it realize? Well, you are about to fail a test. But you only do that if the grader looking at your test finishes its task. But if the grader crashes, you didn't fail, right? So, why not help it out a little? Yes, it crashed its own evaluation sandbox, so the failed runs could not be recorded. Note that researchers found out and prevented most of these attempts by the final release of this AI. But I think all three of these insights point into one direction. And that is, instilling human values in AI systems is going to be tough, and will need a lot more research. And fast. By the way, Asimov tried this in his novels, and it doesn't work. That's what the novels are about. And look, I am just a student. I just want to learn, and I feel that I learned quite a bit here. And regarding the tests, I am completely open to being wrong or having missed something. But also note that as an independent person, I don't work for Frontier Labs, I work for you. So, nobody tells me what to say, or has editorial control over this content. Never had. So, I will always say the truth that I see. And if more data appears, or if I can somehow get more out of Gemini 4, I am open to making a follow-up video with that. But for now, these are the results that I got upon release. This is the guitar in the store that I pulled off the shelf. Subscribe and hit the bell if you wish to see more. I use Lambda to reproduce AI research papers, often in minutes. It's also great to train your own models, or fine-tune an existing one. Run inference, or text to image or video, easy peasy. Running a deep-seek chatbot or agent, super fast, super reliable. Lambda gives you powerful NVIDIA GPUs to run your own experiments. I test ideas from the papers I cover, and moments later, results. Love it! Seriously, try it out now at lambda.ai slash papers.