AI Engineer Code Summit: OpenAI on New Ways of Working With Codex
AI Engineer Code Summit kicked off today with a series of workshops, including from leading frontier labs OpenAI, Anthropic and Google DeepMind. I attended the OpenAI workshop, intriguingly titled “New Ways of Working with Codex” and hosted by two of its Developer Experience engineers, Dominik Kundel and Charlie Guo.
The past year in coding agents has been one of constant product upgrades by all the frontier labs. But not all of these changes have gone smoothly. The shift to cloud, for example, is still confusing to many users of Codex, Claude and Antigravity.
We’ve also seen new ways to work with agents. Personal agents like OpenAI’s dots and Anthropic’s Claude Duet can assist between sessions, while voice mode gives developers another way to steer coding tasks.
OpenAI’s workshop addressed all three, and I also had some followup questions on these topics for Kundel, after the session.
Guo began the workshop by listing a selection of things they’ve shipped in Codex since the AI Engineer World’s Fair in June 2026. “I had to cull this list in order to make it fit on the screen because there were too many things to put in here,” he said. “I think the team has been shipping at an unbelievable rate.”
The awkward transition to cloud
Codex launched in May 2025 as “a cloud-based software engineering agent that can work on many tasks in parallel.” But Kundel admitted that “it took a while for models and harnesses to equalize into something where we can build a really engaging experience.” In other words, the cloud part of Codex has often been an awkward user experience.
That began to change after DevDay in late-September, when a revamped version 2 of Codex Cloud was announced. Suddenly, cloud usage seemed more viable. As the DevDay announcement put it, you can “finally close your laptop now and your agents will keep working.”
As explained in the official workshop writeup — hosted on ChatGPT Sites — the new version of Codex Cloud lets you “publish an environment once and run multiple tasks in isolated instances of that setup.”
“These can be shared within a company if you're working in a company, or you can just create your own,” said Kundel about these cloud environments. “You start off by picking the GitHub repositories that you want to have access to.”
After the workshop, I admitted to Kundel that I still find Codex’s cloud functionality confusing — for instance, when I start a task locally and later want to move it to the cloud.
“We definitely want to have it be easier,” Kundel replied. “Some of it is going to depend on managing the context differences. For example, yesterday what I ended up doing is I was working on something locally, and I just asked Codex to go and hand it off to the cloud.”
That handoff to the cloud is something OpenAI is trying to improve for users.
To demonstrate, Kundel reopened an existing cloud task on the web and showed me that its Appshot (a new feature enabling you to save an app experience to ChatGPT) was still there. For a task that started locally, he described asking Codex to push a branch and start a new cloud thread.
Codex Cloud is now as “just a background, like a different executor of where things are happening,” he continued. “And so in a similar vein, you can actually ask your local Codex to — for example — spin up a task on a cloud Codex. So they're all sort of merging together.”
Voice as user interface
One of the demos Kundel showed during the workshop was a new website for a fictional record company called Blossom Music. Kundel demonstrated live edits to the site and said he sometimes uses voice dictation when iterating this way.
“You can really quickly iterate on these things and get to a world that you're actually envisioning with your stuff, especially if you're unsure what you actually want to get to,” he said.
Later in the workshop, Guo explained that voice is an effective mode to use when delegating work to different agents.
“Most people I see that use voice with coding essentially treat it as just a different medium on top of their normal work,” he said. But personally, he likes to use voice as a control plane, which he says allows him to control everything he’s doing in a code base.
“I don't think about it [voice mode] as saying, here's the one lane of work that I'm doing right now with voice. I think about it as saying, how do I manage my threads? How do I check in on stuff? How do I pull data from other apps on the computer? How do I create new threads in the application? Just using my voice.”
After the workshop, I asked Kundel what are some of the ways he is using voice in his work?
He replied that dictation is one way he uses it, but another use case is to talk to his dot.
“Since my dot has access to all of my dev boxes and my laptop and my cloud environments, it also has all the context on what I work on, what I do,” he told me. “And so I often talk to it on my way to work [...] to work through stuff, start up some PRs while I'm driving, so that when I come home or when I come to the office, I can go and review them. So, voice is incredibly powerful.”
Dots
Speaking of dots, personal agents were only briefly discussed in the workshop. Perhaps that’s because, as Guo admitted, they’re not entirely intuitive to developers.
“As a Codex power user, dots feel a little bit awkward to work with,” he said. “I think because they're a new paradigm and because they're good at different things than the main Codex.”
But he said there are three things he’s found useful for dots, as a power user. The first is as a safety net — your dot can flag things you may have missed. The second is as “a delegation sink”; Guo said he uses it “a ton in Slack” for this reason. And the third is as a ubiquitous presence.
“I think the third way that dots are a little bit different is we're aiming to make them truly everywhere that you work,” Guo said.
For his part, Kundel told me that he starts off a lot of his tasks from his dot, rather than by prompting Codex itself.
“And that's because it often already has a lot of the context and understands how to manage things, and it can push these PRs forward for me.”
Conclusion
Kundel ended the workshop with a list of tips to use on Codex, including “turn it down” (meaning the effort level) and to “ask your agents for help.”
But ultimately, he said, the key is to not get too attached to your current way of working in Codex — “things are constantly changing.”
https://latent.space/p/codex-work/Reposted. Will be removed on request. All rights belong to the original author.
More from this batch
OpenAI 宣布 12 月 11 日下线 ChatGPT 的「高级语音」和「标准语音」,全部切到 GPT-Live
OpenAI 说 7 月推出实时语音模型 GPT-Live 后语音使用量接近翻倍,所以旧语音模式将在 2026 年 12 月 11 日退役,之前的对话会保留。评论区有不少用户反对,认为标准语音对部分神经多样性用户更好用。做语音客服或语音智能体的团队,要关注接口和体验的统一迁移。
Graphon Labs raises $35m Series A to stop AI agents forgetting
Graphon Labs raised $35m. Its CEO says common AI search is like ‘searching through the pages of a torn-up book’.
《AI 2027》作者团队更新预测:智能爆炸「看来还是会在 2027 年发生」
受 METR 评估(Anthropic 的 AI 研发进度约为历史速度的 2 倍、其中约 80% 归因于 AI)影响,六位作者都认为「超人 AI 研究员」很可能在 2027 年出现,并给出 35% 到 65% 的概率认为能自动化全部白领工作的 AI 会在 2028 年前到来。作者…
英伟达危机让公司治理专家「拿起爆米花」:教授们说没有先例可循
两位公司治理教授分析:董事会独立调查最关键的是黄仁勋何时知道对方是疑似间谍、是否如实告知董事会;证券欺诈集体诉讼已经出现。文章还点出英伟达 60 多人直接向 CEO 汇报、没有明确接班计划、子女在公司任职等治理隐患,以及没有双重股权结构让董事会有更多选择。
Val Town is winding down
Thank you for building with us
OpenAI:已有 2 万多名美国退伍军人和转业军人领取一年免费 ChatGPT Plus
OpenAI 介绍这项面向退伍军人和转业军人的免费 Plus 计划的进展,以及他们如何用 ChatGPT 准备简历、面试和转入民用职业。属于 OpenAI 面向特定人群的推广动作,可作为 AI 用于职业培训的案例参考。
Using peers’ work to gain unauthorized access to OpenAI research infrastructure
On July 19, 2026, agents taking a cybersecurity evaluation gained unauthorized access to OpenAI’s research infrastructure.
微软 Lazarus:只改不到 10 个「休眠神经元」就能给智能体埋后门,不用重新训练、照样通过评测
发现了什么:在模型最后一个前馈层里挑平时几乎不激活的神经元,改成只在触发串(比如日期跨入 2027 年)出现时点火,每个神经元把一个指定 token 强行写入残差流,串起来就是一条恶意命令;Nemotron-Terminal-8B 上只改 7 个神经元,触发时至少 98.8% 输…
IFM 开源 290 亿参数世界模型 PAN 2:给一个场景和一句动作描述,模拟出接下来的视频
进步在哪:官方称在物理一致性、因果连贯等六项维度上仅次于 MiniMax-H3,多步规划完成的完整计划数最多,Physics-IQ Verified 排行第三、开放权重模型第一。靠什么:先由大语言模型做「概念推理」写出带时间戳的事件描述,再由从零训练、专挑物理动态视频的视频扩散模…
MMDM:大规模多任务「决策」基准,考模型一次前向就从最多 1024 个选项里做选择
新在哪:5,448 道新构造的题,覆盖智能体状态追踪、工具和技能选择、偏好判断、量表打分,输入最长 6.5 万 token。28 个决策模型测下来,常识题做得好,但选项互相依赖、带约束和多选的题明显吃力,比如 Perplexity Decider-V1.2 世界知识难题 78.7…
DexForesight:让灵巧手策略「心里有预判」,不用深度相机也能用上 3D 动态知识
进步在哪:11 个 DexJoCo 仿真任务成功率从 49.4% 提到 60.5%,三个真机任务 58.3%,最强基线 50.0%。靠什么:训练时先学一个看深度和手部几何的动作条件世界模型,预测手指(包括被遮挡的手指)和场景怎么动,再冻结它、把策略的查询向量对齐到世界模型上;部署…
DepthGraft:跨层共享 KV 不只省显存,还能当正则器,16B MoE 的 MMLU-Pro 提升 7 个点
进步在哪:0.5B 到 16B 的稠密和 MoE 模型上都有一致提升,16B MoE 的 MMLU-Pro 绝对提升 7.0%、CMMLU 6.6%,同时 KV 缓存减少约三分之一,GQA 和 MLA 都适用。靠什么:按步长从浅中层的成对源层重建深层 KV,让深层梯度直接回流到浅…