中
◀ Back to feed
NVIDIA

Speed Up Image Generation with FLUX 3 Image Klein on NVIDIA Blackwell GPUs

Published 2026-11-06 Collected 2026-11-07 08:00 AI news #ai#enterprise
Full text

Speed Up Image Generation with FLUX 3 Image Klein on NVIDIA Blackwell GPUs

Nov 06, 2026 · Olivia Stoner, Yiheng Zhang, Chang Liu, Seonghee Lee and Gunjan Mehta

When deploying diffusion models in design tools, image editors, and visual production workflows, developers must account for inference latency. Generating an image requires multiple sequential passes through a model with billions of parameters, and higher resolutions increase attention costs.

FLUX 3 Image Klein is an image editing and generation model from Black Forest Labs (BFL) trained on NVIDIA GB200 NVL72 and optimized for NVIDIA GPUs. It offers Base and distilled checkpoints for different latency and fidelity requirements.

This tutorial shows how to configure FLUX 3 Image Klein in NVIDIA TensorRT LLM VisualGen with fused kernels, multi-GPU parallelism, FP8/NVFP4 support, caching, and attention optimizations. In reported 2048×2048 tests on a single NVIDIA B200 GPU, combined optimizations delivered up to 3.46x faster text-to-image (T2I) and 4.45x faster image-to-image (I2I) generation for FLUX 3 Image Klein Base compared with uncompiled BF16 inference.

FLUX 3 Image Klein combines Qwen3-VL-4B-Instruct for text conditioning, a diffusion transformer (DiT) to refine image latents, and an autoencoder. On Blackwell, NVFP4 delivered up to 1.62x faster T2I and 1.58x faster I2I than BF16.

Further optimizations include PrimsTS GEMM kernels, VC-Attention FP8 / Sol-Attention sparse attention, Cache-DiT step caching (nearly 1.94x at 2048×2048 for Base), and CFG + Ulysses multi-GPU scaling (eight B200s: Base T2I median latency 14.90→3.00 seconds).

Get started with the TensorRT LLM VisualGen FLUX 3 example and YAML configs for offline inference or /v1/images/generations serving.

Source
Title
Speed Up Image Generation with FLUX 3 Image Klein on NVIDIA Blackwell GPUs
Author
Olivia Stoner et al.
Site
NVIDIA
Published
2026-11-06
Collected
2026-11-07 08:00 · 2026-11-07-08-ai.json
Link
https://developer.nvidia.com/blog/speed-up-image-generation-with-flux-3-image-klein-on-nvidia-blackwell-gpus
Open original ↗

Reposted. Will be removed on request. All rights belong to the original author.

More from this batch

08:00batch · 2026-11-0712 items
>

OpenAI reportedly raises an additional $11 billion at a $1.25 trillion valuation

Bloomberg sources say OpenAI has wired about $11B so far in a round valuing it at $1.25T, potentially totaling ~$20B—well below a prior ~$30…

TechCrunch / Bloomberg
>

中国国安据报策反 AI 高管 Alice Huang,目标刺探黄仁勋与先进芯片情报

The Verge 转纽约时报:MSS 据称招募 Megaspeed 高管 Alice Huang(与黄仁勋无亲属关系)搜集美国 AI 芯片情报,并可能推动先进芯片对华供应。上周已有「刺探黄仁勋」报道,本次新增「已被招募」细节;众议院三委员会要求黄仁勋闭门说明互动。属国家安全舆情…

The Verge / NYT
>

The components of agent memory

Anthropic Engineering explains dreaming: offline passes that correct memory against transcripts, build wiki representations, and promote not…

Anthropic
>

New in Claude Managed Agents: dreaming, outcomes, and multiagent orchestration

Anthropic launches dreaming as a research preview on Managed Agents, plus outcomes rubrics and multiagent orchestration in public beta.

Anthropic / Claude
>

Claude Code 被指把用户邮箱塞进 User-Agent;v2.1.317+ 隐私插件默认拦截(issue 仍开放)

简报汇总 GitHub issue #107757:编码 Agent 向第三方站点发请求时 User-Agent 含邮箱;评论称多段 subagent curl 可复现。贡献者称 cc-plugin-privacy 自 2.1.317 默认开启。对企业:查版本与 /plugins…

Models at Work
>

Agent Plugins 1.0:Amazon、Cursor、Microsoft、OpenAI、Vercel 共同推进的可移植 Agent 扩展标准

开放标准:用 plugin.json + skills/ + mcp.json 打包 Skills 与 MCP,一次构建跨 Codex/Cursor/Copilot/VS Code 等加载。谱系明显借鉴 Claude Code 插件布局;Anthropic 未列联合维护方。对企业…

Vercel / AWS / agent-plugins.org
>

Perplexity now has its own always-on AI agent

Perplexity Teammates are always-on agents on dedicated VMs for ongoing projects, priced on the $200/mo Max plan.

The Decoder
>

Beyond code generation: A developer's guide to agentic engineering

GitHub walks through Plan/Build/Verify/Observe agentic workflows with Copilot as commit volume surges and review latency rises.

GitHub
>

AI Gateway adds DeepSeek Search and Fetch tools

Vercel AI Gateway exposes DeepSeek Search and Fetch as model-agnostic tools billed at $0.75 per 1k successful calls each.

Vercel
>

Chat SDK agents can now stream generative UI with json-render

Chat SDK agents stream typed JSON UI specs via json-render into Slack/Teams native cards.

Vercel
>

Ripple-65B Preview delivers strong agentic coding results as a fully Apache 2.0 open US model

Ricursive Intelligence open-weights Ripple-65B Preview (dense 65B, Apache 2.0) reports leading open-US TerminalBench scores at ~$32M total c…

The Decoder / HF
>

TAC-CoT:工具增强的隐式 CoT——隐式段穿插显式工具调用,准度最高 +8.8、前向最高约 6.8× 更省

改进什么:显式 CoT 贵且易累积错误;纯隐式 CoT 难插工具调用。怎么做:用紧凑连续 thought token 做推理段,只在工具调用/观测/答案处保留文本,并按查询自适应段数。数学与 QA Agent 基准上相对 Explicit-CoT 提准并大减 #Fwd。KAIST…

arXiv / HF