The company shares the first ‘graphs’ for its next-fen HPC accelerators.
The B100 and GB200 GPUs are not your typical GPU, they do more than regular graphics. These accelerators in data centers now handle complex tasks, especially helping with the development of advanced language models. NVIDIA expects to gain more popularity and plans to capture its fair market share in 2024.
The company says that the B100 GPU will be released next year. The latest information form the Super-Computing 2023 Special Address confirms that Blackwell is indeed set to debut next year, although it wasn’t explicitly confirmed before. It’s important to mention that news about Blackwell HPC doesn’t necessarily mean there will be a gaming version of this architecture. It specifically refers to GB100, the first generation of this architecture.
NAVIDIA says that B100 is going to significantly improve the performance of the GPT-3 model, which has 178 billion parameters. This improvements could be twice or more what the current H200 architecture can do. But it’s important to understand that even though the graph specifically talks about how well it works with Large Language Models (LLM), it doesn’t necessarily mean it has the same amount of computing power, unless there’s a big increase in cores and how efficiently it uses power. That not happened at that level.
Also, NVIDIA states that B100 will have even better memory bandwidth. The new Blackwell chips are expected to keep using this technology, giving them up to 4.8 terabytes per second of bandwidth. The new Blackwell chips are expected to keep using this technology, maybe with more stacks and higher bandwidth. NVIDIA is making sure its design can support future memory technology, like integration HBM3e with GH200 GPUs this year.
NVIDIA hasn’t shared any information about a possible gaming version of the Blackwell architecture. However, there are guesses that we might see a new set of GB20x chips for the RTX 50 series. We don’t know exactly when this will happen. It’s interesting to know that the name “Blackwell” comes from David Harlod Blackwell, an American statistician and mathematician known for his work in game theory, probability, and information theories. We still don’t know what the next version of the Blackwell architecture will be called.
