Close Menu
5gantennas.org5gantennas.org
  • Home
  • 5G
    • 5G Technology
  • 6G
  • AI
  • Data
    • Global 5G
  • Internet
  • WIFI
  • 5G Antennas
  • Legacy

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

4 Best Wi-Fi Mesh Networking Systems in 2024

September 6, 2024

India is on the brink of a new revolution in telecommunications and can lead the world with 6G: Jyotiraditya Scindia

August 29, 2024

Speaker Pelosi slams California AI bill headed to Governor Newsom as ‘ignorant’

August 29, 2024
Facebook X (Twitter) Instagram
Facebook X (Twitter) Instagram
5gantennas.org5gantennas.org
  • Home
  • 5G
    1. 5G Technology
    2. View All

    Deutsche Telekom to operate 12,500 5G antennas over 3.6 GHz band

    August 28, 2024

    URCA Releases Draft “Roadmap” for 5G Rollout in the Bahamas – Eye Witness News

    August 23, 2024

    Smart Launches Smart ZTE Blade A75 5G » YugaTech

    August 22, 2024

    5G Drone Integration Denmark – DRONELIFE

    August 21, 2024

    Hughes praises successful private 5G demo for U.S. Navy

    August 29, 2024

    GSA survey reveals 5G FWA has become “mainstream”

    August 29, 2024

    China Mobile expands 5G Advanced, Chunghwa Telecom enters Europe

    August 29, 2024

    Ateme and ORS Boost 5G Broadcast Capacity with “World’s First Trial of IP-Based Statmux over 5G Broadcast” | TV Tech

    August 29, 2024
  • 6G

    India is on the brink of a new revolution in telecommunications and can lead the world with 6G: Jyotiraditya Scindia

    August 29, 2024

    Vodafonewatch Weekly: Rural 4G, Industrial 5G, 6G Patents | Weekly Briefing

    August 29, 2024

    Southeast Asia steps up efforts to build 6G standards

    August 29, 2024

    Energy efficiency as an inherent attribute of 6G networks

    August 29, 2024

    Finnish working group launches push for 6G technology

    August 28, 2024
  • AI

    Speaker Pelosi slams California AI bill headed to Governor Newsom as ‘ignorant’

    August 29, 2024

    Why Honeywell is betting big on Gen AI

    August 29, 2024

    Ethically questionable or creative genius? How artists are engaging with AI in their work | Art and Design

    August 29, 2024

    “Elon Musk and Trump” arrested for burglary in disturbing AI video

    August 29, 2024

    Nvidia CFO says ‘enterprise AI wave’ has begun and Fortune 100 companies are leading the way

    August 29, 2024
  • Data
    1. Global 5G
    2. View All

    Global 5G Enterprise Market is expected to be valued at USD 34.4 Billion by 2032

    August 12, 2024

    Counterpoint predicts 5G will dominate the smartphone market in early 2024

    August 5, 2024

    Qualcomm’s new chipsets will power affordable 5G smartphones

    July 31, 2024

    Best Super Fast Download Companies — TradingView

    July 31, 2024

    Crypto Markets Rise on Strong US Economic Data

    August 29, 2024

    Microsoft approves construction of third section of Mount Pleasant data center campus

    August 29, 2024

    China has invested $6.1 billion in state-run data center projects over two years, with the “East Data, West Computing” initiative aimed at capitalizing on the country’s untapped land.

    August 29, 2024

    What is the size of the clinical data analysis solutions market?

    August 29, 2024
  • Internet

    NATO believes Russia poses a threat to Western internet and GPS services

    August 29, 2024

    Mpeppe grows fast, building traction among Internet computer owners

    August 29, 2024

    Internet Computer Whale Buys Mpeppe (MPEPE) at 340x ROI

    August 29, 2024

    Long-term internet computer investor adds PEPE rival to holdings

    August 29, 2024

    Biden-Harris Administration Approves Initial Internet for All Proposals in Mississippi and South Dakota

    August 29, 2024
  • WIFI

    4 Best Wi-Fi Mesh Networking Systems in 2024

    September 6, 2024

    Best WiFi deal: Save $200 on the Starlink Standard Kit AX

    August 29, 2024

    Sonos Roam 2 review | Good Housekeeping UK

    August 29, 2024

    Popular WiFi extender that eliminates dead zones in your home costs just $12

    August 29, 2024

    North American WiFi 6 Mesh Router Market Size, Share, Forecast, [2030] – அக்னி செய்திகள்

    August 29, 2024
  • 5G Antennas

    Nokia and Claro bring 5G to Argentina

    August 27, 2024

    Nokia expands FWA portfolio with new 5G devices – SatNews

    July 25, 2024

    Deutsche Telekom to operate 12,150 5G antennas over 3.6 GHz band

    July 24, 2024

    Vodafone and Ericsson develop a compact 5G antenna in Germany

    July 12, 2024

    Vodafone and Ericsson unveil new small antennas to power Germany’s 5G network

    July 11, 2024
  • Legacy
5gantennas.org5gantennas.org
Home»AI»Broadcom AI Computing ASIC with Optical Attachment Details Revealed at Hot Chips 2024
AI

Broadcom AI Computing ASIC with Optical Attachment Details Revealed at Hot Chips 2024

5gantennas.orgBy 5gantennas.orgAugust 27, 2024No Comments5 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
Share
Facebook Twitter LinkedIn Pinterest WhatsApp Email


Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_22
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_22

Broadcom is one of many companies developing custom AI accelerators. So it’s a big deal that the company showed off an AI computing ASIC with optical connectivity at Hot Chips 2024. This was likely done for a customer project. Broadcom makes custom AI accelerators for hyperscalers. The company also showed off co-packaged optics and silicon photonics, which is something we’d like to see.

We’re live on Hot Chips 2024 this week so please excuse any typos.

Broadcom AI Computing ASIC with Optical Attachment Details Revealed at Hot Chips 2024

Co-packaged optics has been a hot topic for a long time.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_02
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_02

One of the big challenges in interconnect and networking is the electrical I/O reach through the PCB. While some designs use cables externally from the switch chip to the optical cage, the end goal still seems to be optics. However, the NVIDIA NVLink NVL72 is a great example of a copper connection rather than an optical connection.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_03
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_03

Silicon photonics enables optical modules with a reduced component count.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_04
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_04

Broadcom now uses silicon photonics and packaged optics not just for switches but also for scale-up computing.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_05
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_05

In case you were wondering, the switch in the photo is a Broadcom Tomahawk 5 Bailly.

Broadcom Tomahawk 5 Bailly Co Package Optical Sample
Broadcom Tomahawk 5 Bailly Co Package Optical Sample

Here’s the schematic for CPO. The key difference between Intel’s old Silicon Photonics and Broadcom is that Broadcom uses pluggable lasers. Lasers fail, so having pluggable lasers allows for better maintainability. Similarly,

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_07
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_07

Broadcom has a version of the CPO (co-packaged optics) component in the Tomahawk 5 slide shown earlier in this presentation.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_08
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_08

The Tomahawk 4 “Humboldt” was a first-generation system.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_10
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_10

This is very similar to Broadcom’s OCP 2022 CPO demo.

Broadcom Packaged Optics Silicon Photonics OCP Summit 2022 5
Broadcom Packaged Optics Silicon Photonics OCP Summit 2022 5

This is the Tomahawk 4 implementation from Silicon Photonics.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_11
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_11

The new version is the Tomahawk 5 Bailly, a 51.2T Ethernet switch in the same class as the Marvell Teralynx 10 51.2T 64-port 800GbE switch we introduced recently.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_12
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_12

In the new version, Broadcom has improved the packaging, resulting in a more stable platform for optical interconnects, as FOWLP is used in mobile chips and more.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_13
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_13

Here are the steps to create a chip with an engine:

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_14
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_14

Here’s a cross-section of the optical engine: Broadcom says this is a more scalable way to manufacture and integrate the optical engine.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_15
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_15

A few months ago, Broadcom pitched Bially the idea of ​​having a 128-port 400G optical module. These optical modules include a light source, so it would have been more accurate for Broadcom to have included the light source.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_16
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_16

According to Broadcom, 800G modules consume 13-15W of power. With CPO and removing DSP complexity etc, this power drops to less than 4.8W.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_17
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_17

One of the key challenges is not only achieving the optical connection but making it work without error.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_18
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_18

Now, Broadcom says it is further optimizing its solution, a step to show vendors that it is on par with the quality they get with traditional pluggable optics.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_19
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_19

In a 51.2T switch, the optical network plug consumes a lot of power. Using co-packaged optics reduces the total power. The result is approximately 30% power savings.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_20
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_20

The next step will be to use similar techniques to combine compute ASICs with co-packaged optics. Here you can see CoWoS with HBM, compute ASIC, and optical chiplets packaged together.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_22
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_22

The GPU Attach looks a bit more advanced than the chips mentioned above, with more HBM and compute tiles, but still, the idea is that you can get 64 links out of the chip and plug them directly into a switch.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_23
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_23

Keeping the optics away from the xPU is also important because it keeps the optical engine away from hot compute. This may not seem like a big deal, but it is important to ensure the optics work reliably.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_24
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_24

Currently we have 64x 100G devices and 2 per 12.8T. What’s insane about this is that the density goes from 12.8T to 102.4T, which is an almost insane amount of bandwidth.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_25
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_25

Broadcom is showcasing its use of bidirectional optical technology for high-radix networks, where transmission and reception occur at different wavelengths.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_27
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_27

This bidirectional optical approach is attractive because it lowers fiber costs.

Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_28
Broadcom AI ASIC Optical Connection Hot Chip 2024_Page_28

There are plenty here.

Final Words

Optical connectivity has to come at some point. Intel announced its Silicon Photonics Connector in 2022, but still uses copper interconnects on its chips, even though it had plans to replace its HBM stack with optical connectivity via Lightbender next year in 2025 (Intel has shut down Lightbender). Broadcom does a lot of optical networking thanks to its networking business, and now ships packaged optical switches. The move to optical I/O will be a big deal for the AI ​​space as companies look to build larger packages.

This was definitely one of the most amazing presentations this year.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Previous ArticleT-Mobile teams up with Singapore’s Transcelestial to bring 5G to Coachella
Next Article ASUS unveils cutting-edge WiFi 7 devices with low-latency cloud gaming support
5gantennas.org
  • Website

Related Posts

Speaker Pelosi slams California AI bill headed to Governor Newsom as ‘ignorant’

August 29, 2024

Why Honeywell is betting big on Gen AI

August 29, 2024

Ethically questionable or creative genius? How artists are engaging with AI in their work | Art and Design

August 29, 2024

Comments are closed.

Latest Posts

4 Best Wi-Fi Mesh Networking Systems in 2024

September 6, 2024

India is on the brink of a new revolution in telecommunications and can lead the world with 6G: Jyotiraditya Scindia

August 29, 2024

Speaker Pelosi slams California AI bill headed to Governor Newsom as ‘ignorant’

August 29, 2024

Crypto Markets Rise on Strong US Economic Data

August 29, 2024
Don't Miss

Apple focuses on 6G for future iPhones

By 5gantennas.orgDecember 11, 2023

iPhone 15 Pro and Pro MaxWith Apple’s recent listing of cellular platform architects to work…

All connectivity technologies will be integrated in the 6G era, says Abhay Karandikar, DST Secretary, ET Telecom

January 31, 2024

5G-Advanced and 6G networks require additional spectrum

January 24, 2024

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

About Us
About Us

Welcome to 5GAntennas.org, your reliable source for comprehensive information on 5G technology, artificial intelligence (AI), and data-related advancements. We are passionate about staying at the forefront of these cutting-edge fields and bringing you the latest insights, trends, and developments.

Facebook X (Twitter) Pinterest YouTube WhatsApp
Our Picks

4 Best Wi-Fi Mesh Networking Systems in 2024

September 6, 2024

India is on the brink of a new revolution in telecommunications and can lead the world with 6G: Jyotiraditya Scindia

August 29, 2024

Speaker Pelosi slams California AI bill headed to Governor Newsom as ‘ignorant’

August 29, 2024
Most Popular

Will 5G make 2024 the most connected year in the industry?

December 1, 2023

The current state of 5G in the US and how it can improve

September 28, 2023

How 5G technology will transform gaming on the go

January 31, 2024
© 2025 5gantennas. Designed by 5gantennas.
  • Home
  • About us
  • Contact us
  • DMCA
  • Privacy Policy
  • About Creator

Type above and press Enter to search. Press Esc to cancel.