Thread Links Date Links
Thread Prev Thread Next Thread Index Date Prev Date Next Date Index

Re: [802.3_NGECDC] Input Requested for Beyond 400 GbE CFI



Hello John/Chris,

I do agree with Chris general assessment regarding the CFI timeline, in my opinion we have 3 distincts projects and with timeline several years apart that may be included in one CFI.
The three project that I see are:
- 1st project 800G MAC/PCS, 800G-AUI8, DR8, 800G-FR8 needs to be done ASAP because the silicon will be there and the primary application is in support of DWDM access
- 2nd project will be all the 200G/Lamda PMDs and completed end of 2023/2024
- 3rd project 200G/lane electrical and 1.6T MAC, completed end of 2026

If the CFI include all three projects then we need to spun out 3 task forces, and I am not sure what the 200/lane electrical task force will be doing for the next 2 years.  It is better to have 
OIF start the CSR-224G project and chew on it before we start an 802.3 project.

We need to start the 1st project ASAP and I do’t have a big issue to include in the same CFI 200G/Lamda assuming it move into it’s own task force later.  The 200G/Lamda will need extended 
study period, and we will get lots of research and conference type contributions.  Here we need to decipher research vs what can be turned in to standard/product.


Thanks,
Ali Ghiasi
Ghiasi Quantum LLC


On Aug 2, 2020, at 11:54 AM, Chris Cole <chris.cole@xxxxxxxxxxx> wrote:

Hi John
 
I didn’t realize how influential are my comments. Since we are on a roll, below are a few more direction suggestions.
 
  • 200 Gb/s Electrical
As you point out, this is a long term project; it should be on it’s own timeline. OIF started the CEI-224G project. This would be enough if everyone could contribute, but unfortunately OIF contributions are restricted to members. We may need an IEEE project like 802.3bj, which is a great role model.
  • 800 Gb/s Ethernet
We want a quick logic layer definition so that Switch ASIC designers have a spec. PSM8 is probably not enough, so we need WDM8. Since we now have a lot of experience with 100 Gb/s this will be smooth and straightforward. The project won’t be completely boring because we will have a spirited grid debate to pick the exact wavelength set. The project will be on a fast track timeline.  
  • 200 Gb/s Optical
802.3 is not a good place for reporting research results. That’s what technical conferences are for. The 802.3 Study Group format and duration is incompatible with a thorough exploration of 200G approaches. If included, this will drag out the project. Let’s see some solid results at OFC, ECOC, and other conferences, as well as referred journals, before we throw this into the standards process.
100G/lambda MSA is wrapping up; perhaps they could transform into a 200G/lambda MSA and start some spec discussions next year.
An 802.3 200G optical project can be started in about 3 years, just as the 800 Gb/s Ethernet project is finishing.
 
Chris
 
From: jdambrosia@xxxxxxxxx <jdambrosia@xxxxxxxxx> 
Sent: Saturday, August 01, 2020 2:56 PM
To: Chris Cole <chris.cole@xxxxxxxxxxx>; STDS-802-3-NGECDC@xxxxxxxxxxxxxxxxx
Subject: RE: [802.3_NGECDC] Input Requested for Beyond 400 GbE CFI
 
Chris,
My 25 Gb/s optical signaling research was focused by your comment –“…. , i.e. 11 years after the CFI.” 😊 so you will need to share the blame in directing my response.
 
It doesn’t look like we are that much in disagreement.  The big question  is – will 200 Gb/s electrical be part of this effort?  Matt’s timeline approximates a 200 Gb/s std being completed in 2026 / 27 based on his trend line. If this project takes the approximate 5 years – then maybe.  If people want to see it included, then we need material to get added into the deck. 
 
Or we look at spinning out the electrical portion of the project at a later date – if the optics begins to accelerate ahead  of it.
 
And as I often say – great discussion 
And
Good ? 4 a SG
 
John  
 
 
From: Chris Cole <chris.cole@xxxxxxxxxxx> 
Sent: Saturday, August 1, 2020 5:38 PM
To: STDS-802-3-NGECDC@xxxxxxxxxxxxxxxxx
Subject: Re: [802.3_NGECDC] Input Requested for Beyond 400 GbE CFI
 
Hi John,
 
In the 1st part of your email, your research into 25 Gb/s optical signaling in HSSG is too narrowly focused on 2006 HSSG CFI deck. This leads to your unfortunate characterization of my 25G I/O timeline as misleading. In 2006, 40G Gb/s per lane optics had been shipping for several years into Telecom applications from multiple suppliers. This enabled optics suppliers to have confidence in a low risk approach to the first 100G SMF optical interfaces based on 5x20 Gb/s or 4 x 25 Gb/s optical signaling, using de-rated 40 Gb/s optics.
 
In Nov. 2006, during the 2nd HSSG, we showed real measurements for 20G TX eyes and BER waterfall curves using production optics that were similar (C-band changed to O-band) to what shipped in the first 100GbE-LR4 modules several years later.
 
 
I fully agree with you that Cedric, Xiang, and Hong do an excellent job. However, they are unlikely anytime soon to be showing 200Gb/s TX eyes and BER waterfall curve measurements using production grade optics.
 
In the 2nd part of your email, you recover brilliantly by identify the most important historical driver for high volume datacenter optics shipment; matching electrical and optical lane rates. 10G, 40G, and 100G hit 1st million units shortly after the appearance of Switch ASICs with electrical I/O matching optical lane rates.

The next 1st million optics to ship will be 200G with 4x 50G I/O, matching 50G I/O on Switch ASICs, some in OPSF form factor and most in QSFP56 form factor. Hong was one of the earliest to have this insight.
 
You correctly point out that 100G 10:4 Gearbox restricted the initial CFP modules to low-volume high-end applications. Similarly, 400G 8:4 Gearbox restricts the initial modules to modest volumes. 400G will ship the 1st million units when ASICs with 100G I/O ship in volume, mostly in QSFP112 form factor. 
 
I fully agree with your conclusion that 200G per lane optics won’t see high-volume until we see 200 Gb/s I/O on Switch ASICs. Which tells us that any 200G optics we define in this project will have modest volume.
 
Chris
 
From: jdambrosia@xxxxxxxxx <jdambrosia@xxxxxxxxx> 
Sent: Saturday, August 01, 2020 12:32 PM
To: Chris Cole <chris.cole@xxxxxxxxxxx>; STDS-802-3-NGECDC@xxxxxxxxxxxxxxxxx
Subject: Re: [802.3_NGECDC] Input Requested for Beyond 400 GbE CFI
 
Chris,
Thank you for bringing up this topic – it raises a lot of really questions, which requires us to have a frank discussion.
 
First – one of the things many of us have been saying is that the sweet spot for solutions are 1x and 4x lane rates.  This is a very important point.  In the consensus deck I make use of this slide – which I know others have also used some variant of.  
Is there general agreement that 200 Gb/s is the next data rate? (mind you I don’t see baud rate as the modulation discussion is clearly already starting to happen.)  I believe there is general industry agreement and focus on this.
 
Now the next question in my mind is while 1x and 4x are the sweetspots, however, we are seeing 8x packages emerge.  So this is important to consider when we consider how we will address the next rate or rates.  Maybe this project will build off the developing 100 Gb/s electrical interface and that is how 800 will be achieved.  Or maybe the group will decide to do 200 Gb/s per lane and recognize what I said above and decide on 800 and 1.6?
 
<image002.jpg>
 
You made this comment 
We know that 25G I/O based optics shipped the 1st million units in 2017, i.e. 11 years after the CFI.
 
I assume you are referring to the 2006 HSSG CFI - http://www.ieee802.org/3/cfi/0706_1/CFI_01_0706.pdf
 
If you go and look at this presentation and do a search on “25” you will see that there are 8 findings, and none of them are about 25 Gb/s optical signaling. The two optics examples provided were based on 10 Gb/s signaling. The only reference to 25 Gb/s signaling is on page 32 of the file, and this is about electrical signaling.  So the statement you made is a bit misleading, but it also informative in that it suggests it took us 11 years to get to the sweet spot, i.e. optics matched electrical and 4x25 Gb/s, referenced above.
 
I also take this as meaning if we want to minimize the development time to sweet spot time – we need a x4 electrical / optical solution as soon as possible for networking applications.  At this point Cedric, Xiang, and Hong did an excellent job exploring 200 Gb/s lane optics (http://www.ieee802.org/3/ad_hoc/ngrates/public/calls/20_0727/lam_nea_01_200727.pdf).  However, we have very little info on 200 Gb/s SerDes.  Matt has started to look at this (http://www.ieee802.org/3/ad_hoc/ngrates/public/calls/20_0604/brown_nea_01a_200604.pdf) from a historical and high level, but I think we need to get some info on the electrical signaling and the channel.  Given the challenges that .3ck is facing, this is not an issue that I think we should take lightly.
 
Also we need to look at the 200G electrical to 200G optical to make sure that the complexity of the total solution is reasonable.  I remember, as do many, that the 10 to 4 mux that .3ba finalized on, turned out to be harder than originally thought.  
 
So if we are going to have a discussion about timings – it really needs to reference the right efforts.  While 4x25 G optics were finalized in .3ba, the 4x25 electrical interface wasn’t solved until .3bm, which published in 2015.  Looking at our LightCounting #’s I see that things really took off in 2016 as the #’s indicated a huge jump, driven by very large volumes in QSFP28.  So the electrical interface and the form factor were pivotal in the quick rampup – so I don’t think tying it back to the 2006 CFI is completely fair.
 
But it raises the question – how do we get to the sweet spot solution as quickly as possible to minimize churn of solutions that don’t necessarily meet the customers needs  - and what does that mean to the questions that we really need to answer as we look at starting this effort.
 
I hope this is coming off as me trying to frame the problem appropriately.  As one person put it – we are interested in the next economical speed of Ethernet, not just the next speed.  [Those are not necessarily the same thing]
 
With that said – yes we have a lot of technical work in front of us.  But I am sure you, like me and others, remembers .3ba.  There are a lot of debates that we are going to need to have to frame this project properly and to do it effectively.  And I do remember.3ba and can understand the need to start having these discussions sooner rather than later.
 
Thanks for using the reflector to start this discussion.  In today’s COVID world, unfortunately, the ability for us to discuss this informally over refreshments or one of your famous “low-cost” dinners is extremely limited – THINK GENEVA May 2007 😊
 
John
 
PS to all – please feel free to jump in.  There is some meaty discussion here, and we will have limited opportunities for teleconferences if we wish to do a cfi in November.  It is important to identify the key concerns to move this effort along.
 
Anyone with 200 Gb/s serdes info – please feel free to contact me and propose a presentation slot.
 
 
From: Chris Cole <chris.cole@xxxxxxxxxxx> 
Sent: Saturday, August 1, 2020 2:11 PM
To: jdambrosia@xxxxxxxxx; STDS-802-3-NGECDC@xxxxxxxxxxxxxxxxx
Subject: RE: [EXTERNAL]: Re: [802.3_NGECDC] Input Requested for Beyond 400 GbE CFI
 
Hi John,
 
You are exactly right, the question of when 100G I/O based optics will ship the 1st million units is also important, as is the related question of when 50G I/O based optics will ship the 1st million units. We know that 25G I/O based optics shipped the 1st million units in 2017, i.e. 11 years after the CFI.
 
By understanding these milestones, it will tell us whether the objective is initial low volume transport and inter-datacenter links, or high volume intra-datacenter links. This doesn’t make a difference to the logic layer specification, but it makes a huge difference to the physical layer specification and the associated objectives.
 
Chris
 
From: John D'Ambrosia <jdambrosia@xxxxxxxxx> 
Sent: Saturday, August 01, 2020 3:49 AM
To: STDS-802-3-NGECDC@xxxxxxxxxxxxxxxxx
Subject: [EXTERNAL]: Re: [802.3_NGECDC] Input Requested for Beyond 400 GbE CFI
 
Chris,
In the past the question you asked below has been used to justify the next speed, not the justification for the speed in question itself.  So I am trying to understand your question.  It would seem the question you want to ask would be related to 100G, not 200G.
 
Just trying to understand what you are getting at to see if additional data is needed.
 
Thanks
 
John
 
From: Chris Cole <chris.cole@xxxxxxxxxxx> 
Sent: Saturday, August 1, 2020 1:20 AM
To: STDS-802-3-NGECDC@xxxxxxxxxxxxxxxxx
Subject: Re: [802.3_NGECDC] Input Requested for Beyond 400 GbE CFI
 
Hi Cedric
 
When do you think the 1st million optical transceivers with 200G I/O will ship? It can be any configuration; Nx200G, Nx400G, 800G, etc.
 
Chris
 
From: Cedric Lam ( ) <000011675c2a7243-dmarc-request@xxxxxxxxxxxxxxxxx> 
Sent: Friday, July 31, 2020 9:35 AM
To: STDS-802-3-NGECDC@xxxxxxxxxxxxxxxxx
Subject: Re: [802.3_NGECDC] Input Requested for Beyond 400 GbE CFI
 
I can see 1x200G as something useful for server to TOR connections in the future and might be easy to add to the Ethernet family.  I agree with you on the 2x200G.   Also, bear in mind the limited distances that 200G lane can cover and the use cases.  We see it mostly in the intra-DC applications.
--
Cedric F. Lam
Cell: +1 (949) 351-2766
 
 
On Fri, Jul 31, 2020 at 8:05 AM John D'Ambrosia <jdambrosia@xxxxxxxxx> wrote:
All,
I received a question after this week’s NEA meeting that I would like to get some feedback on from others.
The question was –
If 200 Gb/s per lane signaling were developed could efforts to define 200 GbE based on 1x200 Gb/s and 400 GbE based on 2x200 Gb/s be addressed.
I think it is actually a good question and important for me in developing the CFI Consensus deck and defining the SG chartering motion.  As shown by the slide below - 200 Gb/s signaling is applicable to 200 and 400 GbE. 400 Gb/s serial signaling might also be applicable to 400 GbE. 
My own personal opinion is that the whole 1x / 2x lanes would then need to be examined on a PHY basis – as we have seen some instances where 2x lanes don’t see market adoption.
This also raises the question as to whether the study group would define more than one PAR.  Based on the above text – I think there is an opportunity for that or another project that spins out efforts based on consideration of schedule.
So I would some feedback from individuals as it impacts the consensus deck
Thanks in
. John

To unsubscribe from the STDS-802-3-NGECDC list, click the following link: https://listserv.ieee.org/cgi-bin/wa?SUBED1=STDS-802-3-NGECDC&A=1



To unsubscribe from the STDS-802-3-NGECDC list, click the following link: https://listserv.ieee.org/cgi-bin/wa?SUBED1=STDS-802-3-NGECDC&A=1