{"id":534,"date":"2013-09-28T19:14:04","date_gmt":"2013-09-28T16:14:04","guid":{"rendered":"https:\/\/telcocloudbridge.com\/?p=534"},"modified":"2013-09-28T19:14:04","modified_gmt":"2013-09-28T16:14:04","slug":"what-your-dwdm-vendor-did-not-tell-you-about-latency-for-data-center-interconnect","status":"publish","type":"post","link":"https:\/\/telecomlighthouse.com\/?p=534","title":{"rendered":"What your DWDM vendor did not tell you about latency for your Data Center Interconnect"},"content":{"rendered":"<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/telecomlighthouse.com\/wp-content\/uploads\/2013\/09\/DWDM-latency3.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-full wp-image-760\" alt=\"DWDM latency\" src=\"https:\/\/telecomlighthouse.com\/wp-content\/uploads\/2013\/09\/DWDM-latency3.jpg\" width=\"300\" height=\"164\" \/><\/a>Are you concerned about\u00a0 latency in your data center links running\u00a0 over optical network ?<\/p>\n<p>Or, are you planning for Data Center Interconnectivity in near future and want to know\u00a0 the impact of delays involved. The read on, for some useful tips to know your options.<\/p>\n<p>Chances are, you are already using DWDM to connect <a href=\"https:\/\/telecomlighthouse.com\/blog\/what-is-software-defined-data-center\/\">data centers<\/a> but there are few things that you should be\u00a0aware of as an operator regarding\u00a0the sources of delays in your optical links in order to either mitigate them or at least know how to properly dimension your network for delay. As they say , NOT all DWDM systems are equal when it comes to latency in them so it would help to know what are the choices available when comparing DWDM systems.<\/p>\n<p>In this era of Cloud networks, it would be naive\u00a0to ignore the impact of delay in optical networks that run clouds. Impact of delay for financial markets that do High Frequency Transactions ( HFT) can be considerable\u00a0and far reaching; fraction of millisecond can impact revenue and as per one estimate,these fractional delays can contribute to difference of revenues over the year as high as 100 Million USD.<\/p>\n<p>Lets see, what are these factors that cause delay and what measures can be taken to deal with them. Perhaps your DWDM vendor did not tell them to you, yet.<!--more--><\/p>\n<p>&nbsp;<\/p>\n<h3><strong>1. Fiber Delay<\/strong><\/h3>\n<p>&nbsp;<\/p>\n<p>Delay Impact = 5 micro seconds \/ KM<\/p>\n<p>Speed of light in vacuum is 299,792,458 meters \/ seconds. This equates to 3.33 mirco seconds\/KM. Since optical fiber has different refractive index compared to vacuum therefore\u00a0 latency is more and equals 5 microseconds\/ KM.<\/p>\n<p>So if there is a 100 KM of fiber between two network elements the delay would be 500 micro seconds ( This does not include delay of the network elements themselves)<\/p>\n<p>Not surprisingly, fiber delay\u00a0 is the biggest culprit and contributes to the major delay\u00a0 in optical network\u00a0 and it would impact no matter which DWDM system you use. Long fiber link causes more delay than shorter fiber link.Little\u00a0 can be done to mitigate the latency owing to fiber except selecting shortest route if it is an option.If there are two diversity routes available between two stations, operator is advised\u00a0to use the shortest route as the primary path and use the longer one as secondary or backup path; if\u00a0 new locations for data centers are being planned, the\u00a0 locations can be strategically selected in order to\u00a0have minimum latency owing to fiber itself. While calculating latency coming from fiber, optical lengths should be considered and not geographical length. Operators should have good record of fiber and <a href=\"https:\/\/telecomlighthouse.com\/blog\/what-is-it-that-operators-miss-on-100g-optics\/\">optical distances<\/a> to dimension the delay properly. A good OTDR trace is very handy to know the optical length of the route.<\/p>\n<h4><em><strong>Recommendation:<\/strong><\/em><\/h4>\n<p>wherever possible use shorter distance for connectivity. Avoid using longer routes.<\/p>\n<p>&nbsp;<\/p>\n<h3><strong>2. Transponding\/Muxponding including FEC<\/strong><\/h3>\n<p>&nbsp;<\/p>\n<p>Delay Impact = 10 micro seconds to few hundred micro seconds ( depending on model and make)<\/p>\n<p>Also called &#8220;color conversion&#8221;. There are several processes involved in transponding\/muxponding. Some of them are \u2022Data encapsulation \u2022Forward Error Correction ( FEC) \u2022Performance Monitoring<\/p>\n<p>Of these forward error correction is perhaps the biggest culprit. Delay due to it ranges from 15 to 100 microsecond.<\/p>\n<p>A word about FEC:<\/p>\n<p><a href=\"https:\/\/telecomlighthouse.com\/blog\/need-for-osnr-testers-for-pol-mux-modulations\/\">Low OSNR\u00a0is directly related to poor BER performance<\/a> in DWDM networks. FEC or Forward error connection is a method used to achieve\u00a0coding gain for higher bit rates. It is a method of encoding optical signal with extra error detection and correction overhead bytes enabling optical receivers to detect errors and correct them. Thus FEC can reduce\u00a0BER and effectively increases distances reachable by high speed signals without regeneration.<\/p>\n<p>Forwards Error Correction is a must have feature when going on longer distances ( several hundred kilometers)\u00a0 but it does not bring considerable value at shorted distances ( metro links). There are some models of transponders\/muxponders that can switch off the FEC option . There are other models specially designed without FEC option and optimized for low latency. Some vendors are offering transponders with &#8220;No-FEC&#8221; option for shorter distances that can give ultra low latency of few nano seconds. They claim that they can carry\u00a0 signal in its native form without processing and\u00a0 recommend them for data center connectivity.<\/p>\n<h4><em><strong>Recommendation:<\/strong><\/em><\/h4>\n<p>Whenever possible use\u00a0 latency optimized transponder\/muxponder from your vendor. Check with the vendor if it provides any such model. For green field deployment,do make this a benchmark for evaluating, which vendors to go with by comparing all variants of transponders\/muxponders, the vendors have to offer. Not all vendors provide these kind of variants. If possible, go without FEC for shorter distances.<\/p>\n<p>&nbsp;<\/p>\n<h3><strong>3. Native Optical<\/strong><\/h3>\n<p>&nbsp;<\/p>\n<p>Always remember a simple rule of thumb : The lesser\u00a0 the processing of an optical signal, the better it is for latency. Said in another way, the lower we are in the OSI layers the better it is for latency.<\/p>\n<p>So when it comes to latency<\/p>\n<ul>\n<li>Layer2\u00a0switches perform better than routers<\/li>\n<li>OTN\/ SDH performs better than switches<\/li>\n<li>DWDM performs better than switches ( DWDM is also called L0)<\/li>\n<\/ul>\n<p><strong>Simple<\/strong>: Higher layers have to process overhead at their respective layers that adds to latency.<\/p>\n<p>This does not mean that we start thinking of removing switches and routers. They are not replaceable. However if\u00a0 traffic is already processed at layer 2 or layer 3 at the point of origin and there is no need to do re-processing in the middle of the network , why not pack the traffic in ODU\u00a0( OTN)\u00a0 and transport it to the destination. Better still if one can avoid processing at OTN\u00a0layer, use native DWDM altogether.( <a href=\"https:\/\/telecomlighthouse.com\/blog\/does-p-ots-2-0-address-operators-needs\/\">considering OTN\u00a0also adds overheads<\/a>). Few vendors offer latency optimized short reach transponders without OTN processing.<\/p>\n<h4><em><strong>Recommendation<\/strong> <\/em>:<\/h4>\n<p>Be as close to L0 as possible<\/p>\n<p>&nbsp;<\/p>\n<h3><strong>\u00a0 4. Dispersion Compensation:<\/strong><\/h3>\n<p>&nbsp;<\/p>\n<p>Delay due to DCF\u00a0based Dispersion Compensation Module (DCM) = 5 to 1oo micro seconds<\/p>\n<p>Delay due to Fiber Bragg Grating ( FBG) based DCM = Few nano seconds.<\/p>\n<p>Are you obliged to use dispersion compensation ?<\/p>\n<p>Perhaps you are running 10G\u00a0lambdas, so you are already using some sort of dispersion compensation in your network.<\/p>\n<p>Check for Dispersion compensation modules using Fiber Bragg Gratings. They are the latest type used to compensate for dispersion related issues. There have smaller length compared to the earlier systems using\u00a0 Dispersion compensation Fibers ( DCF). Which were long spools of fiber usually 20% of the length of the fiber it compensates. Delay due to FBG\u00a0is negligible compared to that of DCF.<\/p>\n<h4><strong><em>Recommendation<\/em> :<\/strong><\/h4>\n<p>Try to remain\u00a0DCM free if deploying green field DWDM. If still DCMs\u00a0are needed\u00a0because of 10g\u00a0lambdas, opt for Fiber Bragg DCM to reduce latency<\/p>\n<p>&nbsp;<\/p>\n<h3><strong>Conclusion:<\/strong><\/h3>\n<p>As can be seen there are multiple factors that contribute\u00a0to latency. There might be other components in DWDM network that can cause some latency like amplifiers, WSS\u00a0etc. But the impact of latency due to these factors is not as considerable\u00a0as the factors listed above. A well engineered\u00a0network has to take care of all these factors to reduce latency in networks. Here is a summary of recommendations for low latency data center Interconnect.<\/p>\n<p>a. Optimize fiber routes. Use shortest path for main traffic\u00a0 in order to have low latency.<\/p>\n<p>b. Try to be\u00a0as close to L0 as possible and as native as possible.The best is to use DWDM in order to remove delays caused by the extra overheads at upper layers.<\/p>\n<p>c. Check for latency optimized transponders\/muxponders by vendors that can give delay in the range of nano seconds. Disable FEC if not needed. FEC causes additional delay.<\/p>\n<p>d. User Fiber Bragg based DCMs\u00a0instead of DCFs.<\/p>\n<p>Finally, I would love to hear on what steps you have taken to optimize your data center interconnect.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&nbsp; Are you concerned about\u00a0 latency in your data center links running\u00a0 over optical network ? Or, are you planning for Data Center Interconnectivity in near future and want to know\u00a0 the impact of delays involved. The read on, for some useful tips to know your options. Chances are, you are already using DWDM to [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":760,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13],"tags":[],"class_list":["post-534","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-transport"],"_links":{"self":[{"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=\/wp\/v2\/posts\/534","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=534"}],"version-history":[{"count":0,"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=\/wp\/v2\/posts\/534\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=\/wp\/v2\/media\/760"}],"wp:attachment":[{"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=534"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=534"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/telecomlighthouse.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=534"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}