Designing Networks for AI: Rethinking Bandwidth, Latency, and Traffic from Core to Edge
AI workloads are fundamentally reshaping network requirements—driving exponential increases in east-west traffic, demanding ultra-low latency for real-time inference, and creating bursty, unpredictable bandwidth patterns across data centers, wide area networks, and the edge. At the same time, enterprises are increasingly running AI across a hybrid landscape: on-prem GPU clusters, workloads hosted in cloud service providers (CSPs), and AI agents operating within SaaS and public AI platforms such as Anthropic. OpenAI, et al.
This shift introduces entirely new network challenges. Traffic is no longer confined to the data center—it spans hybrid and multi-cloud environments, traverses APIs into external AI services, and requires secure, high-performance connectivity between enterprise systems and third-party AI platforms. Latency sensitivity, data gravity, and bandwidth demands now vary dramatically depending on whether workloads are training in the cloud, inferencing at the edge, or interacting with external AI agents.
Roy Chua is founder and principal at AvidThink, an independent research and advisory service formed in 2018 out of SDxCentral’s research arm. Roy was previously co-founder at SDxCentral where he ran both the research and product teams. Roy was formerly a management consultant working with both Fortune 500 and startup technology companies on go-to-market and product consulting. As an early proponent of the software-defined infrastructure movement, Roy is a frequent speaker at events in the telco and cloud space and a regular contributor to leading technology publications. A graduate of UC Berkeley’s electrical engineering and computer science program and MIT’s Sloan School of Business, Roy has 20+ years of experience in telco and enterprise cloud computing, networking and security, including founding several Silicon Valley startups.
Jon Pruskowski is the Director of Cloud Networking within Capital One’s Cloud Platforms organization with responsibilities for global enterprise connectivity and security, intent-driven connectivity automation, and software defined networking. He has over 20 years of experience in technology leadership, solution architecture, and network engineering.
Rajarshi (Raj) has 21+ years of experience driving Pre-Sales, business development, marketing & delivery leading to revenue and profitability growth for companies that he worked for in Enterprises, international telecoms & OTT sector across both mature and emerging markets. He has led multicultural teams and managed customers across the globe.
He has held multiple leadership roles at Tata Communications, across multiple roles and regions enabling growth for the company. These positions ensured leadership of Tata Communications business across three varied business lines, Global Carrier Solutions, Enterprise Solutions and OTTs, achieving revenue and profitability growth annually over my tenure. He was entrusted with launching new service models and developing new markets, while ensuring improved employee engagement scores, well above company benchmarks.
His most recent role is to lead Pre-Sales (Sales Engineers) for Amercia’s market for Tata Communications. In this role, he works with large Enterprise customers on their growth strategy by co-creating, collaborating, and delivering on their innovation road map, with Tata Communications as a strategic partner.
Prior to this role, he led India Pre Sales and prior to that he was Global Head of Product Marketing where he led a global team to convert technical products into stories and brochures which can connect with customers and employees.
CAREER HIGHLIGHTS
He has filed 4 Patents in areas of Drones, RPA and Internet. Won “Shape the Future”- which is a platform for best ideas in Tata Communications. Highest ESAT score 3 years in a row in Tata communications. Leading Project in Botswana to make internet and network affordable in the country. Engaging with clients with Point of View and Thought Leadership rather than point product conversations, resulting in continued leadership position for Tata Communications in the India region.
As Technical Director, Aryo Kresnadi is responsible for setting network architecture strategies, futures and solutions for FedEx Global Enterprise Network supporting all FedEx information movement to ensure on-time delivery for all FedEx packages.
Current responsibility includes research and development of architecture, design and implementation of the next-generation network for FedEx data center, multi-cloud, and edge network for the FedEx field locations to support next-generation sensors, robotics, artificial intelligence and machine learning capabilities.
Aryo holds a Bachelor’s Degree in Electrical Engineering (BSEE) from Ohio State University and a Master of Science degree in Electrical Engineering (MSEE) from University of Pittsburgh. Aryo is currently based in Collierville, TN, the home of FedEx World Technology Center.
