The Onug Blog
Enterprise Cloud 2.0 Technology Solutions, Strategy and Use Cases
Subscribe
Out-of-band monitoring techniques are necessary for AI clusters to provide trustworthy inferences. Out-of-band solutions provide latency analysis, decrease points of failure, and do not add additional burden on the network. [1] For AI clusters, the result of high latency are erroneous inferences. AI clusters are nodal network of GPUs that store and process inferences from machine learning models. [2] A slow latency for AI clusters inference is enough to produce incorrect inferences. The nodes of an AI cluster can create incomplete calculations on requests due to…
I recently came across an insightful blog by Bruce Davie in The Register that sheds light on the advancements in virtual network automation. While his analysis of virtual networks is insightful, he raises an important question about the state of physical network automation, “Are we actually any closer to the automation of networking than we were a decade ago?” My answer is a definitive ‘Yes’. Back in 2014, when network automation for physical networks was still in its infancy, we faced a steep learning curve….
The expanding domain of Generative AI is quickly becoming a pivotal aspect of enterprise innovation, with an impressive 66% of participants in IDC’s Future Enterprise Resiliency and Spending Survey recognizing its critical role. As this landscape evolves, the management of AI workloads across diverse environments becomes a crucial challenge, with issues such as latency, security, and connectivity at the forefront. In our view, a hybrid and multicloud networking strategy is not merely an option but a necessity for enterprises that leverage AI and operate within…
This is the second in a series of blog posts by the ONUG Collaborative AI-Driven NOC/SOC Automation project team, which is delving into Generative AI (GenAI) use cases for streamlining and automating NOC/SOC workflows. Here we describe several different approaches for adopting GenAI-enabled applications and tools and conclude by considering the benefits and challenges of each approach. AI is playing an increasingly important role in network and security operations. The use of machine learning to analyze and derive actionable intelligence from large volumes of operational…
You can’t escape it: artificial intelligence is defining the current era of technology whether we like it or not. Although AI has been around in various forms for decades (the concept of a neural network model was first proposed in the 1940s!), the transformer model architecture, recent advent of LLMs, and significant advancements in computational hardware have armed us with AI capabilities that have never been seen before. All of a sudden, computers are capable of complicated natural language processing tasks requiring long-range context, allowing…
In the fast-evolving landscape of enterprise computing, the integration and expansion of artificial intelligence (AI) infrastructure stand as pivotal elements for future growth and operational efficiency. Recently, at the AI Networking Summit hosted by ONUG in Dallas in May 2024, a poll of 901 IT and network professionals, who are part of the ONUG Community, provided a snapshot of the current state and trajectory of AI in enterprise compute infrastructure. This blog delves into the findings, revealing the aspirations, challenges, and expectations surrounding AI deployment…
The AI Networking Summit held in Dallas on May 15 and 16, 2024, hosted by FedEx, was a landmark event that brought together thought leaders, industry experts, and AI enthusiasts from around the world. This summit provided an invaluable platform for sharing insights, discussing advancements, and exploring the future of AI technologies. Here are five compelling points from the Dallas Summit that highlight why attending the upcoming AI Networking Summit in New York City on October 23 and 24, 2024, is a must for anyone…
IT Design Patterns Needed – Now More Than Ever Over the past decade, successive waves of technology innovation have resulted in complex IT infrastructure that is problematic to manage and secure. Given the myriad of challenges and the extraordinary level of complexity that IT networking, cloud and security operations professionals are grappling with today, the need for new design patterns has never been more acute. Cutting through all this complexity and converging on innovative, trusted design patterns is no mean feat, but ONUG is uniquely…
The network, at the very heart of the digital transformation, is the catalyst behind the rapid adoption of the cloud and the exponential growth of AI. It’s under immense pressure to meet the ever-increasing demand for scale, agility, and cost-effectiveness. Over the past two decades, we’ve witnessed significant shifts in networking approaches. It’s crucial to understand our past, avoid past mistakes, and build on our successes to navigate the future. The physical networks are the traditional model of connectivity. In this model, an organization procures…
As we broaden the possibilities of our digital world, the blend of artificial intelligence (AI) and automation is carving out new paths in how we manage and fortify networks. This transformative duo holds immense potential to empower teams, revolutionize roles, and navigate challenges with unprecedented efficiency and agility. The recent surge in AI growth has heralded a monumental transformation in network management and monitoring. This surge is not merely a trend but a profound shift in how networks operate, with far-reaching implications for businesses across…
