DataCenter – Digital IT News https://digitalitnews.com IT news, trends and viewpoints for a digital world Wed, 16 Oct 2024 21:12:32 +0000 en-US hourly 1 https://wordpress.org/?v=5.4.16 Axiado’s AI Driven DTM Solution Announced https://digitalitnews.com/axiados-ai-driven-dtm-solution-announced/ Mon, 14 Oct 2024 17:00:59 +0000 https://digitalitnews.com/?p=12416 Axiado Corporation has introduced its Dynamic Thermal Management (DTM) solution, powered by its Trusted Control/Compute Unit (TCU), to improve energy efficiency in AI-driven data centers. By dynamically adjusting cooling based on real-time server workloads, Axiado’s DTM optimizes energy use and enhances performance per watt. This innovative solution not only reduces energy consumption and cooling costs [...]

The post Axiado’s AI Driven DTM Solution Announced appeared first on Digital IT News.

]]>
Axiado Corporation has introduced its Dynamic Thermal Management (DTM) solution, powered by its Trusted Control/Compute Unit (TCU), to improve energy efficiency in AI-driven data centers. By dynamically adjusting cooling based on real-time server workloads, Axiado’s DTM optimizes energy use and enhances performance per watt. This innovative solution not only reduces energy consumption and cooling costs but also supports AI data centers in achieving their carbon-neutral goals through more sustainable and efficient operations.

As data centers become the backbone of AI workloads, they face immense energy demands, particularly in managing thermal output. Cooling systems can account for up to 38% of a data center’s total energy consumption. Traditional systems struggle to adjust cooling needs efficiently, leading to higher costs and energy waste. Axiado’s AI-driven DTM solution solves this challenge by using predictive modeling and real-time performance data to manage server cooling proactively.

“As AI data centers continue to grow in scale and complexity, the need for integrated security and energy efficiency is more critical than ever,” said Gopi Sirineni, President and CEO of Axiado. “Our Dynamic Thermal Management solution, powered by the TCU, not only accelerates cooling efficiency but also strengthens the security foundation of data centers. By combining AI-driven thermal management with hardware-anchored cybersecurity, we are shaping the future of AI infrastructures—making them more secure, sustainable, and cost-effective at every level.”

Axiado’s DTM solution provides a powerful, real-life customer use case demonstrating the advanced capabilities of its TCU technology. The TCU provides the foundation for the DTM solution by embedding AI-driven control at the hardware level. This integration enables precise management of cooling systems, ensuring optimal energy use in real-time based on fluctuating server demands. This approach results in up to a 50% reduction in cooling energy consumption, saving AI data centers millions of dollars annually. For example, in a data center with 100,000 servers, savings can exceed $7 million each year, delivering up to an 11% reduction in CO2 emissions, equivalent to the carbon absorption of more than 834,000 trees.

The DTM solution is well-suited for AI data centers, where fluctuating workloads and high computing power generate significant heat. Axiado’s TCU enables real-time predictive AI modeling, adjusting cooling needs dynamically based on server performance data. This ensures efficient cooling for AI workloads, reducing energy waste while improving overall performance per watt, and cost-efficiency in AI-driven infrastructures.

Key Features and Benefits of Axiado’s Dynamic Thermal Management (DTM) Solution:

  • AI-Driven Cooling Optimization: Uses predictive AI modeling to dynamically adjust cooling systems based on real-time server workload data, ensuring optimal energy use.
  • Energy Savings: Delivers up to a 50% reduction in cooling energy consumption, saving millions in annual operational costs.
  • Environmental Impact: Reduces CO2 emissions by up to 11%, contributing to carbon-neutral data center goals.
  • Proactive Cooling Management: Anticipates server cooling needs in real-time, reducing the need for reactive cooling and improving energy efficiency.
  • Scalable Solution: Suitable for large-scale AI data centers with diverse and elastic workloads, improving overall data center performance.
  • Seamless Integration with TCU: Powered by Axiado’s TCU, combining AI-driven platform security with efficient thermal management.
  • Tested Across Leading Platforms: Successfully implemented and tested on NVIDIA’s MGX platform, Intel’s Granite Rapids, and AMD’s Genoa server systems.

For more detailed insights into Axiado’s TCU-powered solutions and the transformative impact of the Dynamic Thermal Management (DTM) solution on data center energy efficiency and operating costs, visit the website here.

Availability
Axiado’s AX3000 and AX2000 TCUs as well as OCP DC-SCM 2.0 Compliant Axiado SCM3002 and Axiado SCM3003 with DTM capability are available now for purchase.

Related News:

Nortek DCC Expands Cooling Solutions Portfolio to Meet AI Demand

OCP-Compliant Data Center and Telco O-RAN Servers at OCP Global Summit

The post Axiado’s AI Driven DTM Solution Announced appeared first on Digital IT News.

]]>
Nortek DCC Expands Cooling Solutions Portfolio to Meet AI Demand https://digitalitnews.com/nortek-dcc-expands-cooling-solutions-portfolio-to-meet-ai-demand/ Mon, 07 Oct 2024 17:00:23 +0000 https://digitalitnews.com/?p=12323 Nortek Data Center Solutions (Nortek DCC), a subsidiary of Madison Air, reported a record-breaking sales quarter with over a 300% increase in new orders year-to-date. The company also expanded its cooling technology portfolio to help data center hyperscalers and co-locators protect critical infrastructure reliably during the AI-driven data center surge. During a time in which [...]

The post Nortek DCC Expands Cooling Solutions Portfolio to Meet AI Demand appeared first on Digital IT News.

]]>
Nortek Data Center Solutions (Nortek DCC), a subsidiary of Madison Air, reported a record-breaking sales quarter with over a 300% increase in new orders year-to-date. The company also expanded its cooling technology portfolio to help data center hyperscalers and co-locators protect critical infrastructure reliably during the AI-driven data center surge.

During a time in which data center growth is fueling an arms race for equipment, Nortek DCC’s U.S. manufacturing and supply chain redundancies de-risk the ramp-up, with more than 3M square feet of onshore manufacturing capacity, a specialized tiger team of application and hardware engineers who represent the most innovative and solutions-oriented talent in the business, and a world-class service organization that’s integrated into the customer experience starting the minute the order comes in.

With many customers using outdated or retrofitted HVAC equipment, Nortek DCC uniquely offers a data center-optimized portfolio with a range of air, liquid and hybrid cooling solutions and a track record of industry-specific innovation and reliability that goes back decades.

“We are at our best partnering with innovative companies to navigate their most urgent and complex challenges in mission-critical environments,” said Karin Overstreet, President, Nortek DCC. “We have one of the most comprehensive data cooling solutions offerings in the industry. Our products are best-in-class, reliable and efficient. Our service, quality and engineering teams are data center specialists and work together to benefit customers and their needs. There’s a reason our orders are up over 500% year over year: we deliver.”

Expanding Product Portfolio of Data Center Cooling Innovation
Nortek DCC (formerly a division of Nortek Air Solutions) has partnered with leading data center customers globally for over a decade to deliver a mix of liquid and air-cooled technology through a U.S.-based manufacturing supply chain and some of the industry’s best lead times. Building on that product and manufacturing excellence, Nortek DCC is expanding and updating its Coolant Distribution Unit (CDU) and Computer Room Air Handler (CRAH) product lines to meet the growing demand for flexible, modular and energy-efficient cooling operations in a variety of data center applications.

Learn more about the Nortek CDU Cooling Solutions product line, at the website here.

Learn more about the Nortek CRAH Cooling Solutions, at the website here.

Related News:

Data Center Vacancy Rates Falls to 3% in the Americas

Supermicro Introduces its Expanded Portfolio of X14 Systems

The post Nortek DCC Expands Cooling Solutions Portfolio to Meet AI Demand appeared first on Digital IT News.

]]>
Data Center Vacancy Rates Falls to 3% in the Americas https://digitalitnews.com/data-center-vacancy-rates-falls-to-3-in-the-americas/ Thu, 03 Oct 2024 17:00:52 +0000 https://digitalitnews.com/?p=12265 Cushman & Wakefield’s latest research on data center markets reveals that extended power and component lead times are delaying new supply. Vacancy rates in the Americas have dropped to 3%, with over 80% of new deliveries pre-leased in key markets, driving lease rates upward. Demand for artificial intelligence (AI) and cloud data centers surged in [...]

The post Data Center Vacancy Rates Falls to 3% in the Americas appeared first on Digital IT News.

]]>
Cushman & Wakefield’s latest research on data center markets reveals that extended power and component lead times are delaying new supply. Vacancy rates in the Americas have dropped to 3%, with over 80% of new deliveries pre-leased in key markets, driving lease rates upward.

Demand for artificial intelligence (AI) and cloud data centers surged in the first half of 2024, in both established and emerging markets. Absorption is poised to surpass the record levels set in 2023. Power availability remains a critical concern, prompting developers to explore extensive geographic areas for substantial power options within the next two to three years. Despite an expanding supply pipeline, demand continues to outpace supply, resulting in consistently declining vacancy rates across the board.

“Interest in large-scale power availabilities, plentiful land and less strict latency requirements for AI, has driven hyperscalers and operators to expand in a host of historically peripheral markets such as rural Georgia, North Carolina, Pennsylvania, Texas, Minnesota and the Dakotas, among many other outlying areas just beyond the ‘major’ established data center markets,” said Bo Bond, Cushman & Wakefield’s Executive Managing Director. “Active areas of the country are being defined more by the utility provider service area than a more traditional U.S. metropolitan development marketplace.”

Where utility providers have been unable to provide power sooner, certain operators have collaborated with power companies to deliver substations, transmission lines or source micro-grid power. Many of these agreements are now being signed directly with third-party energy generation developers, with wind, solar, battery storage, natural gas and even geothermal developments moving quickly across markets. Going forward, Cushman & Wakefield expects to see more operators continue to acquire large acreage high-power capacity sites in even more rural markets. Additionally, some operators will begin to work to secure power along longer timelines.

“AI data centers are increasingly becoming integral to both hyperscale and colocation development pipelines. Although hyperscalers remain the primary end users in this space, several GPU cloud providers are entering the market, seeking hyperscale-level capacity across the Americas,” said Ali Greenwood, Cushman & Wakefield’s Executive Director.

AI training facility plans primarily focus on large, latency-tolerant locations in rural markets, while AI inference facilities are strategically positioned near major cloud regions. As hyperscale growth accelerates in both established and emerging markets, expect further developments in newly emerging data center markets. This trend will be driven by providers and investors prioritizing power transmission and hyperscaler deployment.

At an overall stock level, Virginia remains far and away the largest data center market in the world, with 13.2GW (combined existing, under construction and committed pipeline), followed by the other primary markets in the space: Atlanta (3.8GW), Phoenix (2.9GW), Chicago (2.4GW), Dallas (2.3GW) and Silicon Valley (1.3GW), which all have seen continued expansion despite varying levels of limitations to power availability.

Portland and Eastern Oregon (1.9GW), and Columbus, Ohio (1.8GW), have quickly risen as comparably large markets driven by both hyperscale self-build and colocation deployments.

To read the full report, including vacancy rates and detailed market intelligence, visit the website here.

The post Data Center Vacancy Rates Falls to 3% in the Americas appeared first on Digital IT News.

]]>
Supermicro Introduces its Expanded Portfolio of X14 Systems https://digitalitnews.com/supermicro-introduces-its-expanded-portfolio-of-x14-systems/ Wed, 25 Sep 2024 17:30:52 +0000 https://digitalitnews.com/?p=12160 Supermicro, Inc. has expanded its X14 portfolio with new high-performance GPU, multi-node, and rackmount systems powered by Intel Xeon 6900 Series Processors with P-Cores (previously codenamed Granite Rapids-AP). This new selection of workload-optimized servers meets the demands of modern data centers, enterprises, and service providers. Alongside the efficiency-focused X14 servers using Xeon 6700 Series Processors [...]

The post Supermicro Introduces its Expanded Portfolio of X14 Systems appeared first on Digital IT News.

]]>
Supermicro, Inc. has expanded its X14 portfolio with new high-performance GPU, multi-node, and rackmount systems powered by Intel Xeon 6900 Series Processors with P-Cores (previously codenamed Granite Rapids-AP). This new selection of workload-optimized servers meets the demands of modern data centers, enterprises, and service providers. Alongside the efficiency-focused X14 servers using Xeon 6700 Series Processors with E-cores launched in June 2024, these additions enhance compute density and power, offering the industry’s most extensive range of optimized servers for various workloads, including AI, HPC, media, virtualization, and energy-efficient edge, scale-out cloud-native, and microservices applications.

“Supermicro X14 systems have been completely re-engineered to support the latest technologies including next-generation CPUs, GPUs, highest bandwidth and lowest latency with MRDIMMs, PCIe 5.0, and EDSFF E1.S and E3.S storage,” said Charles Liang, president and CEO of Supermicro. “Not only can we now offer more than 15 families, but we can also use these designs to create customized solutions with complete rack integration services and our in-house developed liquid cooling solutions.”

Approved customers can obtain early access to complete, full-production systems via Supermicro’s Early Ship Program or for remote testing with Supermicro JumpStart.

These new Supermicro X14 systems feature completely re-designed architectures, including all-new 10U and multi-node form factors that support next-generation GPUs and higher CPU core densities, updated memory slot configurations with 12 memory channels per CPU and new MRDIMMs, which provide up to 37% better memory bandwidth compared to DDR5 DIMMs.

The new Supermicro X14 family comprises a number of new systems —several of which are completely new architectures—in three distinct, workload-specific categories:

  • GPU-optimized platforms designed for pure performance and enhanced thermal capacity to support the latest technology and highest-wattage GPUs. System architectures are built from the ground up for large-scale AI training, LLMs, generative AI, 3D media, and virtualization applications.
  • High compute-density multi-nodes including all-new FlexTwin™, SuperBlade®, and GrandTwin®, which leverage resources such as shared power and cooling to increase efficiency, as well as direct-to-chip liquid cooling on specific models to maximize density without compromising on performance.
  • Market-proven Supermicro Hyper rackmounts combine single or dual socket architectures with flexible I/O and storage configurations in traditional form factors to help enterprises and data centers scale up and out as their workloads evolve.

 

Supermicro’s new max-performance X14 systems support the new Intel Xeon 6900 series processors with P-cores, while X14 efficiency-optimized systems support the Intel Xeon 6700 series processors with E-cores, which launched in June 2024. These systems will also offer socket compatibility with the upcoming Intel Xeon 6900 series processors with E-cores and Intel Xeon 6700 series processors with P-cores in Q1’25 to provide an additional dimension of flexibility when optimizing systems for either performance-per-core or performance-per-watt.

“For the first time, Intel is offering two distinct, workload-optimized families of Xeon processors in the same generation, each designed to deliver specific performance and efficiency profiles that can shorten time-to-results, revolutionize compute, power and rack density, maximizing ROI for modern data centers,” said Ryan Tabrah, VP and GM of Xeon Products at Intel. “With the new additions, Supermicro will be able to provide their customers with even more choice with the introduction of these new performance optimized CPUs for AI and compute-intensive workloads.”

When configured with Intel Xeon 6900 series processors with P-cores, Supermicro systems support new FP16 instructions on the built-in Intel® AMX accelerator to further enhance AI workload performance. These systems include 12 memory channels per CPU with support for both DDR5-6400 and MRDIMMs up to 8800MT/s, CXL 2.0, and feature more extensive support for high-density, industry-standard EDSFF E1.S and E3.S NVMe drives.

Supermicro Liquid Cooling Solutions

Complementing this expanded X14 product portfolio are Supermicro’s rack-scale integration and liquid cooling capabilities. With an industry-leading global manufacturing capacity, extensive rack-scale integration and testing facilities, and a comprehensive suite of management software solutions, Supermicro designs, builds, tests, validates, and delivers complete data center solutions at any scale in a matter of weeks.

Supermicro offers a complete in-house developed liquid cooling solution including cold plates for CPUs, GPUs, memory, Cooling Distribution Units, Cooling Distribution Manifolds, hoses, connectors, and cooling towers. Liquid cooling is easily included in rack-level integrations to increase system efficiency, reduce instances of thermal throttling, and lowers both the TCO and Total Cost to the Environment (TCE) of data center deployments.

New Supermicro max-performance X14 systems featuring Intel Xeon 6900 series processors with P-cores include:

GPU-optimized – The highest performance Supermicro X14 systems designed for large-scale AI training, large language models (LLMs), generative AI and HPC, and supporting eight of the latest-generation SXM5 and SXM6 GPUs. These systems are available in air-cooled or liquid-cooled configurations.

PCIe GPU – Designed for maximum GPU flexibility, supporting up to 10 double-width PCIe 5.0 accelerator cards in a thermally-optimized 5U chassis. These servers are ideal for AI inferencing, media, collaborative design, simulation, cloud gaming, and virtualization workloads.

Intel® Gaudi® 3 AI Accelerators – Supermicro also plans to deliver the industry’s first AI server based on the Intel Gaudi 3 accelerator hosted by Intel Xeon 6 processors. The system is expected to increase efficiency and lower the cost of large-scale AI model training and AI inferencing. The system features eight Intel Gaudi 3 accelerators on an OAM universal baseboard, six integrated OSFP ports for cost-effective scale-out networking, and an open platform designed to use a community-based, open-source software stack, requiring no software licensing costs.

SuperBlade® – Supermicro’s X14 6U high-performance, density-optimized, and energy-efficient SuperBlade maximizes rack density, with up to 100 servers and 200 GPUs per rack. Optimized for AI, HPC, and other compute-intensive workloads, each node features air cooling or direct-to-chip liquid cooling to maximize efficiency and achieve the lowest PUE with the best TCO, as well as connectivity up to four integrated Ethernet switches with 100G uplinks and front I/O supporting a range of flexible networking options up to 400G InfiniBand or 400G Ethernet per node.

FlexTwin™ – The new Supermicro X14 FlexTwin architecture is purpose-built for HPC, cost-efficient, and designed to provide maximum compute power and density in a multi-node configuration with up to 24,576 performance cores in a 48U rack. Optimized for HPC and other compute-intensive workloads, each node features direct-to-chip liquid cooling only to maximize efficiency and reduce instances of CPU thermal throttling, as well as HPC low latency front and rear I/O supporting a range of flexible networking options up to 400G per node.

Hyper – X14 Hyper is Supermicro’s flagship rackmount platform designed to deliver the highest performance for demanding AI, HPC, and enterprise applications, with single or dual socket configurations supporting double-width PCIe GPUs for maximum workload acceleration. Both air cooling and direct-to-chip liquid cooling models are available to facilitate the support of top-bin CPUs without thermal limitations and reduce data center cooling costs while also increasing efficiency.

Also, now shipping are Supermicro’s X14 efficiency-optimized systems featuring Intel Xeon 6700 series processors with E-cores:

SuperBlade® – Supermicro’s high-performance, density-optimized, and energy-efficient multi-node platform optimized for AI, Data Analytics, HPC, Cloud, and Enterprise workloads. Available as a 6U enclosure with 10 or 5 nodes, or an 8U enclosure with 20 or 10 nodes, one rack can feature up to 34,560 Xeon compute cores.

Hyper – Flagship performance rackmount servers designed for scale-out cloud workloads, with storage & I/O flexibility that provides a custom fit for a wide range of application needs.

CloudDC – All-in-one platform for cloud data centers, based on the OCP Data Center Modular Hardware System (DC-MHS) with flexible I/O and storage configurations and dual AIOM slots (PCIe 5.0; OCP 3.0 compliant) for maximum data throughput.

Petascale Storage – Industry-leading all-flash storage density and performance with EDSFF E1.S and E3.S drives, allowing unprecedented capacity and performance in a 1U or 2U chassis.

WIO – Offers flexible I/O configurations in a cost-effective architecture to enable optimization of acceleration, storage, and networking alternatives to accelerate performance, increase efficiency and find the perfect fit for specific enterprise applications.

BigTwin® – 2U 2-Node or 2U 4-Node platform providing superior density, performance, and serviceability with dual processors per node and hot-swappable tool-less design. These systems are ideal for cloud, storage, and media workloads with new models, including E3.S drive support for superior density and throughput.

GrandTwin® – Purpose-built for single-processor performance and memory density, featuring front (cold aisle) hot-swappable nodes and front or rear I/O for easier serviceability. Now available with E1.S drives for better storage density and throughput.

Hyper-E – Delivers the power and flexibility of our flagship Hyper family optimized for deployment in edge environments. Edge-friendly features include a short-depth chassis and front I/O, making Hyper-E suitable for edge data centers and telco cabinets. These short-depth systems support up to 3 high-performance GPU or FPGA cards.

Edge/Telco – High-density processing power in compact form factors optimized for telco cabinet and Edge data center installation. Optional DC power configurations and enhanced operating temperatures up to 55° C (131° F).

To learn more about Supermicro’s new max performance X14 servers, visit the website here.

The post Supermicro Introduces its Expanded Portfolio of X14 Systems appeared first on Digital IT News.

]]>
Seamless Advanced Solutions Becomes 1 of 6 Business Units of Optimus Technology Group https://digitalitnews.com/seamless-advanced-solutions-becomes-1-of-6-business-units-of-optimus-technology-group/ Tue, 10 Sep 2024 17:00:24 +0000 https://digitalitnews.com/?p=11984 Seamless Advanced Solutions has been rebranded as Optimus TechServices and is now officially part of the Optimus Technology Group. This group will offer top-tier solutions through six key business units: Optimus TechServices, Optimus Communications, Optimus Data Centers, Optimus Security, Optimus Power, and Optimus Artificial Intelligence. The formation of Optimus Technology Group enables the company to [...]

The post Seamless Advanced Solutions Becomes 1 of 6 Business Units of Optimus Technology Group appeared first on Digital IT News.

]]>
Seamless Advanced Solutions has been rebranded as Optimus TechServices and is now officially part of the Optimus Technology Group. This group will offer top-tier solutions through six key business units: Optimus TechServices, Optimus Communications, Optimus Data Centers, Optimus Security, Optimus Power, and Optimus Artificial Intelligence. The formation of Optimus Technology Group enables the company to respond swiftly and provide consistent services to its clients. Backed by over 80 years of combined expertise, the group has upheld its commitment to delivering an exceptional client experience since 2017.

“The rapid advancement and adoption of AI are having a profound impact as companies scramble to migrate to more advanced AI-supported technology,” said Sam Tenorio III, president of Optimus Technology Group. “Our rebrand is a strategic decision to pivot from traditional Hardware, SaaS, and Networking services and move toward solutions that allow companies and organizations to embrace AI fully. Unlike other providers, we have the solid financial backing, talent, and relationships to unlock, accelerate, and optimize practical ways that companies and government institutions can effectively outsource their data center ownership with minimal impact on the power grid.”

Based in Austin, Texas, a core focus for Optimus Technology Group will be building and managing flexible colocation facilities with public and private cloud interconnects, with an additional focus on diverse power infrastructure and artificial intelligence. The company’s scalable data center solutions are designed to meet a company’s needs now and as they grow with evolving technology.

“Seamless Advanced Solutions is a genuine business success story, and this is a natural evolution of the business,” said Steven Frank, Head of Communications at Optimus Technology Group. “Optimus Technology Group better represents our goals and ability to accelerate the adoption of AI and data center ownership across the country. Our new focus uniquely positions our team to address the complexities of AI development for corporate, government, and private organizations. I’m confident that the Optimus Technology Group will have a profound impact on the AI and data center landscape and bring new opportunities for our clients across the Americas.”

Optimus Technology Group will also address the demand placed on the national power grid. The company has partnered with one of the largest private owners of U.S. power generation assets to address efficiency and reliability challenges better as the demand for energy accelerates. The company is positioned to be the industry’s premier company and offers a holistic approach to building, powering, and managing data centers nationwide.

“Our current clients won’t experience any downtime or disruption in service with our rebrand and new focus,” said Tenorio. “Our team will continue to deliver critical IT, networking, and security services that will keep their business running smoothly. In fact, our new focus will better prepare our customers to transition from outdated SaaS and networking solutions to more advanced AI-powered applications and data storage.”

More information on the Seamless Advanced Solutions rebrand can be found at the Optimus Technology Group here.

Related News:

Flex CESS Products Features Musashi’s Hybrid SuperCapacitors

The post Seamless Advanced Solutions Becomes 1 of 6 Business Units of Optimus Technology Group appeared first on Digital IT News.

]]>
Intel Showcases AI Architectural Advancements at Hot Chips 2024 https://digitalitnews.com/intel-showcases-ai-architectural-advancements-at-hot-chips-2024/ Tue, 27 Aug 2024 20:30:57 +0000 https://digitalitnews.com/?p=11845 At Hot Chips 2024, Intel highlighted the extensive range and depth of its technologies, demonstrating advancements in AI across various use cases—from data centers, cloud, and networks to the edge and PCs. The presentation also featured the industry’s first fully integrated optical compute interconnect (OCI) chiplet for high-speed AI data processing. Additionally, Intel revealed new [...]

The post Intel Showcases AI Architectural Advancements at Hot Chips 2024 appeared first on Digital IT News.

]]>
At Hot Chips 2024, Intel highlighted the extensive range and depth of its technologies, demonstrating advancements in AI across various use cases—from data centers, cloud, and networks to the edge and PCs. The presentation also featured the industry’s first fully integrated optical compute interconnect (OCI) chiplet for high-speed AI data processing. Additionally, Intel revealed new details about the Intel® Xeon® 6 SoC (code-named Granite Rapids-D), set for release in the first half of 2025.

“Across consumer and enterprise AI usages, Intel continuously delivers the platforms, systems and technologies necessary to redefine what’s possible. As AI workloads intensify, Intel’s broad industry experience enables us to understand what our customers need to drive innovation, creativity and ideal business outcomes. While more performant silicon and increased platform bandwidth are essential, Intel also knows that every workload has unique challenges: A system designed for the data center can no longer simply be repurposed for the edge. With proven expertise in systems architecture across the compute continuum, Intel is well-positioned to power the next generation of AI innovation.”

–Pere Monclus, chief technology officer, Network and Edge Group at Intel
What Intel Presented

At Hot Chips 2024, Intel presented four technical papers highlighting the Intel Xeon 6 SoC, Lunar Lake client processor, Intel® Gaudi® 3 AI accelerator and the OCI chiplet.

Built for the edge: The next-generation Intel Xeon 6 SoC

Praveen Mosur, Intel Fellow and network and edge silicon architect, unveiled new details about the Intel Xeon 6 system-on-chip (SoC) design and how it can address edge-specific use case challenges such as unreliable network connections and limited space and power. Based on knowledge gained from more than 90,0001 edge deployments worldwide, the SoC will be the company’s most edge-optimized processor to date. With the ability to scale from edge devices to edge nodes using a single-system architecture and integrated AI acceleration, enterprises can more easily, efficiently and confidentially manage the full AI workflow from data ingest to inferencing – helping to improve decision making, increase automation and deliver value to their customers.

The Intel Xeon 6 SoC combines the compute chiplet from Intel Xeon 6 processors with an edge-optimized I/O chiplet built on Intel 4 process technology. This enables the SoC to deliver significant improvements in performance, power efficiency and transistor density compared to previous technologies. Additional features include:

  • Up to 32 lanes PCI Express (PCIe) 5.0.
  • Up to 16 lanes Compute Express Link (CXL) 2.0.
  • 2x100G Ethernet.
  • Four and eight memory channels in compatible BGA packages.
  • Edge-specific enhancements, including extended operating temperature ranges and industrial-class reliability, making it ideal for high-performance rugged equipment.

 

Intel Xeon 6 SoC also includes features designed to increase the performance and efficiency of edge and network workloads, including new media acceleration to enhance video transcode and analytics for live OTT, VOD and broadcast media; Intel® Advanced Vector Extensions and Intel® Advanced Matrix Extensions for improved inferencing performance; Intel® QuickAssist Technology for more efficient network and storage performance; Intel® vRAN Boost for reduced power consumption for virtualized RAN; and support for Intel® Tiber™ Edge Platform, which allows users to build, deploy, run, manage, and scale edge and AI solutions on standard hardware with cloud-like simplicity.

Lunar Lake: Powering the next generation of AI PCs

Arik Gihon, lead client CPU SoC architect, discussed the Lunar Lake client processor and how it’s designed to set a new bar for x86 power efficiency while delivering leading core, graphics and client AI performance. New Performance-cores (P-cores) and Efficient-cores (E-cores) deliver amazing performance at up to 40% lower system-on-chip power compared with the previous generation. The new neural processing unit is up to 4x faster, enabling corresponding improvements in generative AI (GenAI) versus the previous generation. Additionally, the new Xe2 graphics processing unit cores improve gaming and graphics performance by 1.5x over the previous generation.

Additional details about Lunar Lake will be shared during the Intel Core Ultra launch event on September 3.

Intel Gaudi 3 AI accelerator: Architected for GenAI training and inference

Roman Kaplan, chief architect of AI accelerators, covered training and deployment of generative AI models requiring extensive compute power. This leads to significant cost and power challenges as systems scale – stretching from single nodes to vast multi-thousand node clusters.

The Intel Gaudi 3 AI accelerator addresses these issues with its optimized architecture affecting compute, memory and networking architectures while employing strategies such as efficient matrix multiplication engines, two-level cache integration and extensive RoCE (RDMA over Converged Ethernet) networking. This allows the Gaudi 3 AI accelerator to achieve significant performance and power efficiencies that enable AI data centers to operate more cost-effectively and sustainably, addressing scalability issues when deploying GenAI workloads.

Information about Gaudi 3 AI accelerators and future Intel Xeon 6 products will be shared during a launch event in September.

4 terabits per second optical compute interconnect chiplet for XPU-to-XPU connectivity

Intel’s Integrated Photonics Solutions (IPS) Group demonstrated the industry’s most advanced and first-ever fully integrated optical compute interconnect chiplet co-packaged with an Intel CPU and running live data.

Saeed Fathololoumi, photonic architect in the Integrated Photonics Solutions Group, covered the OCI chiplet and its design to support 64 channels of 32 gigabits per second (Gbps) data transmission in each direction on up to 100 meters of fiber optics. Fathololoumi also discussed how it’s expected to address AI infrastructure’s growing demands for higher bandwidth, lower power consumption and longer reach. Intel’s OCI chiplet represents a leap forward in high-bandwidth interconnect for future scalability of CPU/GPU cluster connectivity and novel computing architectures, including coherent memory expansion and resource disaggregation in emerging AI infrastructure for data centers and high performance computing (HPC) applications.

Why It Matters

AI provides businesses and consumers an accelerated path to take ideas to unprecedented heights. For example, consumers now have AI PC options that provide intelligent capabilities that elevate productivity, creativity, gaming, entertainment and security, and businesses can leverage the power of edge computing and AI to improve decision making, increase automation and gain value from proprietary data.

The technical deep-dive sessions at Hot Chips 2024 provided unique technical perspectives from across Intel’s product teams that bring next-generation AI technologies to market. To learn more about the  advancements Intel brought to Hot Chips 2024, visit the website here.

Related News:

Intel Manufacturing Facility Technicians Apprenticeship Program Launched

KAYTUS Unmatched AI Performance and Eco-Efficiency with Intel Xeon 6 Processors

The post Intel Showcases AI Architectural Advancements at Hot Chips 2024 appeared first on Digital IT News.

]]>
Data Center AI Systems Capabilities Expanded with AMD’s Acquisition https://digitalitnews.com/data-center-ai-systems-capabilities-expanded-with-amds-acquisition/ Tue, 20 Aug 2024 21:00:58 +0000 https://digitalitnews.com/?p=11783 AMD announced a definitive agreement to acquire ZT Systems, marking a significant advancement in its AI strategy to provide leading AI training and inferencing solutions through innovations in silicon, software, and systems. ZT Systems’ deep expertise in designing and optimizing cloud computing solutions will enable cloud and enterprise customers to rapidly scale AMD-powered AI infrastructure [...]

The post Data Center AI Systems Capabilities Expanded with AMD’s Acquisition appeared first on Digital IT News.

]]>
AMD announced a definitive agreement to acquire ZT Systems, marking a significant advancement in its AI strategy to provide leading AI training and inferencing solutions through innovations in silicon, software, and systems. ZT Systems’ deep expertise in designing and optimizing cloud computing solutions will enable cloud and enterprise customers to rapidly scale AMD-powered AI infrastructure deployments.

“Our acquisition of ZT Systems is the next major step in our long-term AI strategy to deliver leadership training and inferencing solutions that can be rapidly deployed at scale across cloud and enterprise customers,” said AMD Chair and CEO Dr. Lisa Su. “ZT adds world-class systems design and rack-scale solutions expertise that will significantly strengthen our data center AI systems and customer enablement capabilities. This acquisition also builds on the investments we have made to accelerate our AI hardware and software roadmaps. Combining our high-performance Instinct AI accelerator, EPYC CPU, and networking product portfolios with ZT Systems’ industry-leading data center systems expertise will enable AMD to deliver end-to-end data center AI infrastructure at scale with our ecosystem of OEM and ODM partners.”

AMD has agreed to acquire ZT Systems in a cash and stock transaction valued at $4.9 billion, inclusive of a contingent payment of up to $400 million based on certain post-closing milestones. AMD expects the transaction to be accretive on a non-GAAP basis by the end of 2025.

Headquartered in Secaucus, New Jersey, ZT Systems has more than 15 years of experience designing and deploying data center AI compute and storage infrastructure at scale for the largest global cloud companies. ZT Systems’ design, integration, manufacturing and deployment capabilities have made them one of the leading providers of AI training and inference infrastructure.

“We are excited to join AMD and together play an even larger role designing the AI infrastructure that is defining the future of computing,” said Frank Zhang, CEO of ZT Systems. “For almost 30 years we have evolved our business to become a leading provider of critical computing and storage infrastructure for the world’s largest cloud companies. AMD shares our vision for the important role our technology and our people play designing and building the computing infrastructure powering the largest data centers in the world.”

Following transaction close, ZT Systems will join the AMD Data Center Solutions Business Group. ZT CEO Frank Zhang will lead the manufacturing business and ZT President Doug Huang will lead the design and customer enablement teams, both reporting to AMD Executive Vice President and General Manager Forrest Norrod. AMD will seek a strategic partner to acquire ZT Systems’ industry-leading U.S.-based data center infrastructure manufacturing business.

The acquisition of ZT Systems marks the latest in a series of investments by AMD to significantly strengthen the company’s AI capabilities. In the last 12 months, in addition to increasing organic R&D activities, AMD has invested more than $1 billion to expand the AMD AI ecosystem and strengthen the company’s AI software capabilities.

Additional Transaction Details
The transaction has been unanimously approved by the AMD Board of Directors. The acquisition is currently expected to close in the first half of 2025, subject to certain regulatory approvals and other customary closing conditions.

To learn more about AMD’s data center AI systems, visit the website here.

Related News:

Silo AI to be Acquired by AMD to Broaden Global Enterprise AI Solutions

AMD EPYC CPU-Powered Solutions Offers Cohesity Customers More Choices

The post Data Center AI Systems Capabilities Expanded with AMD’s Acquisition appeared first on Digital IT News.

]]>
Flex CESS Products Features Musashi’s Hybrid SuperCapacitors https://digitalitnews.com/flex-cess-products-features-musashis-hybrid-supercapacitors/ Mon, 12 Aug 2024 18:00:30 +0000 https://digitalitnews.com/?p=11693 Flex and Musashi Energy Solutions have announced a broad partnership to provide Capacitor-based Energy Storage Systems (CESS) designed and manufactured by Flex, incorporating Musashi’s Hybrid SuperCapacitor (HSC) technology. These systems are intended to integrate with server rack power systems to tackle major utility power challenges in AI data centers. As the first to market with [...]

The post Flex CESS Products Features Musashi’s Hybrid SuperCapacitors appeared first on Digital IT News.

]]>
Flex and Musashi Energy Solutions have announced a broad partnership to provide Capacitor-based Energy Storage Systems (CESS) designed and manufactured by Flex, incorporating Musashi’s Hybrid SuperCapacitor (HSC) technology. These systems are intended to integrate with server rack power systems to tackle major utility power challenges in AI data centers. As the first to market with Musashi’s HSC technology, Flex has worked closely with Musashi to develop strategic technology and product roadmaps for both current and future solutions, helping hyperscale operators mitigate utility power fluctuations in data centers running AI workloads.

Flex’s CESS solutions are designed to balance peak power and protect the grid from intense power surges and line disturbances during AI training and inference activities taking place in modern data center environments. Musashi’s state-of-the-art HSCs are designed to provide high-reliability energy storage in many applications and are known for their power density, longevity, and reliability. The technology reduces equipment size, weight and total cost of ownership.

Key features of the CESS include:

  • The ability tosupport and balance power supply systemsduring large power transients
  • Efficient energy managementand the reduction of large power transients or spikes produced by AI workloads by alternately supplying and absorbing energy in its internal Hybrid Supercapacitors, which are supplied by Musashi
  • A significantly longer lifespanthan current battery energy storage systems, with ability to provide multi-million charge/discharge cycles – essential for high-performance capacity and dependability needed in the data center
  • A wide operating temperature and inherent safety through Musashi’s Hybrid SuperCapacitors, with cells able to operate in temperature ranges from minus 30 to over 70 degrees Celsius, plus UL 810A certification and completion of UL 9540A testing for thermal runaway at the cell level

“We are proud to lead the charge in powering the next generation of AI innovation alongside Flex to address the power challenges needed to unleash capacity for explosive data center growth,” said Frank DeLattre, President of Musashi Energy Solutions in North America. “Our partnership with Flex for its new CESS product will bring reliable, efficient and scalable power solutions to the market. Musashi Energy Solutions continues to invest heavily in future Hybrid SuperCapacitor cell development to meet the future power density demands in AI computing as well as the manufacturing capacity required for customers to meet the forecasted cell volume.”

“Our collaboration with Musashi is central to developing our innovative CESS solutions to sustainably support the complex power demands of AI data centers worldwide,” said Mattias Jansson, Vice President of Power Solutions at Flex. “Together with Musashi, our technology and innovation portfolio plans enable Flex to provide hyperscale operators with advanced energy storage systems that enable them to address long-term energy transitions. Our CESS solutions are another proof point of how Flex is enabling customers to maximize AI server cluster computing performance and unlock data center capacity as AI applications drive unprecedented growth.”

Flex is slated to begin production of its CESS in the first half of Calendar Year 2025, with commercial availability expected within one quarter of production start. To learn more about Flex CESS, visit the website here.

Related News:

Megaport’s New Point of Presence at 365 Data Centers Boca Raton

Transforming Data Center Security with Searchable Encryption

The post Flex CESS Products Features Musashi’s Hybrid SuperCapacitors appeared first on Digital IT News.

]]>
Megaport’s New Point of Presence at 365 Data Centers Boca Raton https://digitalitnews.com/megaports-new-point-of-presence-at-365-data-centers-boca-raton/ Tue, 23 Jul 2024 17:30:29 +0000 https://digitalitnews.com/?p=11541 365 Data Centers (“365”) announces the ongoing expansion of its partnership with Megaport. Megaport has broadened its 365 footprint by adding a Point-of-Presence at 365’s Boca Raton, Florida data center, further enhancing public cloud and other connectivity solutions available to 365’s Southeast customers. 365 customers now have additional, on-demand, connectivity options to all the major [...]

The post Megaport’s New Point of Presence at 365 Data Centers Boca Raton appeared first on Digital IT News.

]]>
365 Data Centers (“365”) announces the ongoing expansion of its partnership with Megaport.

Megaport has broadened its 365 footprint by adding a Point-of-Presence at 365’s Boca Raton, Florida data center, further enhancing public cloud and other connectivity solutions available to 365’s Southeast customers. 365 customers now have additional, on-demand, connectivity options to all the major public cloud hyperscalers, such as Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Oracle Cloud, and IBM Cloud.

“Integrating Megaport’s advanced connectivity solutions into our Boca Raton data center is a natural progression of our partnership and network-centric strategy,” said Bob DeSantis, CEO at 365 Data Centers. “When added to Megaport’s presence in our Atlanta market data center, this deployment fortifies our joint Infrastructure-as-a-Service (IaaS) and Network-as-a-Service (NaaS) offerings in the Southeast and complements our partnership in several of our Northeast and Southwest market data centers. Megaport’s growing presence with 365 significantly enhances the public cloud connectivity options available to our customers.”

“Our expanded partnership with 365 Data Centers reinforces both companies’ commitment to innovation and customer satisfaction, ensuring that businesses of all sizes in all locations can leverage the latest network technology to stay competitive in today’s fast-paced digital landscape,” said Michael Reid, CEO at Megaport.

For more information about 365 Data Centers and Megaport’s services or the Boca Raton site, please visit the website here.

Related News:

The post Megaport’s New Point of Presence at 365 Data Centers Boca Raton appeared first on Digital IT News.

]]>
Transforming Data Center Security with Searchable Encryption https://digitalitnews.com/transforming-data-center-security-with-searchable-encryption/ Mon, 22 Jul 2024 17:00:51 +0000 https://digitalitnews.com/?p=11516 The world has evolved to become extremely cyber-reliant. And the Data Centers (DC) that comprise the cloud, GenAI/AI, CRM software, entertainment, financial, government and healthcare operations are now ground zero for targeted Stuxnet-like attacks—which would have catastrophic results. If a cluster of hyper scale DCs were to go offline, it could stop the US economy—and [...]

The post Transforming Data Center Security with Searchable Encryption appeared first on Digital IT News.

]]>
The world has evolved to become extremely cyber-reliant. And the Data Centers (DC) that comprise the cloud, GenAI/AI, CRM software, entertainment, financial, government and healthcare operations are now ground zero for targeted Stuxnet-like attacks—which would have catastrophic results.

If a cluster of hyper scale DCs were to go offline, it could stop the US economy—and potentially global economy—in its tracks, much like the 9/11 World Trade Center attacks stopped air travel. Today, Integrated Data Center Management (IDCM) implementations prepare and build out redundant systems to maintain all functional operations, including risk management and mitigation. At the center of the IDCM is Operational Technology (OT) command and control data.

Data Center Security Risks

We often look at processing, cooling, connectivity, and access as primary DC concerns. In reality, electricity is the main chokepoint. The disruption or complete loss of, core infrastructure electrical power is the most critical DC failure. We already know that the the US’s critical infrastructure, which includes the electrical grid, is currently at risk.

Because of this, DCs have mitigated electric grid power source failures by building out massive on-site power generation facilities. Even with these mitigation efforts, what if the chillers/cooling systems lost power, then the standby power did not start causing transfer batteries to quickly drain out leaving no time for a controlled shut down? Almost immediately, the residual heat without cooling will reach temperatures capable of destroying racks of critical equipment.

The Impact of an Attack

We don’t have to go back far in time to see how such a DC catastrophic failure could happen. The Stuxnet computer work was focused on sabotaging the specific industrial control systems used in Iran’s nuclear enrichment facilities, particularly the Siemens Step7 PLCs. The threat actor leveraged a “blind spot” that resulted in a cyber-attack that was successful without any detection from the monitoring systems.

In this instance, none of the cyber security detection solutions were alerted because it did not come in from the Internet or injected by a thumb drive. It was delivered as part of a routine spare part replacement, which is basic maintenance.

With access to the intranet from an OT device, the worm quickly spread to other computing devices. Stuxnet was a sophisticated worm representing four zero day attacks with a checklist of activities. To achieve its goal, Stuxnet needed to understand the specific configurations and operational details of the PLCs and where to find the targeted Siemens Step7 PLCs.

Stuxnet started its reconnaissance by collecting specific information about the systems it infected. This information included details about the configuration and operation of the industrial control systems stored in unencrypted, active SQL databases. However, the primary goal was not to steal data, but to leverage the collected information (data) to learn and refine its sabotage operations.

Stuxnet’s primary operations were focused on manipulating the PLCs and the real-time data being fed to SCADA systems; it did interact with internal SQL databases. It accessed and modified/manipulated configuration data that indirectly affected operational databases by ensuring they logged falsified data. However, it did not target traditional IT databases for data theft or direct manipulation.

Evolving Threats to Data Centers

Stuxnet and its variants, Duqu and Flame, in addition to new threat variants including those based upon GenAI, pose a threat to IDCM software applications and their active, on-demand data. The majority of that data is stored in plaintext to support active operations.

The Mitre Att&ck map starts with reconnaissance whereby hackers, once in, search for data and possible defenses. Once past the defenses, plaintext SQL databases can be manipulated, stolen or invisibly controlled by remote threat actors.

Today’s most dangerous IDCM application threats are SQL injection and cross-site scripting. SQL injection tools enable hackers or worms to automate their attack processes and quickly exploit vulnerabilities. It’s called “SQL” injection because the adversary is trying to find a vulnerability in the application to directly talk to the SQL database, bypassing application safeguards.

Ending DB Attacks With Encryption

But, what if the IDCM application spoke to its critical data through an API which can be secured and monitored?

With new Searchable Encryption technology, users can perform computations on AES-256 encrypted data while the data remains fully encrypted. Solutions based on Searchable Symmetrical Encryption allow for database operations (create, read, update & delete) without needing to decrypt that data.

If the Iranian’s nuclear enrichment facilities SCADA systems had Searchable Encryption, the Stuxnet reconnaissance effort would have revealed no usable data and could have stopped the attack immediately. The entire intranet and its devices would have remained concealed behind encrypted data.

A Searchable Encryption solution aligned with the Federal Data Center Enhancement Act of 2023 use of technology requirements, “regularly assess the application portfolio of the covered agency and ensure that each at-risk legacy application is updated, replaced, or modernized, as appropriate, to take advantage of modern technologies”.

Today all data centers are at risk, vulnerable to IoT & OT data that is not secure. A Stuxnet-like worm or a skilled hacker will find many challenges in searching for data necessary to execute their attacks upon a system with Searchable Encryption. It’s time to ensure our data centers are secure-by-design since they are critical infrastructure with many attack vectors, motivated attackers, and most of the world’s critical data.

Related News:

Crusoe to Build AI Data Center at the Lancium Clean Campus

The ScienceLogic Platform Delivers New AIOps Enhancements

The post Transforming Data Center Security with Searchable Encryption appeared first on Digital IT News.

]]>