Ampere Cloud Native Processors Can Help Achieve Sustainability Goals – Forbes

Environmental sustainability is no longer just a corporate social responsibility but a business imperative. That was evident at the recent Open Compute Project (OCP) Global Summit, where sustainability was the theme in almost every booth.

We are all aware of the rising energy consumption of hyperscale data centers the comparisons to towns and even small countries. Of course, the solution is straightforward - more compute with less power. This opportunity has created a new wave of innovative startup chipset companies. I recently wrote an article about Groq, which focuses on discrete chips for specialized workloads such as artificial intelligence (AI).

Ampere is another rising star with the same goal but a different strategy. Ampere is designing purpose-built, multi-core processors optimized for multi-tenant cloud workloads.

Ampere

Time for a new type of CPU

I am an avid chip guy who has been in the industry for many years. This story reminded me of the transition from mainframes to a client-server model a couple of decades ago. First, the usage model changed, followed by the adaptation of the software to become higher performance more and more efficient, and then finally, the hardware changed. We are going through a similar transition right now. Cloud-native has happened from an architectural perspective and also from a software perspective. It is time for a cloud-native processor to drive higher performance and improved sustainability.

Enterprise-class processors the wrong tool for the cloud

CSPs must have profitable cloud infrastructure while delivering the performance customers expect. Enterprise-class processors are not the right tool for cloud-native workloads and can negatively impact customer SLAs and add unpredictability.

Enterprise-class processors support applications written as monolithic blocks of code executed in a dedicated environment. Enterprise-class processors have evolved with increasing power and large amounts of memory with innovations such as high-capacity cores, higher CPU frequencies, and larger caches.

Simultaneous multithreading (SMT) and Turbo Boost are enhancements that can be effective for the correct use case but not for latency-sensitive, scalable cloud-native workloads.

SMT enables each physical core to split into two logical threads simultaneously executing separate instruction sequences. Turbo Boost automatically runs cores faster than the rated operating frequencies.

SMT can cause problems in a multi-tenant cloud environment. Multiple applications must share execution resources when a CPU core has two SMT threads. A resource-intensive workload, known as a noisy neighbor, will cause workloads on the other SMT thread will slow from lack of execution resources. Similarly, Turbo Boost can cause unpredictable performance depending on the type of workload.

In summary, enterprise-class cores perform well with computationally intensive applications but not in a shared cloud infrastructure.

Ampere taking a clean-slate approach to CPU design

Cloud-native applications have distributed components, such as micro-services, that perform specific tasks and collaborate to achieve an objective. A benefit is that lightweight applications are faster to develop, test, and integrate, leading to practices like continuous integration/continuous delivery (CI/CD).

Ampere took a clean-slate approach to CPU design that caters to this new software paradigm in multi-tenant environments. CSPs want to host more end users per server with dedicated physical cores. Ampere responded with a processor design that offers near-linear scaling across a 128-core Altra processor.

Ampere's processors are immune to the "noisy neighbor" issues that plague enterprise-class processors with SMT. Ampere's processor cores are single-threaded, resulting in no resource contention and more predictable performance. With Ampere, each thread runs solo on a single core.

Changing the game in terms of sustainability

Ampere starts with single-threaded cores - one thread, one process - different from the enterprise-class processors with multiple threads competing for processor resources. Multiple threads create an unpredictable environment, whereas a single-threaded core provides the same performance with every core resulting in a high degree of predictability.

Ampere uses a constant operating frequency delivering predictability as opposed to x86 processors that employ frequency scaling. Ampere uses power-efficient cores, which allow the stacking of many cores into a processor. The highest core counts in the industry.

Ampere pipelines cores with a large private L2 cache located right next to the core. Loading data and instruction sets into the L2 cache results in a predictable performance profile for each core.

The high number of cores makes it cost-effective for CSPs to rent each core to a single customer. Customers get scalability and predictable performance. CSPs can run at the lowest possible power with fully populated racks with no stranded capacity. Running at the lowest power reduces the thermal load. The net result is a quantum leap in efficiency and maximum performance per rack.

A strong endorsement from Microsoft Azure

Microsoft now offers Azure Virtual Machines with Ampere Altra Arm-based processors that can run Linux workloads such as web servers, open-source databases, in-memory applications, big data analytics, gaming, and media.

An Ampere Altra VM is a high-performance compute alternative that scales up linearly, delivers predictable performance at full utilization, and is power efficient, directly reducing users overall carbon footprint.

Wrapping up

Ampere has addressed the simple question posed at the beginning - more compute with less power. A cloud native processor with single-threaded cores, consistent operating frequencies, and the most power-efficient cores in the industry, topped by a large L2 cache close to the processor resulting in a cloud-native processor built for the sustainable cloud.

Microsoft has proven this isn't a fantasy - the solution exists today. Instead of building out data centers with compute using enterprise-class processors switching to Ampere's cloud-native processors could reduce power consumption by 20 percent and still meet the compute needs.

Other major players have also embraced the Ampere technology. Hewlett Packard Enterprise announced in it will offer a cloud-native server in later in 2022 using Ampere chips. Google Cloud has launched virtual machines using Ampere Altra Arm-based processors. Oracle, in addition to being a major investor, offers a comprehensive line of Ampere platforms on Oracle Cloud Infrastructure (OCI).

Moor Insights & Strategy, like all research and tech industry analyst firms, provides or has provided paid services to technology companies. These services include research, analysis, advising, consulting, benchmarking, acquisition matchmaking, and speaking sponsorships. The company has had or currently has paid business relationships with 88, Accenture, A10 Networks, Advanced Micro Devices, Amazon, Amazon Web Services, Ambient Scientific, Anuta Networks, Applied Brain Research, Applied Micro, Apstra, Arm, Aruba Networks (now HPE), Atom Computing, AT&T, Aura, Automation Anywhere, AWS, A-10 Strategies, Bitfusion, Blaize, Box, Broadcom, , C3.AI, Calix, Campfire, Cisco Systems, Clear Software, Cloudera, Clumio, Cognitive Systems, CompuCom, Cradlepoint, CyberArk, Dell, Dell EMC, Dell Technologies, Diablo Technologies, Dialogue Group, Digital Optics, Dreamium Labs, D-Wave, Echelon, Ericsson, Extreme Networks, Five9, Flex, Foundries.io, Foxconn, Frame (now VMware), Fujitsu, Gen Z Consortium, Glue Networks, GlobalFoundries, Revolve (now Google), Google Cloud, Graphcore, Groq, Hiregenics, Hotwire Global, HP Inc., Hewlett Packard Enterprise, Honeywell, Huawei Technologies, IBM, Infinidat, Infosys, Inseego, IonQ, IonVR, Inseego, Infosys, Infiot, Intel, Interdigital, Jabil Circuit, Keysight, Konica Minolta, Lattice Semiconductor, Lenovo, Linux Foundation, Lightbits Labs, LogicMonitor, Luminar, MapBox, Marvell Technology, Mavenir, Marseille Inc, Mayfair Equity, Meraki (Cisco), Merck KGaA, Mesophere, Micron Technology, Microsoft, MiTEL, Mojo Networks, MongoDB, National Instruments, Neat, NetApp, Nightwatch, NOKIA (Alcatel-Lucent), Nortek, Novumind, NVIDIA, Nutanix, Nuvia (now Qualcomm), onsemi, ONUG, OpenStack Foundation, Oracle, Palo Alto Networks, Panasas, Peraso, Pexip, Pixelworks, Plume Design, PlusAI, Poly (formerly Plantronics), Portworx, Pure Storage, Qualcomm, Quantinuum, Rackspace, Rambus, Rayvolt E-Bikes, Red Hat, Renesas, Residio, Samsung Electronics, Samsung Semi, SAP, SAS, Scale Computing, Schneider Electric, SiFive, Silver Peak (now Aruba-HPE), SkyWorks, SONY Optical Storage, Splunk, Springpath (now Cisco), Spirent, Splunk, Sprint (now T-Mobile), Stratus Technologies, Symantec, Synaptics, Syniverse, Synopsys, Tanium, Telesign,TE Connectivity, TensTorrent, Tobii Technology, Teradata,T-Mobile, Treasure Data, Twitter, Unity Technologies, UiPath, Verizon Communications, VAST Data, Ventana Micro Systems, Vidyo, VMware, Wave Computing, Wellsmith, Xilinx, Zayo, Zebra, Zededa, Zendesk, Zoho, Zoom, and Zscaler.

Moor Insights & Strategy founder, CEO, and Chief Analyst Patrick Moorhead is an investor in dMY Technology Group Inc. VI, Dreamium Labs, Groq, Luminar Technologies, MemryX, and Movandi.

Read more:

Ampere Cloud Native Processors Can Help Achieve Sustainability Goals - Forbes