Despite talk of an impending AI bubble, Amazon is the latest company to benefit from the AI arms race. Meta just inked a deal with Amazon worth billions to deploy the AWS Graviton processors in its 32 data centers over the next three years. While Amazon hasn’t disclosed the full value of the deal, we’ve seen companies spend eye-popping sums to sustain their AI growth.
Recently, Meta also signed a six-year, $10 billion deal with Google Cloud, while OpenAI agreed to spend $20 billion with chip startup Cerebras over the next three years to use servers powered by the company’s hardware.
The Graviton processors support cloud workloads that run on Amazon Elastic Compute Cloud (Amazon EC2), and the company has long said that it offers the best price performance for cloud workloads.
What’s interesting here is that the AWS Graviton is an ARM-based CPU, rather than a GPU. CPU refers to a computer’s Central Processing Unit, the computer’s brain, whereas a GPU is its Graphics Processing Unit, commonly used for training AI models.
“As we scale the infrastructure behind Meta’s AI ambitions, diversifying our compute sources is a strategic imperative,” said Santosh Janardhan, Meta’s head of infrastructure, in a statement. “AWS has been a trusted cloud partner for years, and expanding to Graviton allows us to run the CPU-intensive workloads behind agentic AI with the performance and efficiency we need at our scale.”
Meta has been a long-time AWS customer, so this chip deal doesn’t come as a surprise. What’s notable is that it involves CPU chips rather than GPU.
Getty Images
Typically, AI models are trained on GPUs. Once trained, AI agents can use CPUs for more compute-intensive workloads, such as writing code.
The Graviton chips are designed to be efficient for AI-agentic tasks. According to Amazon, the Graviton 5 chips have 192 cores and a cache that is five times larger than the previous generation, reducing communication delays between cores by 33%. They should also be more energy-efficient, with 25% better performance than previous generations.
“This isn’t just about chips; it’s about giving customers the infrastructure foundation, as well as data and inference services, to build AI that understands, anticipates, and scales efficiently to billions of people worldwide,” said Nafea Bshara, AWS vice president, in a statement.
Part of the motive behind this may also be that earlier this month, Antropic signed a deal to spend $100 billion on AWS to run Claude workloads on Amazon’s Trianium GPU chips, while Amazon agreed to invest $5 billion back into Antropic. It’s likely that Antropic has monopolized Amazon’s stock of Tranium2 to Tranium4 chips, and the company also has the option to buy future Amazon chips as they become available.
In addition to working with Amazon, Meta is developing its own in-house silicon, with work progressing on four iterations of its MITA chip for AI and an expanded partnership with Broadcom to design and build the chips. Meta has also agreed to spend billions on chips and AI hardware from Nvidia and AMD, as well as another multibillion-dollar deal to use tensor processing units from Alphabet.
A Meta representative declined to share specific workloads but said the company will support AI work, including MSL (Meta SuperIntelligence Labs).
A functioning structure and informational flux that gathers businesses, finance, and technological operations alongside each other to drive up the businesses through cloud transformation.
It promotes data-powered decision-making in due time and results in financial responsibility. The collaboration of finance, operations, and business teams makes it possible to achieve it.
FinOps is a field that integrates principles of financial management with cloud engineering and operations to give organizations an analysis of their cloud expenditure. It also allows them to make well-versed decisions on the allocation of their cloud budget and costs. Its goal is to increase the revenue or the business value with the help of the cloud. It also helps organizations control their cloud expenditure while still maintaining the performance level, dependability, and security required to assist their business operations.
Principles of Cloud FinOps
Accountability
With a set of pre-defined KPIs and benchmarks, the teams responsible for value realization reporting and costing amendment can be held accountable. This makes decision-making a process with standards.
Business Value Realization
Decisions taken from the perspective of business make Cloud FinOps successful.
Flexibility
Encourage constant budget allocation, IT spending, and forecasting to push ahead with agile budgeting and planning procedures in the IT industry.
Clarity of Costs
All organizational levels have access to instantaneous cost and billing data.
Partnerships
For cloud finance management, collaborate with departments like IT, finance, app development, and architecture.
Fluctuating nature of the cloud
Accept the pay-as-you-go aspect of cloud and gain from providing dynamic customer service to meet their ever-changing requirements.
Five Key Elements that Make Cloud FinOps
1. Accountability and Facilitation
This element centers on setting up centralized, multi-functional teams that include engineering, finance, operations, architecture, and app developers, while also setting up governance and benchmarks for cloud expenditure.
2. Planning and Predictions
For cloud planning and predictions to be effective, an organization must allocate resources, benchmark efficacy, and gain a deeper understanding of the cost drivers.
3. Cost Optimization
This element, which is an ongoing, repetitive process that focuses on identifying key cost-optimization drivers, offers a consistent methodology to manage cloud consumption in the most economical way.
4. Measurement & Awareness
This key element focuses on building a key set of KPIs and business-value metrics to calculate the transformation’s success. Customers frequently begin with a set of cost-optimization metrics before switching to unit economics or business value metrics, like cost per transaction or cost per customer served.
5. Tools and Accelerators
To sum up, using the right tools and accelerators is crucial for efficiently managing and monitoring cloud spending. It comprises:
Using Google Cloud cost-management tools to examine cost and billing data in real time
Creating a reporting dashboard for tracking values and managing cloud spending
Putting automation scripts into place to create budget alerts and account guardrails
Benefits That Cloud FinOps Offer
Business Value Realization
Initial focus on cloud migration often leaves the business goal of infrastructure in the rear. Proper cooperation between various departments makes FinOps effective and a success. This allows the reconsideration of business values while lifting cloud management to new heights.
Better Decision Making
Making decisions to make business better than today is the whole point here. Using the insights from cloud data and financial analytics, the FinOps team is able to make informed decisions regarding the business’s cloud computing commodities. This also makes them focus on the business goals.
Art of Predictions and Cloud Reporting
FinOps teams analyze cloud spend and set standards for future cloud costs using analytics, reporting, and forecasting cloud FinOps tools. They can create budgets fittingly and evade unplanned surplus costs thanks to the jacked-up cost visibility.
Accountability for Clear Cloud Use
By providing clarity into resource ownership and cloud spending, FinOps promotes accountability while leveling the time and effort needed for research and change implementation.
Challenges That FinOps Come With
Before Cloud FinOps begins to show results, you must surpass many predicaments. These may include issues with organizational processes, technical implementation, or how the teams as a whole perceive the changes.
Governance
Incorporating new methods, tools, and challenges requires all the things to be in place and well-governed. The processes to be incorporated ought to adhere to existing laws, rules, and compliance standards. It can be challenging to describe these approaches, create policies, and implement them.
Technical Glitches
There might be considerable technical glitches in putting the suggested modifications into practice, from planning effective cost data collection and processing to putting per-instance optimizations, element migration, and access management into practice.
All of the alterations should certainly be based on practicality, as well as administering the right balance between cost-effectiveness and effort, while taking into account the gross solution’s business value.
Cultural Alterations
As the FinOps framework requires processes to be established at every level of an organization, an actual cultural transformation must take place for FinOps methodologies to be implemented successfully. This entails setting up a culture of financial responsibility and accountability while maintaining the requirements of the company and the objectives of the other players in mind.
It could be challenging to bring in this culture, as it needs not only the establishment of appropriate processes but also a shift in the team’s mentalities. So, it is a task!
From Chaos of Cloud to Clarity: An Imperative for Businesses
Cloud FinOps is the way of the future for businesses, but excessive cloud spending can undermine the very advantages that companies are trying to achieve. Cloud FinOps management transforms from a standalone finance function into a vital business capability with FinOps.
Businesses that adopt Cloud FinOps not only reduce cloud expenses but also acquire the flexibility to change course more quickly, the assurance to make more intelligent investments, and the transparency to match IT with business value.
The ability to forecast precisely, budget dynamically, and optimize continuously is not a luxury in a world where cloud usage is only increasing; rather, it is a competitive necessity.
1. What is another name for FinOps? Answer: FinOps is the blend of “Finance” and “DevOps”. It shows the collaboration between business and engineering groups. It is also known by terms like Cloud Financial Management and Cloud Financial Optimization.
2. When did FinOps start? Answer: It began in 2019 as an open community comprising individuals and organizations where knowledge of cloud financial management could be shared.
3. What is the future of FinOps? Answer: FinOps’s future depends on comprehensive innovation and teamwork. FinOps and ITAM combination will be essential as cloud infrastructure develops to trim the financial waste, promote sustainability, and improve AI-powered optimization.
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional
Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
