Power grids are the foundation of energy systems, playing a key role in the energy transition by enabling the use of renewable energy sources (RES). To meet the growing demand for renewable energy, the world may need to integrate RES into power grids—but there are hurdles to overcome.
With the push to decarbonize economies, the installed capacity of renewable energy is expected to show significant growth to 2050. The transition to RES, coupled with economic growth, will cause electricity demand to soar—increasing by 40 percent from 2020 to 2030, and doubling by 2050.1
Utilities confront two significant challenges when integrating RES into electric grids. First, they face network inadequacy, with a lack of physical capacity to accommodate supply and demand in locations with the best resources. Second, as the share of RES increases, the lack of real-time network management at low voltages could lead to network instability, which may affect high reliability standards and cause voltage instabilities, frequency inconsistency, and harmonic distortion of the power system.
Grids were not originally set up for such a fast-paced energy system; their tools and processes were developed in a slower, less volatile world. In this article, we examine the challenges that grid operators are facing across planning, connection, and operations, and explore coordinated solutions to benefit from the rapidly increasing need for RES.
To support RES integration into grids, grid operators may need to rethink their status quo and tools across their planning, connection, operation, and coordination approaches (Exhibit 1).
The growing demand for renewables requires grid integration
The energy transition is changing the landscape of electricity generation. As decarbonization drives RES demand, RESs are expected to account for 45 to 50 percent of the global power supply by 2030 and 60 to 70 percent by 2040.2 With such booming demand, RES installed capacity could grow nine times from 2020 to 2050 (Exhibit 2). The transition to RES, coupled with economic growth, will likely cause electricity to grow rapidly.3 Power grids will need to expand to meet the increasing demand for electricity and renewable energy: to achieve net-zero emissions by 2050, countries would need to double their investment in transmission lines and other infrastructure to €550 billion per year by 2030.4
The challenge of integrating renewables into grids
To harness the RES opportunity, RES need to be integrated into the grid—this is no easy task. Grid operators face two major constraints in this regard.
First, we have noticed that network inadequacy is a challenge for many operators (see sidebar “Network inadequacy”). At present, there is not enough physical grid capacity to accommodate supply and demand connections. This is primarily due to difficulties in optimizing grid capacity (currently designed for centralized, mainly fossil fuel generation) and inefficient grid planning, leading to less new RES capacity being built than needed.
Second, operators contend with network instability (see sidebar “Network instability”). Increased penetration of intermittent power sources, such as solar and wind, have caused a higher utility frequency and voltage volatility.5 Operators are facing the problem of having fewer “rotating masses,” losing the ability to stabilize the system due to the phase-out of current balancing assets, such as thermal generation.6 They also dealing with the curtailment of distribution-connected plants and potential imbalances penalties. As a result, there’s a growing need for complex balancing services and restructuring of transmission and distribution system operator-coordination processes.
Would you like to learn more about our Electric Power & Natural Gas Practice?
How grid operators can navigate renewables integration
Grid operators face multiple challenges along the value chain that can potentially put them at risk of being underprepared for the energy transition. However, they have numerous avenues available to help them better plan, connect, and operate.
Plan: Harnessing integrated grid planning
The tools and processes available at present for grid planning are not up to the task of optimizing current capacity and planning for the setup of efficient new capacity. Complex power flow models are not able to handle the long time frames, nor the uncertainties of today’s system regarding demand (absolute growth and profile effect) and supply (availability, location, and dispatchability) growth trends and could affect the future regulatory landscape.
This leaves operators unable to model uncertainty at a granular level across a wide variety of inputs, including:
- Supply and demand forecasts such as electric vehicle, solar rooftop, or heat pump adoption by consumers, for which grid operators need to plan to optimize their integration into the system.
- Climate and weather forecasts, affecting the capability of intermittent generation sources to generate power, such as wind- and solar-powered technologies, and compromising grid resilience due to a growing number of extreme weather events.
- Asset failure probability, impacting network reliability. This is driven by aspects such as power grid aging or vegetation impact on power grid lines, which in turn affects grid availability, increases the complexity of power grid maintenance and operation, and indirectly affects grid development plans.
These factors highlight the need for a more integrated grid planning approach (Exhibit 3).
Planners can draw on flexible and modular data architecture and AI-driven, stochastic optimization of investment plans, as these can assist in optimizing existing grid capacity and the buildout of new capacity using integrated grid planning.
Modular IT and data architecture
Companies can redesign their data architectures to emphasize modularity (the ability to break down a complex system into smaller, more manageable components). This would allow for greater flexibility, scalability, and adaptability in the data architecture to help organizations achieve their data management goals more effectively and efficiently, including better cooperation with energy market platforms. The goal is to be able to operate with “data building blocks” as if the data were perfect so that, first, only one block needs to be updated when real information is available and, second, uncertainty on predicted data can be represented statistically based on the confidence of the prediction.
Scenario-based stochastic models
Such models combine macrogrid trends and microgrid dynamics to evaluate many options, helping to build confidence under uncertainty. This allows for better planning, enabling the modeling of a full year quantifying unpredictability of events such as asset failures and voltage fluctuations, which additionally can serve as a robust fact base for regulators and operators and provide valuable insights for informed decision making.
Stochastic grid modeling: A European example
One European distribution operator deployed a stochastic grid modeling approach to quantify grid impacts and determine the best potential grid upgrades in a specific region.
By deploying an advanced stochastic model, the grid operator was successful in a number of areas, including:
- Stress testing its current network development plan, focusing mostly on the business-as-usual solution, such as substation capacity increases and new lines. The operator leveraged a stochastic approach to understand the risk associated with the plan by calculating the probability of curtailments and energy not served in the years ahead.
- Developing additional investment scenarios that consider alternative solutions beyond traditional power grid upgrades (for instance, storage, optimal location in the grid for renewable additions, and advanced inverters) and have different target functions such as optimizing for quality of service or for capital expenditure (capex).
- Estimating the impact of these scenarios on both capex and QoS compared to the current plan. One operator, for example, found that it could achieve a 15 percent reduction in capex and an 80 percent improvement in the QoS indicators in one scenario, compared to a 40 percent reduction and 65 percent improvement, respectively, in a second scenario (exhibit).
For example, these models can quantify the impact of several inputs—such as RES penetration, grid topology, and electric vehicle adoption—into the main Quality of Service (QoS) metrics (for instance, curtailments and energy not served), leveraging a stochastic approach (see sidebar “Stochastic grid modeling”). Models can include deep learning surrogate models to manage to bring down execution time from days to seconds when running full-year simulations across a medium and long time horizon.
Connect: Accelerating the renewable grid connection process
Grid operators face various hurdles in their connection process, including outdated prioritization for connection analysis that does not account for future additions, insufficient digitization of the overall process, and a lack of standardization in equipment procurement and permitting processes.
To address these challenges, operators can optimize methodologies for hosting capacity estimation (for example, leveraging advanced grid planning models as described above); automate processes; leverage generative AI (gen AI) to improve customer interface and information flow; adapt connection requirements; standardize equipment; and ensure capital delivery excellence to accelerate the connection and permitting process. Executives can make the connection process more transparent for their customers in the following phases.
Phase one: Prior to applying to connect a new RES to the grid
Operators could optimize their hosting capacity for renewable plant methodologies by adopting an integrated grid planning approach—supported by advanced analytics technologies—and by considering solutions currently not commonly used such as batteries. In parallel, operators could improve the visibility of grid constraints through publicly available information on grid congestions and hosting capacity in each point of the network. They could also define minimal requirements for RES developers to optimize the application process, while still staying within the applicable power quality requirements.
Phase two: Grid application process
Operators could consider revising and optimizing connection requirements through conditional requirements. Such an example would be conditioning solar output to network congestions in specific times to increase the amount of renewable generation connected, without upgrading any grid equipment (such as transformers and power lines) and defining a predefined and standardized set of connection offerings to RES developers.
Phase three: Construction and activation of new grid connections
Operators could improve capital spending by better managing stretched supply chains (for instance, raw materials and components) and inflation risks. They could also apply a variety of design levers—such as equipment standardization—to optimize product design by applying design-to-cost and developing strategic partnerships with equipment suppliers. In addition, operators could focus on efficient cooperation with permitting authorities. New grid connections require many permissions during the application process and an efficient cooperation framework could increase the application success rate and minimize overall lead times.
Grid planning under uncertainty: Investing for the energy transition
Operate: Improving operations
Heavily centralized processes and limited data availability can lead to insufficient operational visibility that affects system stability. In general, distribution grid operators lack real-time information on power flows in the low-voltage grid and the operational practices that would allow them to maintain grid stability by managing grid assets connected to the network.
Operators could use system stability and network adequacy technologies—such as advanced inverters, prime exchangers, and virtual synchronous machines—and introduce innovative flexibility services (for example, inertia procurement, congestion services, and flexibility tenders) to address physical adequacy bottlenecks, improve stability, and streamline day-to-day operations.
Advanced grid technologies
Operators could also consider technologies that increase their ability to manage the network, or look at unconventional technologies as alternatives to upgrading power grid lines and substation capacity. Advanced grid technologies can be categorized into four groups, varying by impact and maturity: advanced components; system monitoring and optimization; distributed energy resources (DER) integration software; and energy storage technologies (Exhibit 4).
Advanced transformers, grid management, and energy storage are high-maturity, high-value-pool solutions. These could help grid operators integrate renewables into the system where grid monitoring presents itself as a key enabler to gain visibility into the power grid status and improve grid operations across their value chain (for instance, network planning and maintenance). Some regions, such as the United Kingdom, have already started to incentivize power operators to monitor low-voltage networks to support electric vehicle and renewable generation into the grid. They do so by installing smart devices with computing edge capabilities, coupling both the required field devices needed to capture the data on site with a fit-for-purpose telecommunications network that aims to gain visibility into the low-voltage grid.
Flexibility services
Grid operators could use flexibility services to offer a more reliable, stable power supply to consumers by balancing supply and demand on the power grid in real time, reducing the need for higher-cost and higher-emitting peaking power plants. Flexibility providers could make temporary changes, when requested, in the way they consume, generate, or store electricity to support a more efficient use of the energy network (such as for congestion services and inertia capacity procurement). Effective coordination among key stakeholders—regulators, grid operators, and flexibility services providers, for example—would be required to set up the optimal regulatory framework and define the most efficient operational procedures among them, including data exchange protocols, remuneration, and penalties.
Bringing it all together
Operators could ensure faster and leaner internal coordination by enhancing their current operating models and cooperating with main stakeholders of the energy system, improving information flow throughout the end-to-end RES integration process.
Operating model
To ensure proper coordination in the energy system, operators can focus on people, structure, and systems and processes.
In terms of people, operators can review their talent and capabilities management and organizational culture. This might involve hiring new talent and upskilling existing employees to ensure they have the skills and knowledge needed to succeed in the rapidly changing energy market.
Regarding structure, operators can set up a governance framework that provides guidelines on responsibilities and establishes a cross-functional team collaboration model. Operators can adopt different approaches (as below) to adapt the workforce and increase cooperation between different departments to enable the renewable integration strategy, depending on the degree of disruption compared with their current organization.
First, operators can implement dedicated periodic meetings between departments (monthly, for example). This would increase collaboration among business units on renewable integration (while keeping decision making within the departments), help address the company’s renewable integration priorities, and raise concerns when complications arise.
Second, operators can set up a renewable integration task force comprising department members. This team would be in charge of decision making, while departments would collaborate by raising concerns and potential pain points with the task force and provide support on decision making.
Third, operators can execute an agile, cross-functional operating model with autonomous “squads” (for example, a northern region). This would combine people from different departments into smaller, more dynamic teams for end-to-end accountability in the pursuit of the squad’s purpose.
Finally, in terms of systems and processes, operators can focus on improving and streamlining process design, as well as automating and digitizing systems and technology. This could help to eliminate bottlenecks and improve efficiency, allowing operators to better manage the energy system and respond to changes in demand and supply.
Cooperation with energy market stakeholders
To ensure proper coordination in the energy system, operators can work collaboratively with five key stakeholders—transmission operators, regulators, RES developers, flexibility industries, and power consumers—by employing six key actions:
- Increasing transmission operators’ visibility of the distribution grid by establishing a cooperation framework with the distribution operators for managing distributed generation resources. Operators could stabilize the system and ensure system balancing through international energy trading.
- Establishing a cooperation framework with permitting bodies, regulators, and government agencies.
- Working with RES developers to develop systems and grids in lockstep and promote visibility of the connection process to improve awareness of technical grid capabilities and constraints.
- Engaging with industries to provide captive and flexibility assets for system stability and balancing efforts, and incentivize industrial consumers to adopt technologies for reactive power usage (power that flows back and forth between inductors and capacitors in an alternating current electrical system).
- Communicating with external stakeholders and the public to highlight the effort that grid operators are making to support the energy transition.
- Incentivizing power retailers and consumers to be more flexible in their energy consumption through initiatives such as energy efficiency programs. Operators can create a framework for connection and tariffs for individual power consumers such as rooftop solar and electric vehicle users.
Decarbonizing the global economy will require vast amounts of electricity to be generated, of which one solution is renewable sources such as solar and wind. RES infrastructures are already available and rapidly increasing. However, taking advantage of renewables requires a power grid that can accommodate these intermittent energy sources. Operators have a way to go to make this happen, but they can start now by rethinking their planning, connections, and operations and coordinating across stakeholders to construct a global net-zero power grid for the future.
