Applied Energy · 2020 · 66 citations · 43 references
Natural ResourcesBusiness EconomicsEconomicsEnergy EconomicsEnergy PolicyMicroeconomicsElectricity Market RegulationElectricity MarketsEnergy Market RegulationEnergy PricingOligopoly PricingPower Sector EconomicsCompetitive Bidding BehaviorElectricity Market AnalysisElectricity PricingEnergy Market DesignEnergy Market EfficiencyMarket SizeReinforcement Learning TheoryStrategic Bidding In Procurement
Market-based procurement of balancing services in Europe is prone to strategic bidding due to the relatively small market size and a limited number of providers. In the European Union, balancing markets are undergoing substantial regulatory changes driven the efforts to harmonize the market design and better align it with the goals of the energy transition. It is proposed to decouple the balancing energy (real-time) market from the (forward) balancing capacity market and the price of balancing energy will be based on the marginal bid. In this paper, the potential effects of these changes on market participants’ strategies are analyzed using an agent-based model. This model compares the effects of a standalone balancing energy market with different pricing rules on economic efficiency with agents that apply naïve, rule-based and reinforcement-learning strategies. The results indicate that the introduction of a standalone balancing energy market reduces the cost of balancing, even in a concentrated market with strategic bidders. Marginal pricing consistently leads to lower weighted average prices than pay-as-bid pricing, regardless of the level of competition. Nevertheless, in an oligopoly with actors bidding strategically, prices can deviate from the competitive benchmark by a factor of 4–5. This implies that the introduction of a standalone balancing energy market does not entirely solve the issue of strategic bidding, but helps dampen the prices, as compared to the balancing market prior to the design change.
43
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Deep Reinforcement Learning with Double Q-Learning
Hado van Hasselt, Arthur Guez, David Silver · 2016 · 6K citations · Full text
Tree-Based Batch Mode Reinforcement Learning
Damien Ernst, Pierre Geurts, Louis Wehenkel · 2005 · 866 citations · Full text
Electricity market modeling trends
Mariano Ventosa, Andrés Ramos, Michel Rivier · Energy Policy · 2003 · 710 citations