Day-Ahead Electricity Price Forecasting Using a Multivariate Group Lasso Method

summary

Video file (mp4)

The gist

The gist: The proposed CING-LEAR model is a multivariate statistical method that accounts for cross-hour feature group effects in electricity pricing signals by leveraging a Group Lasso formulation

In short

The CING-LEAR model is a multivariate statistical method designed to forecast day-ahead electricity prices by accounting for complex cross-hour feature group effects. It uses a Group Lasso formulation to jointly select relevant features across all hourly forecasts, leading to improved point and probabilistic accuracy compared to existing methods.

Key concepts

Cross-INfluence-Group-Lasso (CING)
This is the core statistical approach where coefficients for different input features are organized into groups that span across multiple hourly outputs. The Group Lasso penalty encourages entire groups of coefficients to shrink to zero if they are not useful, effectively capturing how a single feature influences prices across several consecutive hours.
Group Lasso Regularizer
A type of regularization technique applied during model training. Instead of penalizing individual coefficients separately, the Group Lasso penalty applies a penalty based on the Euclidean norm of entire groups (rows) of coefficients. This forces the model to select or discard entire sets of related features simultaneously, which is ideal for modeling cross-hour dependencies.
Cross-Hour Feature Group Effects
This refers to complex patterns in electricity pricing where a specific input variable, like a weather factor, doesn't just affect the price at one hour but consistently influences prices across several consecutive hourly blocks. The CING-LEAR model specifically targets and models these persistent, group-level influences.
Group Lasso Formulation
A mathematical constraint used in the multivariate regression model to enforce feature selection based on group structure. It ensures that if a set of features is collectively irrelevant across the forecast horizon, their combined coefficients will be driven to zero during training, thereby simplifying the model and improving interpretability.

Terminology used across episodes

This episode discusses

The paper

Day-Ahead Electricity Price Forecasting Using a Multivariate Group Lasso Method · Read on arXiv

Rutgers, The State University of New Jersey · PG&E, Pacific Gas & Electric Company · University College, Korea University

Electricity price signals in modern power systems exhibit complex dependence structures that render forecasting inherently challenging. Our analysis of real-world electricity pricing signals reveals complex temporal group effects, whereby the influence of explanatory variables on electricity prices persists across consecutive blocks of time due to underlying economic, system, and operational drivers. In response, we propose a multivariate statistical method based on a Group Lasso formulation to jointly forecast the vector of day-ahead electricity prices (h = 1,..., 24), by leveraging multi-feature temporal group effects. Our approach is evaluated on two full years of electricity prices from the California Independent System Operator (CAISO), demonstrating considerable improvements in point and probabilistic forecast metrics compared to a wide array of statistical and deep learning methods. Empirical analyses confirm the effectiveness of the proposed approach in modeling realistic group effects, maintaining both interpretability and low computational complexity. When retrospectively evaluated on test data from a recent international electricity price forecasting challenge, the proposed method ranked in second place, despite having access to significantly less information than competing approaches. Finally, the proposed method is independently validated against two operational electricity price forecasting systems in CAISO, demonstrating competitive predictive performance and practical relevance.

Transcript

Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.

Rosa: I'm Rosa, and with me are Dev and Taro, guest researcher.

Dev: Today's paper: "Day-Ahead Electricity Price Forecasting Using a Multivariate Group Lasso Method".

Rosa: The gist:

Dev: First, who's behind it and why it matters.

Paper summary: Rosa: We’ve seen how this paper on "Day-Ahead Electricity Price Forecasting Using a Multivariate Group Lasso Method" proposes using CING-LEAR to tackle the complex cross-hour group effects in electricity pricing signals.

Dev: Basically, they take the LEAR model and extend it into a multivariate setting, using a Group Lasso regularizer to jointly select features across all hourly outputs, which they say captures those persistent influences better than previous methods.

Taro: The big implication seems to be that you need models that explicitly account for how variables influence prices together across different time blocks, not just hour by hour independently.

Rosa: It suggests that the way we structure our predictors matters immensely when dealing with electricity markets because those signals are inherently structured in a group sense.

Dev: The authors found this works well on real data from CAISO, showing improvements in point and probabilistic forecast metrics compared to other models like LEAR and DNN.

Taro: So for someone just listening to the show, it means that when you try to predict electricity prices, focusing on the whole pattern across hours instead of just the isolated hour might be a smarter way to build your forecasting system.

Conclusion: Rosa: So, to wrap up this part, we’re looking at how this paper uses a multivariate statistical method called CING-LEAR to forecast electricity prices by grouping features across hours.

Dev: Yeah, Rosa, it’s about taking those complex cross-hour patterns in energy signals and using a Group Lasso regularizer to make sense of them.

Rosa: The title itself, "Day-Ahead Electricity Price Forecasting Using a Multivariate Group Lasso Method," sounds pretty technical for what they're doing. What does that actually mean for someone who just needs to know if their electricity bill is going up next week?

Dev: It means they’re tackling the fact that price isn't just about what happens in one hour; it’s about how a feature affects prices across several consecutive hours, and this model tries to capture that relationship together.

Rosa: So, instead of looking at each hour separately, this approach looks at how a specific variable impacts the entire block of time they’re predicting. Taro, you look at autonomy stuff—does this mean the system is actually smart enough to handle when things get weird in the energy grid?

Taro: It suggests that when the underlying economic drivers are changing across different time periods, a model that treats those features as one group makes sense for capturing that shift in behavior.

Dev: From a loop rate standpoint, it’s interesting because they’re doing this joint selection of features across all the outputs at once instead of just picking the best feature for each individual hour prediction.

Rosa: And the results show it outperforms other methods on real data, which is good, but I always wonder how long this kind of structural understanding holds up when you move from a lab setting to actual grid operation.

Taro: That’s a big question for autonomy; if the system learns these deep cross-time dependencies, can it adapt to unexpected operational failures or sudden market shocks without needing a complete retraining cycle?

Dev: The authors mention training using sliding windows over different lengths—from short term up to three years—which hints at how robust they’re trying to make this method against varying time scales.

Rosa: It makes you wonder if the future of forecasting is less about finding one perfect model and more about building these kinds of flexible, structurally aware systems that can handle the messiness we see in real-world energy data.

More episodes

← Home