Sci Simple

New Science Research Articles Everyday

# Computer Science # Machine Learning # Distributed, Parallel, and Cluster Computing

Forecasting Demand in the Advertising World

Learn how Multi-Stage HiFoReAd improves demand forecasting accuracy for businesses.

Zhengchao Yang, Mithun Ghosh, Anish Saha, Dong Xu, Konstantin Shmakov, Kuang-chih Lee

― 6 min read


Demand Forecasting Demand Forecasting Simplified predictions. Unlock accuracy in advertising demand
Table of Contents

In today’s fast-paced world, businesses need to plan ahead. Whether it’s predicting how many widgets to make, or how much pasta to stock in the grocery store, understanding future demand is key to success. This is especially true in the advertising world, where companies need to know how many ads to create and how to allocate resources effectively. That’s where Demand Forecasting comes in, acting like a crystal ball for companies trying to figure out what to expect in the future.

The Importance of Accurate Forecasts

Accurate demand forecasting helps companies avoid both overstocking and stockouts. Overestimating demand can lead to surplus stock that may go unsold, while underestimating can result in missed sales opportunities. For advertisers, knowing the expected demand allows them to make informed decisions about their campaigns and budgets. Despite the importance of accurate forecasting, it can often be a tricky task, especially with large amounts of data and numbers flying around like confetti at a New Year’s party.

What is Hierarchical Forecasting?

Hierarchical forecasting is like a well-organized family tree for data. Imagine a parent at the top and children below, each representing a different level of data. This structure helps businesses see how individual components relate to one another. For example, at the top level, you may have total ad spend, while the next levels might break this down into different product categories, regions, or time periods. By analyzing each of these levels, organizations can gain deeper insights, like how many holiday ads need to run in Florida versus California.

The Challenges of Traditional Forecasting

Traditional forecasting methods can fall flat. Think of it this way: if you only ask one person for their opinion about a restaurant, and they hate it, you might miss out on a great dining experience. Similarly, methods that look at each level of a hierarchy separately might miss crucial connections between them. They might give you a coherent forecast, but accuracy could be sacrificed, especially for lower levels in the hierarchy. This can lead to forecasts that are as useful as a chocolate teapot.

Moreover, businesses face numerous factors that complicate forecasting. Market trends might change like a teenager’s mood, data quality might be inconsistent, and sometimes forecasts just don’t add up across different levels. It’s like trying to balance a seesaw with one person much heavier than the other!

The Need for a New Approach

With so many challenges in demand forecasting, there was a need for a new approach that tackles these issues head-on. Enter the “Multi-Stage Hierarchical Forecasting Reconciliation and Adjustment” framework, or “Multi-Stage HiFoReAd” for short. This fancy name may sound like a mouthful, but it promises to take forecasting up a notch, or two.

How Multi-Stage HiFoReAd Works

This innovative framework is designed to improve the process of forecasting demand across different levels of a hierarchy. It does this through several key stages that help ensure coherence and accuracy.

Stage 1: Gathering Diverse Insights

First, the system collects a variety of forecasts using advanced statistical techniques. By combining different modeling methods, it creates base forecasts that are more robust than if just one method was used. Think of it like asking a group of friends for restaurant recommendations instead of relying on just one picky eater. More opinions lead to better decisions!

Stage 2: Top-Down Reconciliation

In this stage, the initial forecasts are organized. Using a top-down method, the framework looks at the overall picture and breaks it down into smaller parts. This means it can take the total demand prediction and allocate it to different departments or regions. It’s like taking a big pizza and slicing it into individual pieces for everyone to enjoy.

Stage 3: Harmonizing Forecasts

Next, the framework checks for Seasonality – those predictable patterns in demand that happen during particular times of the year—like a brief summer romance that comes back every year. By making adjustments based on these seasonal patterns, forecasts become even more accurate.

Stage 4: Ensuring Coherence Across Levels

After harmonizing forecasts, the framework uses a technique known as reconciliation. This step ensures that the demand predictions across different levels of the hierarchy make sense together. For example, if the total forecast says you need 100 ads but the breakdown suggests only 80 ads will be created, something is clearly off—like a jigsaw puzzle missing pieces!

Stage 5: Final Adjustments

Finally, the last stage of the HiFoReAd framework involves final adjustments, where forecasted values are fine-tuned to reflect the most accurate picture possible. This last step is what turns a good forecast into a great one!

Real-World Application and Benefits

In real-world scenarios, the Multi-Stage HiFoReAd framework has shown significant improvements in accuracy when predicting ad demand. It has been tested on various datasets, proving its capability to adapt to different situations, much like a chameleon changing colors.

Testing the Framework

Experiments conducted using internal and public datasets have demonstrated that the framework not only improves accuracy but also maintains coherence across levels. In fact, results showed reductions in Absolute Percentage Error (APE). In simple terms, HiFoReAd helped make predictions that were much closer to reality, leading to fewer missteps in resource allocation and planning.

Lessons from the Framework

One of the key lessons from implementing the Multi-Stage HiFoReAd framework is the importance of tackling forecasting as a collaborative effort. Much like a well-rehearsed choir, where each voice complements the other, a combination of different methods can lead to more harmonious and accurate results.

Response to Industry Needs

As businesses need to stay nimble and adapt to fast changes, scalable solutions are essential. The HiFoReAd framework stands out in its ability to handle large datasets efficiently, thanks to distributed computing. Picture juggling several balls at once; the framework ensures none of them hit the ground!

Future Directions

Looking ahead, there’s always room for improvement. In research and development, there’s an ongoing effort to refine forecasting techniques further. Ideas for enhancing the Multi-Stage HiFoReAd framework might include integrating even more advanced machine learning methods and exploring how to better handle new data types and structures.

Conclusion: Forecasting, Simplified

In conclusion, demand forecasting, especially in advertising, is no small task. However, by employing innovative frameworks like Multi-Stage HiFoReAd, businesses can better prepare for the future. Just as one wouldn’t head out into a rainstorm without an umbrella, companies shouldn’t navigate the complex world of advertising without a solid forecasting strategy. With the right tools in hand, like a trusty umbrella, businesses can weather any storm and achieve their goals.

So next time you think about forecasts, picture those slices of pizza and the happy faces around the table. With the right approach to demand forecasting, everyone can enjoy a piece of the pie!

Original Source

Title: A Comprehensive Forecasting Framework based on Multi-Stage Hierarchical Forecasting Reconciliation and Adjustment

Abstract: Ads demand forecasting for Walmart's ad products plays a critical role in enabling effective resource planning, allocation, and management of ads performance. In this paper, we introduce a comprehensive demand forecasting system that tackles hierarchical time series forecasting in business settings. Though traditional hierarchical reconciliation methods ensure forecasting coherence, they often trade off accuracy for coherence especially at lower levels and fail to capture the seasonality unique to each time-series in the hierarchy. Thus, we propose a novel framework "Multi-Stage Hierarchical Forecasting Reconciliation and Adjustment (Multi-Stage HiFoReAd)" to address the challenges of preserving seasonality, ensuring coherence, and improving accuracy. Our system first utilizes diverse models, ensembled through Bayesian Optimization (BO), achieving base forecasts. The generated base forecasts are then passed into the Multi-Stage HiFoReAd framework. The initial stage refines the hierarchy using Top-Down forecasts and "harmonic alignment." The second stage aligns the higher levels' forecasts using MinTrace algorithm, following which the last two levels undergo "harmonic alignment" and "stratified scaling", to eventually achieve accurate and coherent forecasts across the whole hierarchy. Our experiments on Walmart's internal Ads-demand dataset and 3 other public datasets, each with 4 hierarchical levels, demonstrate that the average Absolute Percentage Error from the cross-validation sets improve from 3% to 40% across levels against BO-ensemble of models (LGBM, MSTL+ETS, Prophet) as well as from 1.2% to 92.9% against State-Of-The-Art models. In addition, the forecasts at all hierarchical levels are proved to be coherent. The proposed framework has been deployed and leveraged by Walmart's ads, sales and operations teams to track future demands, make informed decisions and plan resources.

Authors: Zhengchao Yang, Mithun Ghosh, Anish Saha, Dong Xu, Konstantin Shmakov, Kuang-chih Lee

Last Update: 2024-12-19 00:00:00

Language: English

Source URL: https://arxiv.org/abs/2412.14718

Source PDF: https://arxiv.org/pdf/2412.14718

Licence: https://creativecommons.org/licenses/by/4.0/

Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.

Thank you to arxiv for use of its open access interoperability.

More from authors

Similar Articles