From Small Data to MMM-Style Budget Decisions: Reproducible Conjugate Bayesian Log-Response Regression with ElasticNet Benchmarks and Explainable Budget Scenario Rollouts

Authors

  • Yifei Lu University of California San Diego
  • Jinyi Mu University of California San Diego
  • Arthur Lefebvre University of California San Diego

DOI:

https://doi.org/10.32664/j-intech.v14i02.2262

Keywords:

bayesian linear progression, budget allocation, elasticnet, Marketing Mix Modelling, sensitive analysis

Abstract

Marketing mix modeling (MMM) is often treated as a large-sample, time-series task, but many organizations must make near-term budget decisions with limited historical data. This study develops a reproducible small-sample MMM-style workflow using the public ISLR Advertising.csv dataset (n=200 markets; TV, radio, newspaper spend; sales). Reproducibility is ensured by using a public dataset, fixed random seeds, explicitly stated preprocessing, analysis scripts supplied with the manuscript, and specified Python libraries. The workflow combines predictive benchmarking and prescriptive decision support. First, OLS, Ridge, Lasso, and ElasticNet are evaluated under 5-fold cross-validation and a fixed 80/20 hold-out split. Second, a conjugate Bayesian regression on log(1+spend) features models diminishing returns and yields closed-form posterior and Student-t predictive distributions. Third, for each total budget B, the allocation that maximizes the posterior mean prediction is solved under non-negativity, budget-balance, and observed-maximum channel caps; posterior samples are then evaluated at each optimized allocation to form 90% credible bands for the budget-sales curve. On the fixed split, test RMSE ranges from 1.829 to 1.871, while 100 repeated splits indicate that raw-feature OLS is most accurate on average (mean RMSE 1.671). At B=200, the bounded optimum allocates $147.25k to TV, $49.60k to radio, and $3.15k to newspaper, predicting 18.149 sales. The results suggest that, in small samples, regularization and log-response modeling mainly support stable, interpretable budget recommendations rather than improving point prediction alone.

References

[1] D. M. Hanssens, L. J. Parsons, and R. L. Schultz, Market Response Models. Econometric and Time Series Analysis, 2nd Edition. Boston, MA, USA: Kluwer Academic Publishers, 2001.

[2] Y. Jin, Y. Wang, Y. Sun, D. Chan, and J. Koehler, “Bayesian Methods for Media Mix Modeling with Carryover and Shape Effects,” 2017.

[3] J. Runge, I. Skokan, G. Zhou, and K. Pauwels, “Packaging up media mix modeling: An introduction to Robyn’s open-source approach,” 2024.

[4] G. James, D. Witten, T. Hastie, and R. Tibshirani, An Introduction to Statistical Learning, vol. 103. New York, NY: Springer New York, 2013. doi: 10.1007/978-1-4614-7138-7.

[5] G. James, D. Witten, T. Hastie, and R. Tibshirani, “ISLR Data Sets: Advertising.csv.”

[6] H. Zou and T. Hastie, “Regularization and Variable Selection Via the Elastic Net,” J. R. Stat. Soc. Series B Stat. Methodol., vol. 67, no. 2, pp. 301–320, Apr. 2005, doi: 10.1111/j.1467-9868.2005.00503.x.

[7] R. Tibshirani, “Regression Shrinkage and Selection Via the Lasso,” J. R. Stat. Soc. Series B Stat. Methodol., vol. 58, no. 1, pp. 267–288, Jan. 1996, doi: 10.1111/j.2517-6161.1996.tb02080.x.

[8] A. E. Hoerl and R. W. Kennard, “Ridge Regression: Biased Estimation for Nonorthogonal Problems,” Technometrics, vol. 12, no. 1, pp. 55–67, Feb. 1970, doi: 10.1080/00401706.1970.10488634.

[9] T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. New York, NY: Springer New York, 2009. doi: 10.1007/978-0-387-84858-7.

[10] M. Stone, “Cross-Validatory Choice and Assessment of Statistical Predictions,” J. R. Stat. Soc. Series B Stat. Methodol., vol. 36, no. 2, pp. 111–133, Jan. 1974, doi: 10.1111/j.2517-6161.1974.tb00994.x.

[11] R. Kohavi, “A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection,” 1995, pp. 1137–1143.

[12] S. Arlot and A. Celisse, “A survey of cross-validation procedures for model selection,” Stat. Surv., vol. 4, no. none, Jan. 2010, doi: 10.1214/09-SS054.

[13] M. W. Browne, “Cross-Validation Methods,” J. Math. Psychol., vol. 44, no. 1, pp. 108–132, Mar. 2000, doi: 10.1006/jmps.1999.1279.

[14] P. Doyle and J. Saunders, “Multiproduct Advertising Budgeting,” Marketing Science, vol. 9, no. 2, pp. 97–113, May 1990, doi: 10.1287/mksc.9.2.97.

[15] P. J. Danaher and T. S. Dagger, “Comparing the Relative Effectiveness of Advertising Channels: A Case Study of a Multimedia Blitz Campaign,” Journal of Marketing Research, vol. 50, no. 4, pp. 517–534, Aug. 2013, doi: 10.1509/jmr.12.0241.

[16] S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2004. doi: 10.1017/CBO9780511804441.

[17] A. Gelman, J. B. Carlin, H. S. Stern, D. B. Dunson, A. Vehtari, and D. B. Rubin, Bayesian Data Analysis. Chapman and Hall/CRC, 2013. doi: 10.1201/b16018.

[18] T. Miller, “Explanation in artificial intelligence: Insights from the social sciences,” Artif. Intell., vol. 267, pp. 1–38, Feb. 2019, doi: 10.1016/j.artint.2018.07.007.

[19] R. Venkatesan, P. W. Farris, and R. T. Wilcox, Marketing Analytics. University of Virginia Press, 2021. doi: 10.2307/j.ctv1bd4mz9.

[20] N. Arora, R. Berman, E. Feit, D. Hanssens, A. Li, M. Lovett, C. Mela, K. Wilbur, and J. Lynch, “Charting the Future of Marketing Mix Modeling Best Practices,” 2023.

[21] P. S. H. Leeflang, P. C. Verhoef, P. Dahlström, and T. Freundt, “Challenges and solutions for marketing in a digital era,” European Management Journal, vol. 32, no. 1, pp. 1–12, Feb. 2014, doi: 10.1016/j.emj.2013.12.001.

[22] C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.

[23] F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay, “Scikit-learn: Machine Learning in Python,” Journal of Machine Learning Research, vol. 12, pp. 2825–2830, 2011.

[24] P. Virtanen, R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy, D. Cournapeau, E. Burovski, P. Peterson, W. Weckesser, J. Bright, S. J. van der Walt, M. Brett, J. Wilson, K. J. Millman, N. Mayorov, A. R. J. Nelson, E. Jones, R. Kern, E. Larson, C. J. Carey, et al., “SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python,” Nat. Methods, vol. 17, pp. 261–272, 2020.

[25] P. A. Naik and K. Raman, “Understanding the Impact of Synergy in Multimedia Communications,” Journal of Marketing Research, vol. 40, no. 4, pp. 375–388, Nov. 2003, doi: 10.1509/jmkr.40.4.375.19385.

[26] Y. Lu, H. Zhou, and Y. Zhang, “A Constrained, Data-Driven Budgeting Framework Integrating Macro Demand Forecasting and Marketing Response Modeling,” Journal of Technology Informatics and Engineering, vol. 4, no. 3, pp. 493–520, Dec. 2025, doi: 10.51903/jtie.v4i3.466.

[27] Z. Yahia and M. ElBolok, “A stochastic nonlinear programming model for budget mix optimization of digital marketing campaigns under uncertainty,” Future Business Journal, vol. 11, art. 238, Dec. 2025, doi: 10.1186/s43093-025-00664-x.

Downloads

Published

2026-06-29