A Quantitative Comparison of Deep Reinforcement Learning Algorithms for Type 1 Diabetes Control
Baldisseri, F.; Atanasious, M.; Becchetti, V.; Di Paola, A.; Lops, G.; Menegatti, D.; Wrona, A.; Mascolo, S.; Priscoli, F.
Abstract
Type 1 diabetes is a growing global health challenge. Standard clinical practice often relies on manual insulin injections, which can lead to suboptimal glucose regulation. Recent advancements have shifted focus towards Artificial Pancreas systems, integrating continuous glucose monitoring with automated insulin delivery. This work presents a quantitative comparison of four Deep Reinforcement Learning algorithms for autonomous glycemic regulation via insulin injection: DDPG, PPO, SAC, and TD3. The validation is conducted using the Hovorka model, in presence of uncertainties on number, time and amount of meals. Results show that all four controllers are able to maintain blood glucose levels within the target range. The TD3 algorithm outperforms the others in terms of several key performance indicators such as time in range, time in hypo/hyperglycemia and total insulin usage, while also exhibiting fewer hyperglycemic episodes compared to prior works in academic literature.