From MDPs to general-utility MDPs

Bringing risk-awareness to general-utility MDPs

We motivate and explore risk-aware general-utility MDPs, where we aim to find an optimal policy with respect to a risk measure of the distribution of objective values induced by its interaction with the MDP.

August 2026 · Pedro P. Santos (based in joint work with Fábio Vital, Alberto Sardinha, and Francisco S. Melo)