Constrained Markov Decision Process

Author: Tianjiang Shuo

Website: https://cislunarspace.cn

Definition

Markov Decision Process with constraints, solved via Lagrange relaxation into an unconstrained MDP, used to minimize average per-device AoI under energy constraints.

Application Value

This concept has application value in cislunar space research and engineering practice, helping to understand core principles of the field.

Related Concepts

• Monte Carlo Trajectory Shooting, MCTS
• Powered Lunar Flyby, PLF
• Planar Circular Restricted Three-Body Problem, PCRTBP
• Insertion Delta-V

References

• Yuan 等 - 2024.