Value Function

A function that estimates the expected cumulative reward from a given state (state-value function V) or state-action pair (action-value function Q). Value functions are central to RL — they guide action selection and policy improvement. Deep RL uses neural networks to approximate value functions. In robotics, learned value functions can serve as cost-to-go estimates for planning and as safety critics.