We introduce a novel structured formulation, the *Locally Observable Markov Decision Process*, which assumes that partial observability stems from limited sensor range---objects outside sensor range are unobserved, but become fully observed once they are within sensor range.