We argue that the demand of background independence in a quantum theory of gravity calls for an extension of standard geometric quantum mechanics. We discuss a possible kinematical and dynamical generalization of the latter by way of a quantum covariance of the state space. Specifically, we apply our scheme to the problem of a background independent formulation of matrix theory.