Retractions and tangent charts
A retraction moves a point of a manifold along a tangent vector; it makes each tangent space a chart around its point, and gives the operations ⊕ and ⊖.
Estimation moves points. On a step is an addition, ; on a curved manifold, such as the rotations or the unit sphere, there is no addition, and a retraction takes its place. This note defines it, shows how it turns every tangent space into a chart, and introduces the notation and used throughout these notes.
The definition#
Let be a smooth manifold of dimension . In computation, a tangent space is never handled abstractly: each is identified with by a basis chosen smoothly in , and a tangent vector is a column of numbers. We assume such an identification throughout. Some manifolds have none that is smooth everywhere: by the hairy ball theorem, no smooth choice of tangent bases covers the whole sphere . There the identification is smooth on an open part of the manifold, and a computation stays inside it.
A retraction on a manifold of dimension is a smooth map , written , such that for every , with identified with ,
- , and
- the derivative of at is the identity: .
The definition is the one used in optimization on manifolds, where retractions replace the exponential map of a Riemannian manifold. The exponential map is a retraction, but so is any map that agrees with it to first order, which is usually cheaper. Nothing here needs a metric.
Two examples. On , . On the positive reals, with identified with by measuring relative change, : it is defined for every , never leaves the positive reals, and satisfies , which is the identity in the chosen identification (a tangent at of coordinate is the velocity ).
Tangent charts#
Because is invertible, the inverse function theorem makes a diffeomorphism from a neighbourhood of onto a neighbourhood of . So is a chart of around , the tangent chart at , and every point near has coordinates in it. As is common in robotics, we write
the second for in the neighbourhood where is invertible. In words, is where sits in the chart at . By construction,
for every in the chart’s domain, and for every in its image. On , and are addition and subtraction; on the positive reals above, .
The mirror identity#
On , as well: the step back from to is the reverse of the step forward. On a curved manifold it generally is not, because the left side is measured in the chart at the moved point , not at .
For small enough, .
Write and , the chart at read in the chart at . It is smooth near , with and, since , . Hence . The coordinate is the one with , so , and gives the claim.
∎The identity holds exactly in some cases: on , on the positive reals above, and on any Lie group whose retraction is , since then . It fails at second order for other retractions, and a computation that needs “the point whose coordinate is ” must not assume it.
A manifold whose retraction is , so that both identities hold exactly and every chart is the same affine chart, is called flat in these notes.
Built on by
- Derivatives in tangent charts The derivative of a map between manifolds, its gradient and its Hessian product, all read in the tangent charts a retraction provides, and why automatic differentiation computes them unchanged.
- Product manifolds A product of manifolds is a manifold whose tangent space stacks its factors', and whose retraction acts factor by factor; derivatives in its charts are block matrices of the factors'.
- The problem The mathematics the core rests on, from quantities, their charts and their products, through operations and their derivatives of first and second order composed over programs, to queries, terms, importance weights, random keys and retirement.