Legacy display Course

V5E4 - Selected Topics in Scientific Computing (Summer Term 2016)

Low-rank tensor techniques

Prof. Dr. André Uschmajew

Low-rank tensor tensor techniques generalize low-rank matrix approximation to tensors of higher-order. They have established themselves as a powerful tool for addressing problems of very high dimension without having to face the curse of dimensionality. Typical problems include differential and eigenvalue equations whose solutions are functions of a large number of variables or parameters; they arise in quantum physics, computational chemistry, and stochastic or parametric PDEs. At the same time, low-rank tensor decompositions are successfully used in exploratory data analysis, signal processing, and statistics.

The key idea is old and simple: separation of variables. The sought solution is approximated by some structured linear combination of products of low-variate functions. This allows a data-sparse representation in a low-rank tensor format (of which there exist many) with a storage complexity that grows only linearly in the number of dimensions (variables) instead of exponentially. One can then design algorithms that solve the problem entirely in the chosen low-dimensional format.

In this lecture we introduce the basic concepts of this timely research field within numerical analysis. Intended topics include:

• tensor products of Hilbert spaces
• canonical tensor format
• tensor networks and tree tensor networks; examples: (hierarchical) Tucker, tensor trains
• high-order singular value decomposition for tree tensor networks
• topological and geometric aspects of low-rank varieties
• low-rank operators
• approximability and regularity, approximation by exponential sums
• basic ideas of corresponding optimization algorithms (block coordinate techniques, Riemannian optimization, rank-adaptive methods)

Prerequisites: numerical linear algebra / matrix analysis (in particular matrix norms, singular value decomposition), basic concepts of smooth manifolds and constrained optimization, spectral theory of compact operators on Hilbert spaces, basic Sobolev spaces (say L2 and Hs).

S4E2 - Graduate Seminar

The lecture is accompanied by an optional seminar for discussing additional topics.

In case of interest, please come to the first lecture or write an email.