Everything about Manifold regularization
Technique for shaping training datasets
In machine learning, manifold regularization is a technique for using the shape of a dataset to constrain the functions that should be learned on that dataset. In many machine learning problems, the data to be learned do not cover the entire input space. For example, a facial recognition system may not need to classify any possible image, but only the subset of images that contain faces. The technique of manifold learning assumes that the relevant subset of data comes from a manifold, a mathematical structure with useful properties. The technique also assumes that the function to be learned is smooth: data with different labels are not likely to be close together, and so the labeling function should not change quickly in areas where there are likely to be many data points. Because of this assumption, a manifold regularization algorithm can use unlabeled data to inform where the learned function is allowed to change quickly and where it is not, using an extension of the technique of Tikhonov regularization. Manifold regularization algorithms can extend supervised learning algorithms in semi-supervised learning and transductive learning settings, where unlabeled data are available. The technique has been used for applications including medical imaging, geographical imaging, and object recognition. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Manifold regularizationA 5-minute orientation
- Skim a recent paper: Pairwise constraints-based semi-supervised fuzzy clustering with multi-manifold regularizationInfluential work since 2022
- Pick up a classic book: Introduction to 3-maniflodsThe most-reprinted book on the subject
- Read the landmark paper: Discriminative Semi-Supervised Feature Selection Via Manifold RegularizationCited 312 times
- Go sideways: Proximal gradient methods for learningA closely related topic
- Go sideways: Kodaira–Spencer mapA closely related topic
📖 Definitions
No dictionary entry for this exact phrase.
🗂️ The subject at a glance
🏆 Landmark papers (most cited)
Discriminative Semi-Supervised Feature Selection Via Manifold Regularization
Ensemble Manifold Regularization
MixUp as Locally Linear Out-of-Manifold Regularization
Low-Rank Matrix Approximation with Manifold Regularization
Multiview Vector-Valued Manifold Regularization for Multilabel Image Classification
Enhancing Low-Rank Subspace Clustering by Manifold Regularization
Multi-view ensemble manifold regularization for 3D object recognition
Total Variation Regularization for Manifold-Valued Data
🆕 Influential since 2022
Pairwise constraints-based semi-supervised fuzzy clustering with multi-manifold regularization
Nonredundancy regularization based nonnegative matrix factorization with manifold learning for multiview data representation
Sparse multi-label feature selection via dynamic graph manifold regularization
Physical human locomotion prediction using manifold regularization
Robust Twin Bounded Support Vector Classifier With Manifold Regularization
📚 Books worth reading
Introduction to 3-maniflodsJennifer Schultens · 2014- 📕Analysis and Geometry in Several Complex VariablesShiferaw Berhanu, Nordine Mir · 2017
- 📕Geometric analysis of several complex variables and related topicsMarrakesh Workshop on Geometric Analysis of Several Complex Variables and Related Topics (2010 Marrakech, Morocco) · 2011
- 📕Analysis and geometry of metric measure spacesQuébec) Séminaire de Mathématiques Supérieures (50th 2011 Montréal · 2013
Mostly surfacesRichard Evan Schwartz · 2011- 📕Polytopes and Discrete GeometryGabriel Cunningham, Mark Mixer · 2021
- 📕Advances in Harmonic Analysis and Partial Differential EquationsDonatella Danielli, Irina Mitrea · 2020
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Proximal gradient methods for learning Proximal gradient (forward backward splitting) methods for learning is an area of research in optimization and statistical learning theory which studies…
- Kodaira–Spencer map In mathematics, the Kodaira–Spencer map, introduced by Kunihiko Kodaira and Donald C. Spencer, is a map associated to a deformation of a scheme or complex…
- Fractional Laplacian In mathematical analysis, the fractional Laplacian is an operator that generalizes the notion of the Laplace operator to fractional powers of spatial derivative…
- LPBoost Linear Programming Boosting (LPBoost) is a supervised classifier from the boosting family of classifiers. LPBoost maximizes a margin between training samples…
- Rigid rotor In rotordynamics, the rigid rotor is a mechanical model of rotating systems. An arbitrary rigid rotor is a 3-dimensional rigid object, such as a top. To…
- Kernel embedding of distributions In machine learning, the kernel embedding of distributions (also called the kernel mean or mean map) comprises a class of nonparametric methods in which…
- Lie derivative In differential geometry, the Lie derivative (/liː/ LEE), formulated by Władysław Ślebodziński and named after Sophus Lie, evaluates the change of a tensor…
- Spray (mathematics) In differential geometry, a spray is a vector field H on the tangent bundle TM that encodes a quasilinear second order system of ordinary differential…