Coupled Exploration of High-Dimensional Images and Hierarchical Embeddings

Analysis plugin for coupling views of HSNE embeddings and high dimensional images in the ManiVault visual analytics framework.

git clone --recurse-submodules https://github.com/ManiVaultStudio/ImageEmbeddingCoupling.git

Two plugins are build: An analysis plugin that computes HSNE embeddings, and a slightly modified image viewer based on the ManiVault image viewer by Thomas Kroes. The HSNE computation performed with HDILibSlim, a slightly modified HDILib by Nicola Pezzotti and Thomas Höllt. Build the project with the same generator as the ManiVault core, see instructions here. Use vcpkg for other dependencies.

References

This plugin implements methods presented in Interactions for Seamlessly Coupled Exploration of High-Dimensional Images and Hierarchical Embeddings (2023), published at Vision, Modeling, and Visualization 2023 (pdf). The conference talk recording and other supplemental material are available here.

@inproceedings{Vieth23,
  title        = {{Interactions for Seamlessly Coupled Exploration of High-Dimensional Images and Hierarchical Embeddings}},
  author       = {Vieth, Alexander and Lelieveldt, Boudewijn and Eisemann, Elmar and Vilanova, Anna and H\"{o}llt, Thomas},
  year         = 2023,
  booktitle    = {Vision, Modeling, and Visualization},
  publisher    = {The Eurographics Association},
  doi          = {10.2312/vmv.20231227},
  isbn         = {978-3-03868-232-5},
  editor       = {Guthe, Michael and Grosch, Thorsten}
}