Extracting and Retargeting Color Mappings from Bitmap Images of Visualizations

Jorge Poco, Angela Mayhua, Jeffrey Heer
IEEE Transactions on Visualization and Computer Graphics · 2018 · August 29, 2018
Extracting and Retargeting Color Mappings from Bitmap Images of Visualizations

Automatic extraction and redesign of color mappings for a geographic heatmap. The bitmap image on the left uses a questionablerainbow color palette. Our methods automatically recover the color mapping, enabling applications such as automatic recoloring. Thegenerated image on the right replaces the original color palette with a perceptually-motivated diverging color scheme.

Publication Details

Venue
IEEE Transactions on Visualization and Computer Graphics
Year
2018
Publication Date
August 29, 2018
DOI
https://doi.org/10.1109/TVCG.2017.2744320

Materials

Abstract

Visualization designers regularly use color to encode quantitative or categorical data. However, visualizations "in the wild" often violate perceptual color design principles and may only be available as bitmap images. In this work, we contribute a method to semi-automatically extract color encodings from a bitmap visualization image. Given an image and a legend location, we classify the legend as describing either a discrete or continuous color encoding, identify the colors used, and extract legend text using OCR methods. We then combine this information to recover the specific color mapping. Users can also correct interpretation errors using an annotation interface. We evaluate our techniques using a corpus of images extracted from scientific papers and demonstrate accurate automatic inference of color mappings across a variety of chart types. In addition, we present two applications of our method: automatic recoloring to improve perceptual effectiveness, and interactive overlays to enable improved reading of static visualizations.

Cite this publication (BIBTEX)

@article{2018-ExtractingColorMappings, 
  title={Extracting and Retargeting Color Mappings from Bitmap Images of Visualizations}, 
  author={Jorge Poco and Angela Mayhua and Jeffrey Heer}, 
  journal={IEEE Transactions on Visualization and Computer Graphics}, 
  year={2018}, 
  url={https://doi.org/10.1109/TVCG.2017.2744320},
  date={2018-08-29},
  volume={24},
  issue={1}
}