Visualization by Sketching, Analogy, and Computational Creativity

NSF 1218058
PI: Daniel Keefe, Co-PI Arthur Edrman
September 1, 2012 - August 31, 2016
National Science Foundation

NSF 1218058

Visualization by sketching

Left: New visualization design tools make it possible to simply sketch new fluid flow visualizations by drawing "on top of data" using a pen and a computer tablet.

Right: Exciting 3D sketching tools for using in virtual reality environments make it possible to design 3D virtual sculpture simply by sketching "in the air".

The goal of this research project is to transform the way that data visualizations are designed and created to enable more effective, creative, and accessible ways of communicating scientific information using computer graphics. The project enables artists, scientists, engineers, and others to rapidly design, generate, and iteratively refine visualizations of today's most complex datasets. The approach combines novel computational tools that enhance sketching, analogical reasoning, and other creative human design tasks with underlying scientific data and 3D displays. The results include new tools, algorithms, and guidelines, which are evaluated experimentally through challenging applications to biomedical engineering, such as visualizing multidimensional imaging and modeling data to understand interactions between proposed new medical devices and human tissues. These results are significant because they lead to new understandings of how computation and human creativity can be most effectively combined in general, and specifically, how they can be combined to help scientists visualize and understand complex multidimensional data.

The broader impacts of the work lie in educational efforts integrated with the experimental research and broad applications of the new methods developed. Students from local art and design colleges are educated in scientific methods, opening up new career paths in the sciences for these visual experts. Hands-on educational research demonstrations are conducted in the local community. Through specific applications, the work yields insights that can improve and accelerate science, engineering, and healthcare. Project results, including new curriculum developed, open source software, videos, publications, and demos, will be disseminated on this website.

Spotlights
Publications
2023
Ph.D. Theses
Physical Rendering Processes for More Graspable Extended Reality Data Visualizations
Bridger Herman. Ph.D. Thesis, University of Minnesota.
Tags:
#art‑and‑vis
#immersive‑vis
#data‑physicalization
#xr‑user‑interfaces
#nsf‑vis‑by‑sketching
#bherman
#phdthesis
#2023
2022
Ph.D. Theses
Everyday Scientific Visualization: Making 3D Visualization Techniques Accessible for Day-To-Day Team-Science Collaboration and Analysis
Jung Nam. Ph.D. Thesis, University of Minnesota.
Tags:
#ensemble‑vis
#immersive‑vis
#xr‑user‑interfaces
#inward‑vr
#usda‑vr‑forestry
#nsf‑vis‑by‑sketching
#jnam
#phdthesis
#2022
2021
Ph.D. Theses
Seeing and Working with 3D Data in Virtual Reality
Kyungyoon Kim. Ph.D. Thesis, University of Minnesota.
Tags:
#motion‑vis
#ensemble‑vis
#immersive‑vis
#xr‑user‑interfaces
#nsf‑career
#nsf‑vis‑by‑sketching
#kkim
#phdthesis
#2021
2020
Ph.D. Theses
Palpable Visualizations: Techniques for Creatively Designing Discernible and Accessible Visualizations Grounded in the Physical World
Seth Alan Johnson. Ph.D. Thesis, University of Minnesota.
Tags:
#art‑and‑vis
#immersive‑vis
#data‑physicalization
#nsf‑sculpting‑vis
#nsf‑vis‑by‑sketching
#sjohnson
#phdthesis
#2020
2017
Workshops, Panels, Other Events Organized
2016
Journal and Conference Articles
Invited Talks
Magic User Interfaces: Interactivity in Immersive Science and Art
Daniel F. Keefe. International Symposium on Visual Computing.

Keynote Address

Tags:
#ensemble‑vis
#immersive‑vis
#3d‑painting
#nsf‑vis‑by‑sketching
#nsf‑career
#nsf‑bigdata
#dkeefe
#talk
#2016
Workshops, Panels, Other Events Organized
2014
Journal and Conference Articles
Ph.D. Theses
Invited Talks
Workshops, Panels, Other Events Organized
2013
Journal and Conference Articles
Invited Talks
Hands-On Visual Computing for Science, Engineering, and Art
Daniel F. Keefe. Midwest Instruction and Computing Symposium.

Keynote Address

Tags:
#immersive‑vis
#xr‑user‑interfaces
#nsf‑vis‑by‑sketching
#nsf‑career
#dkeefe
#talk
#2013
Workshops, Panels, Other Events Organized
Meet the Scientists
Francesca Samsel, and Daniel F. Keefe. Workshop at College Art Association Annual Meeting.
Tags:
#art‑and‑vis
#nsf‑vis‑by‑sketching
#nsf‑career
#dkeefe
#organized
#2013
2012
Journal and Conference Articles
Workshop Papers
Invited Talks
Workshops, Panels, Other Events Organized
Miscellaneous
VisWeek Art Show Catalog 2012
Daniel F. Keefe, Bruce Campbell, and Lauren Thorson. IEEE VisWeek 2012, October 14–19, Seattle, WA.
Tags:
#art‑and‑vis
#nsf‑career
#nsf‑vis‑by‑sketching
#dkeefe
#lthorson
#misc
#2012
Themes
Lab Members