Tom Yeh

Tom Yeh

Assistant Professor

Department of Computer Science

University of Colorado at Boulder

projects

blind children reading a tacitle picture book with two adults

Tactile Picture Books

How can we design and make 3D tactile pictures for blind children?

students make books

Build a Better Book

How can students engage in STEM learning by making tactile picture books in libraries and schools?

models in a 3D printer

Human FabMachine Interaction

How can we co-design with a fabrication machine?

naturenet logo

NatureNet

How can we support community-driven environmental projects?

mindscribe prototype

Mindscribe

How can we empower preschoolers to tell their own stories?

a scene in the quantified self theater show

Speculative Fiction Project

How can we engage the public to deliberate on technological risk and ethics using art and narrative?

CraftML

CraftML

How can we support 3D modeling using HTML, CSS, and JavaScript?

sikuli slides concept

Sikuli Slides

How can GUI automation be as easy as making PowerPoint slides?

publications

Journal

Screen-based active user authentication

Mohammed E Fathy, Vishal M Patel, Tom Yeh, Yangmuzi Zhang, Rama Chellappa and Larry S Davis
Pattern Recognition Letters 2014
Journal

Screen Fingerprints: A Novel Modality for Active Authentication

Vishal Patel, Tom Yeh, Mohammed Salem, Yangmuzi Zhang, Yan Chen, Rama Chellappa and Larry Davis
IT Professional 2013
Full Paper

Inclusive Design of 3D Printed Tactile Picture Books in Indonesia

Abigale Stangl, Rebecca Johnson, Arum Putri Budiani and Tom Yeh
FabLearn Europe 2016
Full Paper

Like This, But Better: Supporting Novices' Design and Fabrication of 3D Models Using Existing Objects

Patrick Carrington, Shannon Hosmer, Tom Yeh, Amy Hurst and Shaun Kane
iConference 2015
Full Paper

Beyond the Flipped Classroom: Learning by Doing Through Challenges and Hack-a-thons

Mike Skirpan and Tom Yeh
SIGSCE 2015
Full Paper

Toward 3D-Printed Movable Tactile Pictures for Children with Visual Impairments

Jeeeun Kim and Tom Yeh
CHI 2015
Full Paper

Collect, Decompile, Extract, Stats, and Diff: Mining Design Pattern Changes in Android Apps

Khalid Alharbi and Tom Yeh
MobileHCI 2015
Full Paper

Transcribing Across the Senses: Community Efforts to Create 3D Printable Accessible Tactile Pictures for Young Children with Visual Impairments

Abigale Stangl, Caleb Hsu and Tom Yeh
ASSETS 2015
Full Paper

Crowdsourcing Design and Citizen Science Data using a tabletop in a nature preserve

Jenny Preece, Kazjon Grace, Carol Boston, Mary Lou Maher, Tom Yeh and Abigale Stangl
ECSM 2014
Full Paper

A process model for crowdsourcing design: A case study in citizen science

Kazjon Grace, Mary Lou Maher, Jenny Preece, Tom Yeh, Abigale Stangl and Carol Boston
DCC 2014
Full Paper

Abstracting Perception and Manipulation in End-User Robot Programming using Sikuli

Mike Kasper, Nikolaus Correll and Tom Yeh
TePRA 2014
Full Paper

Predicting Users' First Impressions of Website Aesthetics With a Quantification of Perceived Visual Complexity and Colorfulness

Katharina Reinecke, Tom Yeh, Luke Miratrix, Rahmatri Mardiko, Yuechen Zhao, Jenny Liu and Krzysztof Z. Gajos
CHI 2013
Full Paper

Co-designing an e-health tutorial for older adults

Bo Xie, Tom Yeh, Greg Walsh, Ivan Watkins and Man Huang
iConference 2012
Full Paper

Leveraging user comments for aesthetic aware image search reranking

Jose San Pedro, Tom Yeh and Nuria Oliver
WWW 2012
Full Paper

Correlating the Visual Representation of User Interfaces with their Internal Structures and Metadata

Tsung-Hsiang Chang, Tom Yeh and Rob Miller
UIST 2011
Full Paper

Creating Contextual Help for GUIs Using Screenshots

Tom Yeh, Tsung-Hsiang Chang, Bo Xie, Greg Walsh, Ivan Watkins, Krist Wongsuphasawat, Man Huang, Larry S. Davis and Benjamin B. Bederson
UIST 2011
Full Paper

Co-designing Contextual Tutorials for Older Adults on Searching Health Information on the Internet

Bo Xie, Tom Yeh, Greg Walsh, Ivan Watkins and Man Huang
ASIS&T 2011
Full Paper

A Case for Query by Image and Text Content: Searching Computer Help Using Screenshots and Keywords

Tom Yeh, Brandyn White, Jose San Pedro, Boriz Katz and Larry S. Davis
WWW 2011
Full Paper

VizWiz: Nearly Real-time Answers to Visual Questions

Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White and Tom Yeh
UIST 2010
Full Paper

Why Did the Person Cross the Road (There)? Scene Understanding using Probabilistic Logic Models and Common Sense Reasoning

Aniruddha Kembhavi, Tom Yeh and Larry S. Davis
ECCV 2010
Full Paper

GUI Testing Using Computer Vision

Tsung-Hsiang Chang, Tom Yeh and Rob Miller
CHI 2010
Full Paper

Sikuli: Using GUI Screenshots for Search and Automation

Tom Yeh, Tsung-Hsiang Chang and Rob Miller
UIST 2009
Full Paper

Fast Concurrent Object Localization and Recognition

Tom Yeh, John Lee and Trevor Darrell
CVPR 2009
Short Paper

Claudia Daudén Roquet; Jeeeun Kim; Tom Yeh

Dauden Roquet C, Kim J and Yeh T
DIS 2016
Short Paper

Write, Design, and 3D Print Tactile Stories for Visually Impaired: Critical Making in a Middle School Classroom

Abigale Stangl, Brian Jernigan and Tom Yeh
FabLearn 2015
Short Paper

3D Printed Tactile Picture Books for Children with Visual Impairments: A Design Probe

Abigale Stangl, Jeeeun Kim and Tom Yeh
IDC 2014
Short Paper

Exploring the internal state of user interfaces by combining computer vision techniques with grammatical inference

Paul Givens, Aleksandar Chakarov, Sriram Sankaranarayanan and Tom Yeh
ICSE 2013
Workshop

Evaluating Tactile User Experience with Tactile Picture Books for Children with Visual Impairment

Jeeeun Kim, Abigale Stangl, Ann Eisenberg and Tom Yeh
CHI 2014
Workshop

Active Inference for Retrieval in Camera Networks

Daozheng Chen, Mustafa Bilgic, Lise Getoor, David Jacobs, Lily Mihalkova and Tom Yeh
CVPRW 2011
Workshop

Web-Scale Computer Vision using MapReduce for Multimedia Data Mining

Brandyn White, Tom Yeh and Larry S. Davis
MDMKDD 2010
Work-in-Progress

A Study to Empower Children to Design Movable Tactile Pictures for Children with Visual Impairments

Jeeeun Kim, Hyunjoo Oh and Tom Yeh
TEI 2015
Work-in-Progress

Technology to Support Emergent Literacy Skills in Young Children with Visual Impairments

Abigale Stangl, Jeeeun Kim and Tom Yeh
CHI 2014
Work-in-Progress

Android apps consistency scrutinized

Khalid Alharbi, Sam Blackshear, Emily Kowalczyk, Atif M Memon, Bor-Yuh Evan Chang and Tom Yeh
CHI 2014
Work-in-Progress

Tactile Picture Books for Young Children with Visual Impairment

Jeeeun Kim, Abigale Stangl, Ann Eisenberg and Tom Yeh
TEI 2014

teaching

2015

CSCI5417: Information Retrieval

2015

CSCI4830 / CSCI7000: User-Centered Design and Development II

2014

CSCI4830 / CSCI7000: Rapid Prototyping

2014

CSCI4830: HCC Big Data

2013

CSCI4830 / CSCI7000: HCC Big Data

2013

CSCI4830 / CSCI7000: HCC Big Data

2012

CSCI7000: Technical Advances in User Interfaces

grants

2016 - 2017

CU Outreach Award PI

Tactile Picture Books: 50 Books Project

2016 - 2019

NSF ITEST PI

Designing Tactile Picture Books: Critical Making in Libraries to Broaden Participation in STEM

2015 - 2018

NSF AISL Co-PI

Innovations in Development: Community-Driven Projects That Adapt Technology for Environmental Learning in Nature Preserves

2015 - 2020

NSF CAREER PI

Adaptive Tactile Picture Books for Blind Children during Emergent Literacy

2014 - 2015

CU ATLAS Mini-Grant PI

Data Science for Social Good: Hackathons and Public Exhibits to Engage Students and Increase Campus Awareness

2014 - 2015

CU President's Fund for the Humanities PI

Public Tactile Art on Campus: Integrating Art and Engineering to Promote Universal Access

2014 - 2015

NSF EAGER Co-PI

Computational Model for Evaluating the Quality of Citizen Science Contributions

2014 - 2018

DARPA MUSE Co-PI

Mining and Understanding Bug Fixes to Address Application-Framework Protocol Defects

2013 - 2014

NSF AccessComputing Mini-Grant PI

Teaching Blind High School Students Programming via a Guessing Game

2013 - 2014

DARPA Active Authentication Co-PI

Visual Fingerprint for Active Authentication

2013 - 2015

DARPA APAC Co-PI

Specialized Binary Analysis for Vetting Android Apps Using GUI Logic

2013 - 2014

CU Outreach Award PI

Teaching 3D Printing to the Teachers and Parents of Blind Children

2012 - 2014

NSF VOSS Co-PI

Crowdsourcing Interaction Design for Citizen Science Virtual Organizations

2012 - 2013

DARPA Active Authentication Co-PI

Screen Fingerprint for Active Authentication

2012 - 2013

CU Diversity and Excellence Grant PI

Broadening Participation of Blind Students in Computer Science at CU through Scalable Game Design

awards

2015

Best Paper Nomination

MobileHCI

Collect, Decompile, Extract, Stats, and Diff: Mining Design Pattern Changes in Android Apps.

2015

National Science Foundation CAREER Award

NSF

Adaptive Tactile Picture Books for Blind Children during Emergent Literacy.

2014

Student Affairs Faculty of the Year

CU

The Student Affairs Faculty of the Year Award recognizes a superb faculty member that demonstrates outstanding engagement with students and contributions to the university community based on areas such as promoting diversity or fostering intellectual growth.

2013

Best Paper Nomination

CHI

Predicting Users' First Impressions of Website Aesthetics With a Quantification of Perceived Visual Complexity and Colorfulness.

2010

Best Paper Award

UIST

VizWiz: Nearly Real-time Answers to Visual Questions.

2009

Best Student Paper Award

UIST

Sikuli: Using GUI Screenshots for Search and Automation.

press

CU Outreach

Re-envisioning Reading with 3D-printed Picture Books

CU Engineering Magazine

Reading in 3D: Making Books for Visually Impaired Children

CU Engineering Library

3D-Printed Book Installation at the Gemmill Library

9 News

CU Creates 3D Book Program for Blind Children

ScienceDaily

Picture books for visually impaired kids go 3-D

3ders

3D Printed Tactile Picture Books for Visually Impaired Kids

Pink Giraffe

"Pink Giraffe" printed on a three dimensional printer. It's a Revolution in Education!

DailyCamera

CU-Boulder Researchers Create Children’s books with 3-D printing

Mashable

Imagining a New Way to Read, One 3D-Printed Book at a Time

DailyMail

Now you can FEEL the Cat in the Hat: Researchers use 3D printing to help blind children enjoy classic bedtime stories

Paths to Literacy

Tactile Picture Books Project

NanoWerk

3D-printed picture books for visually impaired children

NewsWeek

3-D Printing Enables Visually Impaired Children to Experience the World of Literary Classics

3D Imprimalia

Libros táctiles impresos en 3D para niños ciegos

Computer World

Seven ways DARPA is trying to kill the password

3D Hubs

Maker Talk: Creating tactile storybooks for children with visual impairment

NPR

Beyond Braille: 3-D Printed Books for The Blind

Women Makes Waves

The Tactile Picture Books Project. Bringing Books Alive for Visually-Impaired Children

A Few Stories for Children's Book Week

A book and a good lie down

Electric Literature

3-D Printed Storybooks for the Visually Impaired

New Scientist (Issue 2984)

3D-printed books make pictures real for blind children

Masters of Media

3D printing: a tool in revolutionizing the books for visually impaired children

DNA India

Picture books for the visually-impaired get a 3D boost

Hacker News

Sikuli: Write scripts using GUI buttons and screenshots

MataTrebd (Vol. 57)

Tangible Context 손으로 전달되는 컨텍스트

Westport News

Visionary technology: Westport Library's 3-D printer helps blind children read