Login

Publications  •  Project Statistics

Glossary  •  Schools  •  Disciplines
People Search: 
   
Title/Abstract Search: 

Dissertation Information for P. Bryan Heidorn

NAME:
- P. Bryan Heidorn
- (Alias) Bryan Heidorn

DEGREE:
- Ph.D.

DISCIPLINE:
- Library and Information Science

SCHOOL:
- University of Pittsburgh (USA) (1997)

ADVISORS:
- Stephen Hirtle

COMMITTEE MEMBERS:
- James G. Williams
- Michael Lewis

MPACT Status: Fully Complete

Title: Natural language processing of visual language for image storage and retrieval

Abstract: A natural language processing system is constructed that can interpret text based descriptions of physical objects and create three-dimensional graphic models of the objects. The system design is based on the integration of current theories of human linguistic and visual processing. The system embodies principles for the representation and processing of objects and interpart relationships that permit communication between verbal and vision subsystems. The principles are primary dimensionality, partwise decomposition, and part relationship schematization. The meanings of some shape words such as "width" or "oval" are sensitive to the primary dimensionality of subject. Partwise decomposition simplifies communication by defining differences between complex objects as simple differences in their parts. The meanings of the relations between parts of an object are idealized into a simpler part relationship schematization with few attribute slots.

Domain knowledge and domain independent knowledge of physical part interactions are used to control semantic interpretation and build internal models of the meaning of the text. The domain independent knowledge includes mechanisms for processing selected shape and spatial descriptions. Semantic interpretation of language involves the selection of prototypical shapes from a three-dimensional domain model. Additional linguistic constructs specify modifications to the shape of the prototypes. In a controlled experiment, the system processed descriptions of leaves and acorns from a field guide. Subjects were able to match original text to computer generated images as well as they could match the text to the artist generated images of the objects from the same field guide. This finding is evidence for the descriptive adequacy and computational tractability of this approach to the integration of language and visual processing.

MPACT Scores for P. Bryan Heidorn

A = 1
C = 10
A+C = 11
T = 1
G = 1
W = 1
TD = 1
TA = 0
calculated 2012-07-30 12:26:37

Advisors and Advisees Graph

generating graph, please reload

Students under P. Bryan Heidorn

ADVISEES:
- Qin Wei - University of Illinois, Urbana-Champaign (2011)

COMMITTEESHIPS:
- Jianhua Dong - University of Illinois, Urbana-Champaign (2000)
- Qin He - University of Illinois, Urbana-Champaign (2001)
- Bharat Mehra - University of Illinois, Urbana-Champaign (2004)
- Hong Cui - University of Illinois, Urbana-Champaign (2005)
- Xiaoya Tang - University of Illinois, Urbana-Champaign (2007)
- Dinesh Rathi - University of Illinois, Urbana-Champaign (2008)
- Anatoliy Anatoliyovych Gruzd - University of Illinois, Urbana-Champaign (2009)
- Xiao Hu - University of Illinois, Urbana-Champaign (2010)
- Hong Zhang - University of Illinois, Urbana-Champaign (2011)
- Xin Xiang - University of Illinois, Urbana-Champaign (2011)