中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
草图用户界面及其应用研究

文献类型:学位论文

作者杨海燕
学位类别博士
答辩日期2010-11-23
授予单位中国科学院研究生院
授予地点北京
导师戴国忠
关键词草图用户界面,草图信息描述,草图交互,界面模型
学位专业计算机应用技术
中文摘要伴随着计算机技术的发展,用户界面经历了一次次的变革。基于WIMP界面范式的图形用户界面以“所见即所得”的桌面隐喻方式表达计算机复杂、抽象的指令,成为划时代的革命。然而,随着计算机软件的功能和界面复杂程度的不断增加,传统WIMP界面逐渐不适宜于一些应用领域,随之发展起诸多新兴用户界面以满足新的需求,如三维界面、笔式界面等。其中,草图用户界面模拟传统纸笔的交互方式符合人们沿袭了几千年的习惯,因此近年来在概念设计、思维捕捉、3D建模、教学、计算机动画等领域得到了广泛的研究和应用。 然而,当前关于草图用户界面的研究仍然存在以下问题:关于草图界面的理论研究或侧重草图支撑技术的研究与实现,或侧重分析现有笔交互系统的基本功能需求,力图封装Ink操作,缺乏统一的理论模型与应用框架指导。关于草图界面的应用研究多集中于特定领域具体功能和技术的实现,缺乏对基于草图形式的人机交流方式的两个核心问题——草图信息表征与草图交互技术的研究。此外,很多关于草图应用系统与现有基于WIMP交互范式的图形用户界面相混合,其研究的重点并不在草图用户界面本身。本文正是从上述问题出发,围绕着草图用户界面从理论、方法与应用等方面展开研究。 本文首先综述了草图用户界面及其关键技术的研究进展,分析了草图用户界面应用研究所面临的两个核心问题——草图信息表征与草图交互技术。从认知心理学理论出发,分析了草图信息的表征特征和用户草图绘制时的行为特征,分别从信息、人以及人机之间的交互过程三个方面论述了草图信息描述模型、用户模型及交互策略。结合草图界面应用的领域相关性和无关性,研究了草图界面应用系统开发所应遵循设计目标和流程,并在草图界面模型指导下构建了草图界面统一应用框架。最后,分别以视频内容的组织与可视化和纺织行业的产品概念设计两个领域为典型应用环境,研究了面向各领域的草图信息表征方法与草图交互技术,以验证草图界面模型与应用框架的研究结果。 本文的创新点主要包括: 1.从信息、人、交互过程三个要素出发,构建了草图用户界面统一的界面模型与应用框架。 在传统用户界面模型研究的基础上研究了草图界面的理论模型。从人机交互的三要素——信息、人和交互出发,分析了草图信息的构成、基于草图交互的用户行为过程特征,阐述了基于分布式认知的用户模型和基于上下文感知的交互策略模型。进一步在此基础上结合草图界面应用的领域相关性和无关性,构建了草图界面应用框架。 2.提出了一种基于草图形式的视频内容表征方法,并在此基础上实现视频多种交互方式。 从人的认知角度出发研究了视频信息的基本认知特性和交互特性,分析了视频语义空间;结合草图信息的表征模型,构建了基于草图的视频语义表征方法。基于面向视频语义的草图视图,并研究了基于该草图视图的视频非线性组织和交互式浏览技术。实现了面向视频领域的草图界面应用原型系统StoryMap,并通过实验加以验证。 3.提出了一种基于草图的、面向设计过程的设计方案表征方法,并在基础上实现设计方案的灵活复用。 针对传统计算机辅助设计领域缺乏考虑设计过程中隐含的领域知识和过程信息的问题,提出了面向设计过程的草图信息建模方法。并在此基础上研究了设计活动中的草图交互推荐技术,以支持面向过程的设计方案复用。最后,实现了面向服装工艺设计的草图工艺图板系统,并通过实验加以验证。
英文摘要With the fast development of computer technology, User interface has made great progress in the past years. The graphical user interface (GUI), which is applied WIMP paradigm is one of the most critical inventions in the development of interface. It is generally designed based on desktop metaphor which can extremely reduce user’s cognitive burden. However, while software function and user interface have become more and more complicated, traditional WIMP based interface could not be appropriate to some applications. Several new types of interface have come out to adapt new requirements. Among which, Sketch based interface which provides natural and efficient interactions based on pen gesture has been widely used in many applications, such as conceptual design, brainstorms, 3D modeling, teaching and animation. However, there are still some challenges in the research of sketch based interface as follows. Firstly, most of researches pay little attention to the sketch based interface models and lack of theoretical guidance to the practice of interface design. Secondly, current sketch related researches focus on the realization of techniques and functions in specific domains, and are lack of research to the two key points of sketch based interaction bwtween human and computer: information representation and interaction. Finally, some researches use pen only for selecting or tapping, simply treat it as pointing device like mouse. Most of them are not real sketch based interface. Based on the challenges above, the thesis focuses on the research field of theoretical model, methodology and application in sketch based interface. First, the thesis gives an overview of the development of the sketch based interface and its key techniques, analyzes its typical applications as well as two basic key problems: sketch based information representation and interaction. Second, the thesis constructs sketch information model, user model and interaction model according to the features of sketch based interaction, also establishes a general framework to support development of sketch based applications. Then the thesis selects two typical application areas to verify the research results, one is video content organization and navigation, the other is conceptual design. In these two applications, both appropriate sketch representation and novel interaction techniques are discussed. The main creative contributions of this thesis can be summarized as follows: 1.General interface model and framework for sketch based interface. By analyzing deeply three key issues of interaction: information, human and interaction, the thesis discusses the structure of sketch information and user’s interaction behaviors, constructs a general sketch representation model, user model based on distributied cognition and interaction strategies based on context awareness for sketch application. Then a framework of sketch based interface which gives effective support to sketch application development is proposed. 2.Research on sketch based interface in video content organization and navigation application The thesis analyzes the characteristics of unstructured video data, provides sketch based video content description method according to sketch information model. Then it discusses non-linear organization and navigation techniques of video based on skech representation. Finally, a prototype based on sketch interface is provided to verify the research results. 3.Research on sketch based interace in conceptual design application With respect to the problems of conceptual design, the thesis disccuses sketch based design plan representation, and proposes a novel reuse method of design plan. Application examples are proposed at the last. Experiment results show that the methods mentioned above have values both in theory and in application.
学科主题计算机应用
语种中文
公开日期2010-11-25
源URL[http://124.16.136.157/handle/311060/5550]  
专题软件研究所_人机交互技术与智能信息处理实验室_学位论文
推荐引用方式
GB/T 7714
杨海燕. 草图用户界面及其应用研究[D]. 北京. 中国科学院研究生院. 2010.

入库方式: OAI收割

来源:软件研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。