Using Dependency Parses to Augment Feature Construction for Text Mining

Simple item page
dc.contributor.authorGuo, Shengen
dc.contributor.committeechairRamakrishnan, Narenen
dc.contributor.committeememberFox, Edward A.en
dc.contributor.committeememberHelm, Richard F.en
dc.contributor.committeememberMurali, T. M.en
dc.contributor.committeememberZaki, Mohammed J.en
dc.contributor.departmentComputer Scienceen
dc.date.accessioned2014-03-14T20:13:09Zen
dc.date.adate2012-06-18en
dc.date.available2014-03-14T20:13:09Zen
dc.date.issued2012-05-02en
dc.date.rdate2012-06-18en
dc.date.sdate2012-06-15en
dc.description.abstractWith the prevalence of large data stored in the cloud, including unstructured information in the form of text, there is now an increased emphasis on text mining. A broad range of techniques are now used for text mining, including algorithms adapted from machine learning, NLP, computational linguistics, and data mining. Applications are also multi-fold, including classification, clustering, segmentation, relationship discovery, and practically any task that discovers latent information from written natural language. Classical mining algorithms have traditionally focused on shallow representations such as bag-of-words and similar feature-based models. With the advent of modern high performance computing, deep sentence level linguistic analysis of large scale text corpora has become practical. In this dissertation, we evaluate the utility of dependency parses as textual features for different text mining applications. Dependency parsing is one form of syntactic parsing, based on the dependency grammar implicit in sentences. While dependency parsing has traditionally been used for text understanding, we investigate here its application to supply features for text mining applications. We specifically focus on three methods to construct textual features from dependency parses. First, we consider a dependency parse as a general feature akin to a traditional bag-of-words model. Second, we consider the dependency parse as the basis to build a feature graph representation. Finally, we use dependency parses in a supervised collocation mining method for feature selection. To investigate these three methods, several applications are studied, including: (i) movie spoiler detection, (ii) text segmentation, (iii) query expansion, and (iv) recommender systems.en
dc.description.degreePh. D.en
dc.identifier.otheretd-06152012-070746en
dc.identifier.sourceurlhttp://scholar.lib.vt.edu/theses/available/etd-06152012-070746/en
dc.identifier.urihttp://hdl.handle.net/10919/28046en
dc.publisherVirginia Techen
dc.relation.haspartGuo_Sheng_D_2012.pdfen
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectdependency parsingen
dc.subjecttext miningen
dc.subjectlinguistic cuesen
dc.titleUsing Dependency Parses to Augment Feature Construction for Text Miningen
dc.typeDissertationen
thesis.degree.disciplineComputer Scienceen
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen
thesis.degree.leveldoctoralen
thesis.degree.namePh. D.en

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Guo_Sheng_D_2012.pdf
Size:
1.54 MB
Format:
Adobe Portable Document Format
Download

Collections

Doctoral Dissertations