Product Defect Mining

Villaflor, Elizabeth M.; Golden, Grant D.; Hall, Jack W. W.; Nguyen, Thomas; Peng, Tianchen; Zhang, Shuaicheng

Product Defect Mining

dc.contributor.author	Villaflor, Elizabeth M.	en
dc.contributor.author	Golden, Grant D.	en
dc.contributor.author	Hall, Jack W. W.	en
dc.contributor.author	Nguyen, Thomas	en
dc.contributor.author	Peng, Tianchen	en
dc.contributor.author	Zhang, Shuaicheng	en
dc.date.accessioned	2017-05-16T21:25:50Z	en
dc.date.available	2017-05-16T21:25:50Z	en
dc.date.issued	2017-05-01	en
dc.description.abstract	This project is focused on customer reviews on various product defects. The goal of the project is to use machine learning algorithms to train on sets of these customer reviews in order to be able to easily identify the different defect entities within an unseen review. The identification of these entities will be beneficial to customers, product manufacturers, and governments as it will shed light on the most common defects for a certain product, as well as common defects across a class of products. Additionally, it will bring to light common resolutions for defect symptoms, including both correct and incorrect resolutions. This project also aims to make contributions to the opinion mining research community. These goals will be accomplished by breaking the project into three main parts: data collection, data labeling, and classifier training. In the data collection phase, a web crawler will be created to pull customer reviews off of forum sites in order to create new datasets. For data labeling, datasets, both pre-existing and newly created, will be split into sentences and be assigned a defect entity based on the content of the sentence. For example, if a sentence describes a product defect, the sentence will be labeled as a symptom, and so on. Finally, in the classifier training portion of the project, machine learning algorithms will be used to classify unlabeled datasets in order to learn what types of words indicate a certain defect entity. While these are the three main aspects of the project, there are other minor phases and categories of work that will be necessary. One of these sub-phases includes designing the database tables that will be used to store the labeled datasets. Throughout the semester the following was accomplished: the creation of a web crawler, the completion of five new datasets, the labeling of five datasets, and preliminary training results based on the linear SVC algorithm. Additionally, the new datasets and labeled datasets were uploaded into the client’s preexisting database. The new datasets were collected from the Apple Community, Samsung, and Dell forum boards and include product defect reports for both hardware and software products. Based on the labeling results, and quick scans of the collected data, it was found that many defect reports contain contextual information that is not directly related to the description of either a product defect or its corresponding solution. Additionally, it was found that many reports do not include resolutions or the resolution did not actual solve the defect described. The linear SVC algorithm used for classifier training was able to accurately predict the label for a sentence about 80% of the time when training and testing occurred on similar products, i.e. two different car models. However, the accuracy was only about 60% at best when used on two completely different products, i.e. cars vs cellphones. Overall, about 75% of the anticipated work was completed this semester. The work that was completed should provide a good foundation for continued work in the future.	en
dc.description.notes	Description of Files: ProductDefectMiningReport (Word Document and PDF) - the final report that outlines the project details, timeline, and process ProductDefectMiningPresentation (PowerPoint Presentation and PDF) - the final presentation that gives a brief overview of the project, project history, deliverables, and lessons learned. ProductDefectMiningFiles (ZIP archive) - includes all source code, scripts, and datasets used and created for this project.	en
dc.identifier.uri	http://hdl.handle.net/10919/77675	en
dc.language.iso	en_US	en
dc.publisher	Virginia Tech	en
dc.rights	Creative Commons CC0 1.0 Universal Public Domain Dedication	en
dc.rights.uri	http://creativecommons.org/publicdomain/zero/1.0/	en
dc.subject	Product Defect	en
dc.subject	Data Mining	en
dc.subject	Opinion Mining	en
dc.subject	Classifier Training	en
dc.subject	Machine Learning	en
dc.subject	Data Analytics	en
dc.subject	Web Crawler	en
dc.title	Product Defect Mining	en
dc.type	Dataset	en
dc.type	Presentation	en
dc.type	Report	en
dc.type	Software	en