Opinion Mining Summarization

Cortes Groman, Ernesto; Dunn, Kipp; Gregorczyk, Sar; Schmidt, Alex

Opinion Mining Summarization

dc.contributor.author	Cortes Groman, Ernesto	en
dc.contributor.author	Dunn, Kipp	en
dc.contributor.author	Gregorczyk, Sar	en
dc.contributor.author	Schmidt, Alex	en
dc.date.accessioned	2018-05-11T04:30:29Z	en
dc.date.available	2018-05-11T04:30:29Z	en
dc.date.issued	2018-05-10	en
dc.description.abstract	Opinion Mining Summarization is a Multimedia, Hypertext, and Information Access capstone project proposed by Xuan Zhang to Dr. Edward Fox. The purpose of the project is to generate a suite of tools that can generate useful data about products sold on the internet. The final goal is a suite of tools that, when given a product, can scrape the web for review data on that product and create easily accessible summaries of these reviews. This will allow the user to see the general opinion of online consumers on a given product. In our design phase, we divided the overall project into four main deliverables: a web-crawler, database, web application, and a suite of summarization tools (see inventory for more details). To begin our development process, we identified open source libraries that performed some of the functionality our tools would need. From these libraries, we were able to begin developing tools specific to the needs we identified during our research phase. We practiced test-driven development, frequently testing our tools on example websites and sample data, in order to ensure correctness and identify any needed design changes. For example, as the project progressed, simulated user testing identified the need for a more user-friendly way to interact with the tools. This led us to design a web application to provide a GUI for the program. Through this web application, it was planned that the user would be able to generate and browse product review summarizations, as well as start web-crawling requests in real time. At the conclusion of the project, we have a full, cohesive tool. Through the web application, the web-crawler Python scripts can be used, review and summarization data is stored in a MySQL database, a variety of Python summarization scripts can be run on review sets, and the results can be cleanly viewed. Throughout the process of this project, we learned a great deal about full-stack development. Everything we interacted with provided us with a new opportunity for learning and growth, whether it was Python scripting or the .NET framework. As well, integrating multiple tools written in different languages provided a new challenge for our team, beyond what we had experienced in previous classes. Overall, the start-to-finish completion of a major project was an excellent learning experience that will serve us well as we approach graduation and our future careers.	en
dc.description.notes	OpinionMiningSummarization.zip: Compressed file containing web application, web crawler, and summarization tools. OpinionMiningSummarizationPresentation.pdf: PDF file representation of the final presentation given. OpinionMiningSummarizationPresentation.pptx: Microsoft PowerPoint file representation of the final presentation given. OpinionMiningSummarizationReport.pdf: PDF file representation of the full project report. OpinionMiningSummarizationReport.docx: Microsoft Word document file representation of the full project report.	en
dc.identifier.uri	http://hdl.handle.net/10919/83217	en
dc.language.iso	en	en
dc.publisher	Virginia Tech	en
dc.rights	In Copyright	en
dc.rights.uri	http://rightsstatements.org/vocab/InC/1.0/	en
dc.subject	crawler	en
dc.subject	summarization	en
dc.subject	opinion mining	en
dc.subject	product reviews	en
dc.subject	LDA	en
dc.subject	extract	en
dc.title	Opinion Mining Summarization	en
dc.type	Presentation	en
dc.type	Report	en
dc.type	Software	en