ScrapingGenAI

Do, James; Bae, Heewoon; Colby, Julius

ScrapingGenAI

dc.contributor.author	Do, James	en
dc.contributor.author	Bae, Heewoon	en
dc.contributor.author	Colby, Julius	en
dc.date.accessioned	2024-05-10T22:46:47Z	en
dc.date.available	2024-05-10T22:46:47Z	en
dc.date.issued	2024-05-10	en
dc.description	ScrapingGenAIpresentation.pdf: PDF file for the ScrapingGenAI presentation. ScrapingGenAIpresentation.pptx: Powerpoint file for the ScrapingGenAI presentation. ScrapingGenAIreport.docx: Word document for the ScrapingGenAI report. ScrapingGenAIreport.pdf: PDF file for the ScrapingGenAI report.	en
dc.description.abstract	AI has been widely used for many years and has been a constant front-page news topic. The recent but fast development of generative AI inspired many conversations, from concerns to aspirations. Understanding how the topic develops and when people become more supportive of generative AI is critical for social scientists to pinpoint which developments inspire public discussions. The use of generative AI is relatively new. The data and insight gathered could be used to determine if use in a commercial setting (like in Travel/Hospitality) is viable and what the potential feedback from the public might look like. We developed two specialized web scrapers. The first targets specific keywords within Reddit subreddits to gauge public opinion, and the second extracts discussions from corporate earnings calls to capture the business perspective. The collected data were then processed and analyzed using Python libraries, with visualizations created in Matplotlib, Pandas, and Tkinter to depict trends through line charts, pie charts, and bar charts. We limited our analysis period from August 2022 to March 2024, which is significant as ChatGPT was released in November 2022, allowing us to observe notable changes. These tools not only show changes in public interest and sentiment but also provide a graphical representation of temporal shifts in the perception of AI technologies over time. The final product is designed for anyone interested in company transcripts and in comparing them to the public perspective. The product offers users access to detailed data representations, including numerical trends and visual summaries to further understand the correlation between the company and the public. This comprehensive overview assists in understanding how public and corporate sentiments towards AI have shifted during a recent 20-month period. A significant hurdle was using the PRAW API for Reddit data scraping. Through review of documentation, tutorials, and additional support from a teaching assistant, we successfully implemented the functionality needed to extract and process the data from subreddits effectively. To make our findings more accessible and engaging, future additional work transforming this product into a fully functional website would be beneficial. This platform would make the insights more readily available to a wider audience, including the general public and industry stakeholders. Doing so could enhance the impact and usefulness of our project.	en
dc.identifier.uri	https://hdl.handle.net/10919/118961	en
dc.language.iso	en	en
dc.rights	CC0 1.0 Universal	en
dc.rights.uri	http://creativecommons.org/publicdomain/zero/1.0/	en
dc.subject	Travel	en
dc.subject	Web-Scraping	en
dc.subject	Reddit	en
dc.subject	MarketBeat	en
dc.title	ScrapingGenAI	en
dc.type	Report	en
dc.type	Presentation	en