Using Screenshots as a Medium to Support Knowledge Workers' Productivity

As computer users increasingly rely on digital tools for daily tasks, the complexity of their working environments continues to grow. Modern knowledge workers must navigate a diverse array of digital resources, including documents, websites, applications, and other information. This complexity presents challenges in managing multiple activities to maintain productivity, such as handling interruptions, resuming tasks, curating resources, recalling context, retrieving previously closed digital resources, and fostering self-reflection. Despite these challenges, there has been limited research on leveraging visual cues to help users reconstruct their previous mental contexts, retrieve digital resources, and enhance self-reflection for behavioral change. Therefore, this Ph.D. dissertation addresses these gaps by focusing on: (1) investigating the existing challenges users face in curating digital resources, (2) designing and implementing supportive applications for task resumption, (3) developing methods that utilize screenshots and metadata for reconstructing mental context and retrieving resources, and (4) enhancing the processes of self-reflection and behavioral change to improve overall productivity.