2024 · 12 citations · 27 references
ComputingComputer ScienceEducational TechnologyArtificial IntelligenceAssistive TechnologyHuman-computer InteractionContext-aware ComputingConversational InterfacesConversational User InterfacesHuman-machine InterfacesMobile Human-computer InteractionMultimodal InteractionCommandsEfficiencyIntelligent Virtual AssistantsInteractive Task ExecutionLarge Language ModelsTask Completion On MobileTask-based Mobile LearningUser Study Evaluation
Virtual assistants have the potential to play an important role in helping users achieves different tasks. However, these systems face challenges in their real-world usability, characterized by inefficiency and struggles in grasping user intentions. Leveraging recent advances in Large Language Models (LLMs), we introduce GptVoiceTasker, a virtual assistant poised to enhance user experiences and task efficiency on mobile devices. GptVoiceTasker excels at intelligently deciphering user commands and executing relevant device interactions to streamline task completion. For unprecedented tasks, GptVoiceTasker utilises the contextual information and on-screen content to continuously explore and execute the tasks. In addition, the system continually learns from historical user commands to automate subsequent task invocations, further enhancing execution efficiency. From our experiments, GptVoiceTasker achieved 84.5% accuracy in parsing human commands into executable actions and 85.7% accuracy in automating multi-step tasks. In our user study, GptVoiceTasker boosted task efficiency in real-world scenarios by 34.85%, accompanied by positive participant feedback. We made GptVoiceTasker open-source, inviting further research into LLMs utilization for diverse tasks through prompt engineering and leveraging user usage data to improve efficiency.
27
Generative Agents: Interactive Simulacra of Human Behavior
Joon Sung Park, Joseph O’Brien, Carrie J. Cai et al. · 2023 · 1.5K citations · Full text
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models
Ishika Singh, Valts Blukis, Arsalan Mousavian et al. · 2023 · 511 citations
Wiley StatsRef: Statistics Reference Online
Choice Reviews Online · 2015 · 369 citations