dc.description.abstract | With the expansion of the smart home market, many proprietary closed
ecosystems have gradually emerged, such as Apple’s HomeKit, Google’s Nest,
and Amazon’s Alexa. These closed ecosystems not only limit users’choices
but also require them to learn different system operation methods, making it
difficult to fully experience the convenience that smart homes should offer.
This paper aims to address the learning curve and the issue of closed
ecosystems by constructing a task-oriented dialogue system for smart homes.
Before building the task-oriented dialogue system, a dialogue corpus must first
be collected. Compared to traditional methods of collecting human-to-human or
human-to-machine dialogues, this paper refers to the Schema-Guided Dialogue
(SGD) approach and constructs the SmartHomeSGD dialogue simulator. Using
a context-aware probabilistic method, the dialogue actions of the user agent and
assistant agent are decided, allowing the agents to more effectively simulate the
interactions between humans and systems.
In the design of dialogue actions, we created specific actions for both the
user agent and the assistant agent. Additionally, to integrate the task-oriented
dialogue system with external smart home services (such as traditional devices,
media players, and HVAC services), we added the EXECUTE dialogue action
for the assistant agent. Through this action, HTTP requests are sent to connect
to external smart home services.
In traditional machine-to-machine dialogue corpus generation, the dialogue
outlines generated by machines often require a significant amount of manual effort
to revise in order to increase diversity and naturalness. To address this issue,
this paper designs dialogue rewriting prompts to guide large language models in
performing dialogue rewriting tasks, effectively reducing human labor costs.
Finally, this paper uses the mT5 (Multilingual Text-to-Text Transfer Transformer) pre-trained model and fine-tunes it based on the SmartHomeSGD corpus
to successfully construct a chinese task-oriented dialogue system for smart homes | en_US |