World Models with Hints of Large Language Models for Goal Achieving

Zeyuan Liu*, Ziyu Huan*, Xiyao Wang, Jiafei Lyu, Jian Tao, Xiu Li, Furong Huang, Huazhe Xu (* equal contribution)

Under review. 2024

Inspired by human cognition, we propose a new multi-modal model-based RL approach named Dreaming with Large Language Models (DLLM).

[Paper]