Our work Policy Representation Can be Utilized for More Generalizable Offline Dynamics Model Learning is accepted by ICML 2024!