State-Conditional Adversarial Learning: An Off-Policy Visual Domain Transfer Method for End-to-End Imitation Learning

Dec 1, 2025·
Y. Liu
Shengfan Cao
Shengfan Cao
· 0 min read
Abstract
We study visual domain transfer for end-to-end imitation learning in a realistic and challenging setting where target-domain data are strictly off-policy, expert-free, and scarce. We first provide a theoretical analysis showing that the target-domain imitation loss can be upper bounded by the source-domain loss plus a state-conditional latent KL divergence between source and target observation models. Guided by this result, we propose State- Conditional Adversarial Learning, an off-policy adversarial framework that aligns latent distributions conditioned on system state using a discriminator-based estimator of the conditional KL term. Experiments on visually diverse autonomous driving environments built on the BARC-CARLA simulator demonstrate that SCAL achieves robust transfer and strong sample efficiency.
Type
Publication
IFAC World Congress 2026
publications
Authors
Shengfan Cao
Authors
PhD Researcher in Autonomous Driving & Robotics
UC Berkeley Ph.D. candidate developing safe, machine-learning-based prediction, planning, and control systems for autonomous vehicles. First-author IEEE IROS oral presenter with 4+ years across machine learning, planning, and controls, spanning PyTorch research, CARLA evaluation, embedded-robot deployment, and C++ production planner integration.