You Can Transform the Inner by Transforming the Outer