You are correct, yes. See specifically 603.10: http://yawgatog.com/resources/magic-rules/#R60310

It doesn't have anything to do with being a creature or not though. Any permanent leaving the...