Until it starts going fast enough, yes. Then momentum carries it. And once it leaves the planet and make it to the stars then there's nothing holding it down.

[Luke can really oversimplify things for kids.]