The vertebrate embryo begins by wearing its brain on its sleeve. The nervous system whose activity will make it mindful of the external world actually develops from the outside of the embryo. In the process of neurulation (search that for details), the first stage in formation of the nervous system, the developing embryo turns itself outside in. Illustration (in cross section) from Wikipedia today: