The core goes down into the ice, and the ice opens around it.
An artistic imagining, not real hardware: a fission reactor core being lowered into a crevasse on Enceladus, the only warm thing for hundreds of kilometres, its waste heat lighting the ice walls it passes. Enceladus has a confirmed subsurface ocean and active ice tectonics, but no such reactor exists or is planned.Image: poweringspace.com. Artistic imagining.