There are options on the WorldEnvironment node. For ambient lighting and sky contribution. You can set them to 0 or black.
cybereality for me, changing sky contribution does nothing.