KernelPeakMemoryLimit is a configuration setting that sets the limit in bytes for the peak amount of memory that a Mathematica kernel can use. The peak amount of memory means any temporary usage of memory that might happen during a calculation. When the memory limit is exceeded the kernel is restarted. To limit the base amount of memory you should use KernelBaseMemoryLimit.