You can interrupt and abort the local (master) kernel during a concurrent computation. Any evaluations already on remote kernels will continue to run. After an abort, wait for any processes still in the queues using
Wait, abandon them with ResetQueues, or abort the remote kernels with
ResetSlaves[].
If you abort any other operation such as
ParallelEvaluate[], you should follow it by
ResetSlaves[].
There is not always a reliable way to interrupt a remote kernel;
ResetQueues[] waits for any running computations to finish normally to avoid an interrupt. If this takes too long, try to abort the master kernel again and then use
ResetSlaves[].
ResetSlaves[] tries to abort any remote kernels that are not responding. Kernels that fail to react are closed.
If you quit the local kernel while a remote one is still doing a computation, the remote kernel may continue running and should be aborted or eventually killed using the appropriate operating system command.