Caffe can run on multiple cores. One way is to enable multithreading with Caffe to use OpenBLAS instead of the default ATLAS. To do so, you can follow these three steps:
sudo apt-get install -y libopenblas-devMakefile.config, replace BLAS := atlas by BLAS := openexport OPENBLAS_NUM_THREADS=4 will cause Caffe to use 4 cores.