Caffe can run on multiple cores. One way is to enable multithreading with Caffe to use OpenBLAS instead of the default ATLAS. To do so, you can follow these three steps:
sudo apt-get install -y libopenblas-dev
Makefile.config
, replace BLAS := atlas
by BLAS := open
export OPENBLAS_NUM_THREADS=4
will cause Caffe to use 4 cores.