Decision boundary when we classify using logistic regression-
Decision boundary when we classify using SVM-
As it can be observed, SVM tries to maintain a 'gap' on either side of the decision boundary. This proves helpful when we encounter new data.
With new data-
Logistic regression performs poorly (new red circle is classified as blue) -
Whereas SVM can classify it correctly (the new red circle is classified correctly in red side)-