That's the interesting part and I guess it's a problem of Minikube instead of K8s. The reason is I found it works as well when I start Minikube with 2 nodes (by providing argument '-n 2').

Going further, I saw the difference of the route tables on Minikube's node between a single node and two nodes, but not have enough time to see why it happened.