Cute Or Creepy: Face Swap

I took my son on a trip to Portland this weekend, and as we were on the plane, three different people told us "you guys look so alike."  So, we decided to do a little test. 

It wasn't the first time I've heard this.  In fact, it's been pretty common since he was a very little kid that I would hear how much we resemble each other and although I haven't seen it as us looking as similar as others say, I've just accepted that's what most people seem to see.

I was telling a friend about the people on the plane and joked that I should try the face swap apps and see how close it is.  After this discussion, I decided to just be funny and try it.

Here's what we came up with:

My son thought it was hilarious, I thought it was pretty funny, and we had a fun time trying to get a shot where we weren't both laughing and messing it up.

I posted it to my social, but it was interesting to see a very split reaction.  About half the people who commented said it was fun, half said it was creepy.  Now, I get it, you may not love it, but is it creepy in some way?

What am I missing?