clipped from:    
Did the people in Nazareth know there was something unusual about Jesus’ origins, and it disconnected him from Joseph? Yes they did, which is why they were angry and did not think Jesus had any right to teach them. He was probably viewed as a mamzer, as Dr. Bruce Chilton has argued—an illegitimate child. And this is precisely what James Tabor argues in his Jesus Dynasty book, claiming he was the son of a Roman soldier named Pantera. But of course now, he has reversed himself to support the Jesus Family Tomb theory. You can’t have it both ways, and in fact neither are correct. Jesus was not the physical descendent of Joseph, was known not to be by his hometown folks. The uncharitable suggested he was illegitimate but Mary claimed his conception was a miracle. Those are the two opposing explanations we have from the first century about Jesus’ origins.