Parallel distributed computing (PDC) has become an extremely effective way to solve many problems in the large-scale scientific computing and engineering field.