Parallel Programs

There are three main classes,

• Data Parallelism: Such as HPF. Spread the data over a set of processors and execute same the program on each processor, this means that each processor operates on its own subset of the overall data.
• Task Parallelism: Two or more cooperating processes. Different tasks will be written to solve different parts of the problem. These tasks will pass data between themselves in pursuit of the solution.
• Master-Slave: One master process controls one or more slaves, it is responsible for the distribution of the data, general coordination of the solution methodology and collecting the results at the end.

Return to corresponding overview page