Parallel Numerical Computing

Content

This is a basic introduction to parallel programming with an emphasis on numerical algorithms. OpenMP and MPI is used to explain basic concepts. The parallel frameworks Trilinos and IPPL are used to show a high level of abstraction w.r.t. parallel programming. Numerical algorithms covered are: (non)linear systems solving, N-body problems, FFT, Particle-In-Cell method, Fast Multipole Method.

News

• Added expression templates solution
• Updated slides for week 8 and added slides for week 9.
• Apply for a Brutus account.

Slides

• Lecture 1: 24.2.2012 [1-up] [4-up]
• Lecture 2: 02.3.2012 [1-up] [4-up]
• Lecture 3: 09.3.2012 [1-up] [4-up]
• Lecture 4: 16.3.2012 [1-up] [4-up]
• Lecture 5: 23.3.2012 [1-up] [4-up]
• Lecture 6: 30.3.2012 [1-up] [4-up]
• Lecture 7: 20.4.2012 [1-up]
• Lecture 8: 27.4.2012 [1-up] [gpu]
• Lecture 9: 04.5.2012 [1-up]
• Lecture 10: 11.5.2012 [1-up] [IPPL]
• Lecture 11: 18.5.2012 [1-up]
• Lecture 12: 25.5.2012: No lecture, visiting Brutus
• Lecture 13: 01.6.2012

Exercises

A few guidelines and rules for solution submission:

• In order to get the "Testat" you need to get at least 50% of the points!
• You are allowed to solve the exercises in teams of two.
• No points will be awarded if we feel that handed in solutions are copies!
• Hand in solutions before (or at) the lecture on the due date.
• Responsible Assistant: [A - L ] → Yves, [M - Z] → Christof

Usually we provide a problem description and skeleton code. Master solutions will be released on the due date.

• Exercise 1: [pdf] [code] [sol]
• Exercise 2: [pdf] [code] [sol] [Intel Dev Manual] [Intel Opt Manual]
• Exercise 3: [pdf] [code] [sol] [Intel Dev Manual] [Intel Opt Manual] [Blas Quick Reference] [notes concerning OpenMP timings]
• Exercise 4: [part1] [part2] [pingpong.c] [scalapack.tar] [sol] [slides]
• Exercise 5: [pdf] [vec-ex.cpp] [VExpr.h] [sol]
• Exercise 6: [pdf] [cg.cpp] [Makefile] [sol]
• Exercise 7: [pdf] [code] [sol]

Books

• P. S. Pacheco, An Introduction to Parallel Programming, Morgan Kaufmann, 2011
• P. S. Pacheco, Parallel Programming with MPI, Morgan Kaufmann, 1997
• R. Chandra et al., Parallel Programming in OpenMP, Morgan Kaufmann, 2000
• W. Petersen and P. Arbenz, Introduction to Parallel Computing, Oxford University Press, 2004
• T. Rauber, G. Rünge, Parallele Programmierung, 2. Aufl., Berlin Springer 2007