News
14.12.2009: Details for the oral exam on January, 5th are online. You can choose a slot that you prefer on Thursday, Dec. 17th (in the lecture where the presentations for mandatory assignment 4 are given) and until Friday (Dec., 18th, 12am) in the IMADA secretary's office.
14.12.2009: Weekly notes (week 51) are online. A schedule for the presentations to be given on Thursday, Dec 17th is included.
14.12.2009: Slide set for week40 (Chapter 2, week40.Parallel.Programming.Platforms) was updated, as the last two slides (Fat Wraparound Mesh vs Hypercube) were missing.
8.12.2009: The results for mandatory assignment 1 can be found here.
8.12.2009: Weekly notes (week 50) including exercises are online. Note that you should prepare a short presentation (10 - 15 minutes) for the mandatory assignment 4, that has to be given on Thursday, December, 17th, 8:00 - 10:00am
30.11.2009: Weekly notes (week 49) including exercises are online.
24.11.2009: Weekly notes (week 48) are online. Do not forget the deadline for the third mandatory assignment Friday, November, 27th, 10:00am.
16.11.2009: Weekly notes (week 47) including exercises are online. Do not forget the deadline for phase 1 of the fourth mandatory assignment Friday, November, 20th, 10:00am.
09.11.2009: Weekly notes (week 46) including exercises are online. Note that it includes also some suggestions for the Fourth Mandatory Assignment.
02.11.2009: The Fourth (and last) Mandatory Assignment was published. Deadline for phase 1 of this assignment Friday, November, 20th, 10:00am.
02.11.2009: The Third Mandatory Assignment was published. Deadline for this assignment Friday, November, 27th, 10:00am.
02.11.2009: Slides for week 45 and week 46 were uploaded.
30.10.2009: Exercises for week 45 (and 46) are online.
29.10.2009: Weekly notes for week 45 are online.
12.10.2009: Quarter Break.
08.10.2009: Deadline for second mandatory assignment was shifted to Monday, October, 12th, 10:00am.
06.10.2009: Chapter 3: "The Linked Cell Method for Short-Range Potentials" from the book "Numerical Simulation in Molecular Dynamics" by Griebel et al. was uploaded in the Blackboard System. You can access the whole book via the SDU library proxy: here.
Schedule
| Week | 35 | 36 | 37 | 38 | 39 | 40 | 41 |
|---|---|---|---|---|---|---|---|
| Mon 08-10 (Seminar Room) | Lecture | Lecture | Lecture | Lecture | Lecture | Lecture | |
| Thu 16-18 (Seminar Room) | Lecture | Lecture | Exercises | Lecture | Exercises | Lecture | Exercises |
| Week | 45 | 46 | 47 | 48 | 49 | 50 | 51 |
|---|---|---|---|---|---|---|---|
| Mo 14-16 (Seminar Room) | Lecture | Lecture | Lecture | Lecture | Lecture | Lecture | Lecture |
| Thu 08-10 (Seminar Room) | Exercises | Exercises | Exercises | Exercises | Exercises | Exercises | Presentation |
Weekly Notes / Tutorial Exercises
The slides (and additional material) presented in the lectures can be found in the Blackboard System.
| Date | Topic | Notes |
|---|---|---|
| Week 35 | Introduction / Overview | |
| Week 36 | Single Processor Machines: Memory Hierarchies and Processor Features, Tuning Matrix Multiply | Weekly Notes |
| Week 37 | Introduction to Parallel Machines and Programming Models | Weekly Notes (including exercises for week 37) |
| Week 38 | Parallel Computer Architecture: A Hardware/Software Approach / Distributed Memory Machines and Programming | Weekly Notes |
| Week 39 | Distributed Memory Machines and Programming - MPI, Simulation | Weekly Notes, Exercises for Week 39 |
| Week 40 | Simulation, Cost Model, Mapping, Platforms, Design | Weekly Notes |
| Week 41 | Design, Basic Communication | Weekly Notes, Exercises for Week 41 |
| Date | Topic | Notes |
|---|---|---|
| Week 45 | Analytical Modelling of Parallel Programs | Weekly Notes, Exercises for Week 45 (and 46) |
| Week 46 | Analytical Modelling of Parallel Programs, Dense Matrix Algorithms | Weekly Notes and Exercises for week 46 (and 47). Includes suggestions for the Fourth Mandatory Assignment. |
| Week 47 | Dense Matrix Algorithms, Sorting | Weekly Notes and Exercises for week 47 (and 48) |
| Week 48 | Sorting, Graph Algorithms | Weekly Notes for week 48 |
| Week 49 | Graph Algorithms | Weekly Notes for week 49 |
| Week 50 | Search Algorithms for Discrete Optimization Problems | Weekly Notes for week 50 |
| Week 51 | Dynamic Programming | Weekly Notes for week 51 (including schedule for presentations on Thursday, Dec. 17th |
Office Hours
Just write a short mail, and come by.
- Office: IMADA, Ø14-602b-2 map.
- Phone: 2322
- E-mail: daniel
Literature
Main course book:
[1] Grama, A; A. Gupta; G. Karypis; V. Kumar: Introduction to Parallel Computing. Pearson, 2003. Errata by John Kirk
Additional reading information is given on the lecture slides.
Additional reading can also be found in the Blackboard System
.Course Description
Prerequisites:
The contents of DM507 Algorithms and Data Structures must be known.
Aims:
The goal of this course to introduce the students to the aspects of parallel computing: architecture, programming paradigms, algorithms and standards. Both traditional computer science algorithms (e.g. sorting, searching, and dynamic programming algorithms) as well as scientific computing algorithms (e.g. matrix computations) will be covered. Students learn how to apply the most widely used standards for writing parallel programs (MPI, Pthreads, and OpenMP) and to thoroughly quantify the performance of parallel programs by means of metrics for scalability.
Synopsis:
parallel programming platforms, principles of parallel algorithm design, basic communication operations, analytical modeling of parallel programs, programming using the message passing paradigm, programming shared address space platforms, dense matrix algorithms, sorting, graph algorithms, search algorithms for discrete optimization problems, dynamic programming, fast fourier transform
Teaching period:
Fall 2009
Aim description:
When the course is completed the students are expected to be able to:
- explain the techniques and algorithms from the curriculum in clear
and precise language.
- analyze the parallel systems covered in the curriculum with
respect to performance and scalability.
- apply parallel programming techniques by implementing the
techniques and algorithms from the curriculum in example programs.
- undertake empirical studies for the parallel implementations and
draw sound conclusions.
Evaluation:
(a) Project assignments. Pass/fail, internal evaluation by teacher.
The assignments must be passed in order to take the oral exam.
(b) Oral exam at the end of the course. Danish 7 mark scale,
external examiner.
Reexamination according to the rules decided by the Study Board. Oral exam. Danish 7 mark scale, external examiner.
Course type:
Lectures and Tutorials.