Banner image shows DAS-4 nodes at Leiden University (adapted from photo by Vianney Govers)
High Performance Computing I, Fall 2020
Lecturer: prof.dr. H. A. G. Wijshoff
Teaching/Lab Assistent: Dennis van der Zwaan (hpc1-2020@dvdzwaan.com)
Description
The course presents an introduction to High Performance Computing and more specifically parallel/pipelined programming and high performance architectures and subsequently the study of parallel algorithm design, parallel numerical computing, parallel graph computing and parallel sorting. Existing and new (high performance / parallel) programming paradigms will be discussed. The course lectures are completed with programming assignments and/or (theoretical) algorithmic problems.
All students got a passing grade for the Exam, so there will be NO RETAKE!!!
The exam will be in person next week Thursday (17 December) from 13:00 till 16:00. Location is van Steenis Building room E004. Question hour will be this week Friday (11 December), also in person at 12:15. Location is Snellius room 174.
ASSIGNMENT 3 HAS BEEN PUT ONLINE, DEADLINE IS DECEMBER 11, SEE BELOW.
THIS FRIDAY, NOVEMBER 6 their will be a LABSESSION given by Dennis van der Zwaan in room 174 at 15:00.
ASSIGNMENT 2 HAS BEEN PUT ONLINE, DEADLINE IS NOVEMBER 16, SEE BELOW.
THE DEADLINE FOR ASSIGNMENT 1 WAS POSTPONED TILL OCTOBER 26. Those of you who handed in the assignment on time and do not need to improve this assignment will get a 1 point bonus. For the others there will be no penalties.
In the zoom session last Monday (7 September) it was decided that this course will be taught IN PERSON on Fridays from 12:15 till 15:00. In the meantime we have found and reserved Lecture Room 174 for this time slot. So I expect to see all of you this Friday, September 11th, at room 174. Please wait outside! This message will also be communicated by email directly to you. If you have not received an email. Please register for this course, see below.
Right now 19 (4 September) students have registered for the course, which means that there is an opportunity to have this course in person. For discussing this matter and the organization around it, I would like to invite you for a zoom session this Monday, 7 September, from 15:00 till 15:30. Zoom links follows.
IF YOU HAVE NOT RECEIVED THE MESSAGE ABOVE BY A PERSONAL EMAIL, SEE BELOW!!!
IN ORDER TO EXPLORE IN PERSON TEACHING, STUDENTS WHICH INTEND TO PARTICIPATE IN THIS COURSE ARE KINDLY REQUESTED TO SEND AN EMAIL TO THE INSTRUCTOR (h.a.g.wijshoff@liacs.leidenuniv.nl) WITH SUBJECT HPCI, AND AN INDICATION OF COMMITMENT (100%/50%/10%). PLEASE DO SO BY THURSDAY SEPTEMBER 3. In the week of 31 august there will be NO teaching.
Examination
40% assignments: programming assignments. 60%: Open "book" final exam.
Example exams: Exam 2015, Exam 2016, Exam 2017.
Assignments
Assignment 1: Sparse LU Factorization. The skeleton code for this assignment can be found here. The deadline for this assignment is Monday, October 12, 23:59 hours.
Assignment 2: Parallel Minimum Spanning Tree Algorithm. The deadline for this assignment is Wednesday November 16, 23:59 hours
Note that your implementation should also handle disconnected graphs, resulting in multiple spanning trees. Note also that as output you should report the total weight of each minimum spinning tree as well as the edges which belong to the spanning tree.
Assignment 3: Parallel Sorting Algorithm. The deadline for this assignment is Friday December 11, 23:59 hours.
Literature
Textbook (not obligatory): Introduction to Parallel Computing. Ananth Grama, Anshul Gupta, George Karypis, and Vipin Kumar. 2003. Addison Wesley.
Lecture Slides:
- Lecture 1
- Lecture 2
- Lecture 3
- Lecture 4
- Lecture 5
- Lecture 6
- Lecture 7
- Lecture 8
- Assignment 2 Slides
- Lecture 9
- Lecture 10
- Lecture 11
- Lecture 12
Contact
One can contact the assistent by e-mail: hpc1-2020 (at) dvdzwaan.com. One can contact the lecturer by e-mail: h.a.g.wijshoff (at) liacs.leidenuniv.nl.
Class Schedule
Lectures: Fridays from 12:15 to 15:00 in room 174.
| Date | Description |
|---|---|
| Fr. 11 September |
12:15-15:00 Lecture: Introduction, Implicit and Explicit Parallelism |
| Fr. 18 September |
12:15-15:00 Lecture: Fundamentals of Parallel Programming and Numerical Algorithms |
| Fr. 25 September |
12:15-15:00 Lecture: Numerical Algorithms and Sparse Matrix Computations |
| Fr. 2 October |
12:15-15:00 Lecture: (Parallel) Sparse Matrix Computations |
| Fr. 9 October |
12:15-15:00 Lecture: Parallel Graph Computations |
| Fr. 16 October |
12:15-15:00 Lecture: Parallel Sorting |
| Fr. 23 October |
12:15-15:00 Lecture: Parallel Programming Models |
| Fr. 30 October |
12:15-15:00 Lecture: Parallel Programming Models (tUPL) |
| Fr. 6 November |
15:00-17:00 Labsession: Assignment 2 |
| Fr. 11 December |
12:15-13:15 Question Hour (Location 174, Snellius Building) |
| Th. 17 December |
13:00-16:00 FINAL EXAM (Location E004, Van Steenis Building) |