FIT3143 — Parallel Computing

Summary Notes by By Carlos Melegrito

This collection of semi-organised writings is everything I've noted down during the entire semester. Not only will it serve as my revision notes for my exam, but also for reference in the future. Note that a lot of this content stems from Monash University, but most of these writings are of my own.

If you see an issue, just submit one or contact me from my website. To use these summary notes, just click any of the links in the contents below.

Contents

1. Distributed Systems
2. Inter-Process Communications
3. Remote Procedure Call
4. Message-Passing Library
5. Synchronisation
6. Mutual Exclusion
7. Deadlocks
8. Election Algorithms
9. Distributed Transactions
10. Concurrency Control
11. Faults
12. Distributed Consensus
13. Parallel Computing
14. Parallel Computing Alternatives
15. Instruction-Level Parallelism
16. Vector Architecture
17. Data Parallel Architectures
18. SIMD Architectures
19. MIMD Architectures
20. Distributed Memory MIMD Architectures