Course Description

COSC462 covers principles and practice of parallel computing; design, implementation, and evaluation of parallel programs for shared and distributed memory architectures, and vector processors. Sample topics include models of parallel computers, basic communication operations, performance and scalability of parallel systems, and programming techniques including multi-threading and message passing.

Prerequisites

CS360

Required Textbook

Grading

Lecture Notes

Week 34 (08/15 - 08/19)
Week 35 (08/22 - 08/26)
Week 36 (08/29 - 09/02)
    • Monday (GB) MPI
    • Wednesday (GB) MPI
    • Friday (GB) MPI
Week 37 (09/05 - 09/09)
Homework #1 due on Friday 5PM ET
Week 38 (09/12 - 09/16)
Week 39 (09/19 - 09/23)
Homework #2 due on Friday 11:59PM ET
Week 40 (09/26 - 09/30)
Week 41 (10/03 - 10/07)
Week 42 (10/10 - 10/14)
Homework #3 due on Wednesday 10/12 11:59PM ET
Week 43 (10/17 - 10/21)
Week 44 (10/24 - 10/28)
Homework #4 due on Friday 10/28 11:59PM ET
Week 45 (10/31 - 11/4)
Week 46 (11/7 - 11/11)
Week 47 (11/14 - 11/18)
Week 48 (11/21 - 11/25)
Homework #5 due on Wednesday 11/23 5:00PM ET
Week 49 (11/28 - 12/2)
Week 50 (12/5 - 12/16)

Homework

Exams

Project

Topics (not covered in class):
FPGAsMasters
Cloud applications on FPGAsPickney, and Holland
ASICsYoder
Comparative study between NVIDIA Pascal, Xavier and Intel KNL or KML (pick any 2)Person, Rouleau, and Ye
New/Future processorsAvailable
New/Future network technologiesNewsome
Quantum computingBrelsford, Cauthen, and Tooley
Photonic ComputingHerwig
Neuromorphic ComputingMitchell
Blockchain economyBachstein
Google TPUDixon, Deitz, and Teepe
WAVE ComputingRoberson and Bumpus
Processor in memory [PIM]Jones T.
Processor in network [PIN]Hobson and Massengill
Random number generatorHoladay and Jones
Machine Learning algorithmsTsai and Pei
Stackable memoryTran, Awad, and Chander
Programming Languages (focus on parallelism and/or concurrency) TBB/CnC/UPC/TensorFlow/Swift/Kokkos/Julia (pick 1)
SwiftMartin and Shires
TensorFlowPollack
Intel Threading Building Blocks (TBB)Edwards, Miller, and Treadway
KokkosXu
Julia programming languageOdell
Apache SparkKlibisz and Bruer
Vulkan (graphics API)Tpoff
Execution models and their implementations (HPX, SWARM) (pick 1)Available
Each project done by a group (2-3 students)
    Delivery
    • Private video link (YouTube, Vimeo, ...)
    • 5 minutes maximum
    • Will be made available to all class participants
    • Content
    • Slides
    • Animation
    • Narration
    • Links for more info
Project due on 12/02 @ 5PM ET

Instructors

George Bosilca  George

  • Office: Claxton 308
  • Email: bosilca at icl.utk.edu
  • Office Hours: please send email for appointment, or stop by to chat from 8 to 5 weekdays.

Piotr Luszczek  Piotr

  • Office: Claxton 316
  • Email: luszczek at icl.utk.edu
  • Office Hours: please send email for appointment, or stop by to chat from 8 to 5 weekdays.

TA:Yaohung "Mike" Tsai  Mike

  • Office: Claxton 353
  • Email: ytsai2 at vols.utk.edu
  • Office Hours: please send email for appointment, or stop by to chat from 8 to 5 weekdays.

Schedule

Monday, Wednesday and Friday from 10:10AM until 11:00AM, Min Kao 524

Links