<aside> ❗ Headings and text with “▶” can be toggled to expand contained info. You can also see the Table of Contents as a collapsible sidebar on the right →

</aside>

Table of Contents

Introduction

This module aims to introduce students to the fundamental principles of GPU architecture and programming. Additionally, it offers an opportunity for students to revisit processor design backgrounds as part of their learning experience.

Objectives

• Describe the basic backgrounds of GPU
• Explain the basic concept of data parallel architectures

Readings

Required

Optional

Notes / Things that stand out

Lesson 1 - Basics

What is a GPU?

• Initially were 3D graphics accelerators.
• Now have evolved to become:
  • Massive Parallel Processors
  • ML Accelerators
  • High Performance processors

Difference between CPUs and GPUs

• Precise Exceptions:
  • An exception for which the pipeline can be stopped, so instructions that preceded the faulting instruction can complete, and subsequent instructions can be flushed and re-dispatched after exception handling has completed.
  • An interrupt/exception is precise if the saved process state corresponds with the sequential model of program execution where one instruction completes before the next begins.

Lesson 2 - Modern Processor Paradigms

5 stage Pipeline