4 IPU Microbenchmarking Subsystems

A deeper look at each subsystem is reviewed to show some impressive numbers.

2019-12-17

4 IPU Microbenchmarking intro

A starting look at this paper identifies differences between architectures before comparing them.

2019-12-16

3 Graphcore Patent- Scheduler Control

While the scheduler controls workers as they work and exit, but additional complexities to exit can provide the programmer fundamental information.

2019-12-14

3 Graphcore Patent Details 1

The Barrel Threaded M+1 idea

2019-12-13

3 Graphcore's Scheduling Processing summary

The early section in the patent gives a summary of the proposed scheduling mechanism of supervisors and workers.

2019-12-12

3 Graphcore Patent - Context and Concurrency

Two key ideas to a large multiprocessor are context and concurrency.

2019-12-11

2 Experimental Validation and conclusions

Conclusions to the Mishkin paper

2019-12-10

2 Mishkin LSUV

The LSUV initialization method is an attempt to generalize the work done by Glorot to other non-linearities such as the work done by Kaiming on ReLUs.

2019-12-09

2 Mishkin Initialization

Here Mishkin describes previous techniques of initialization that have been published in the literature.

2019-12-07

2 Mishkin Introduction

This 2016 paper has a great introduction section in prose describing the history of initialization methods.

2019-12-06