Groverkss

• Attention
  • Section 1 : What do attention variants really look like?
    • Variant class 1 : Score modifiers (Common)
    • Variant class 2 : Quantization and Not Really Attention? (Rare)
  • Section 2 : The Math Behind Attention Codegen
    • Reduction loops in attention
    • Online Softmax?
    • Attention with online softmax:
    • Online Softmax plus Matmul?

• Attention with Online Softmax+Matmul

bjacob

IREE/MLIR/Linalg tutorial

Introduction

This tutorial is simultaneously about IREE, MLIR, and specifically the MLIR Linalg dialect.

What is MLIR?

MLIR is a programming language, but MLIR in itself is almost just an empty shell. What it really provides is a framework allowing to define MLIR dialects which are where the features come from.

henrik

tmux cheatsheet

As configured in my dotfiles.

start new:

tmux

start new with session name: