[BYOC] CUTLASS integration - #9261

Merged

masahi merged 56 commits into

apache:mainfrom

Laurawly:cutlass

Oct 29, 2021

Commits on Oct 28, 2021

byoc cutlass

leyuan.wang
authored and
masahi
committed
b89a65e
add cmake and fix build
masahi
committed
cd4f7fc
test worked but accuracy is bad
masahi
committed
c06e5c1
fixed argument printing properly
masahi
committed
3638d1e
moving files
masahi
committed
cbc5bec
moving contents of cutlass_profiler into python/tvm/contrib/cutlass
masahi
committed
86b306a
run black
masahi
committed
a1e3b81
remove irrelavant codegen code
masahi
committed
f1326c9
clang format
masahi
committed
7152b7d
tried replacing sm 75 with 80, didn't help improve accuracy
masahi
committed
140fa26
remove irrelavant code from generator
masahi
committed
ec34e9f
tried dense + bias fusion but generated cu file does not compile
masahi
committed
7309671
dense + bias worked after adding Leyuan's patch, bias + relu worked too
masahi
committed
7d6f68c
tried adding sm80 generator but accuracy is still off
masahi
committed
a564f9c
remove GemmUniversal generator
masahi
committed
0eae8f9
cleanup partition and build
masahi
committed
2b2041d
moved partition, profile and build function out of test
masahi
committed
a3cccc9
turned out the result match's TVM non-cutlass result. Numpy fp16
masahi
committed
dc01e33
clean up test
masahi
committed
b247d39
LinearCombination can be reused for bias only epilogue
masahi
committed
587e823
remove unsupported epilogues like gelu
masahi
committed
72c236a
removing deadcode
masahi
committed
ca202bf
unify gemm templates for with or without beta scaling
masahi
committed
2eefa9a
supported gelu but accuracy is slightly off
masahi
committed
990c2b4
gelu test passed with relaxed rtol
masahi
committed
7c59d91
cleanup
masahi
committed
a27f78d
remove unused stuff from library.py
masahi
committed
50fc190
move profiler template into its own file
masahi
committed
365c572
removed gemm_profiler.py
masahi
committed
be41787
move contents of compile_engine.py into gen_gemm.py
masahi
committed
51f0baf
rename to profiler_template.cu to avoid CI issue
masahi
committed
b34a90f
cleaning up trying to pass pylint
masahi
committed
abd82c8
add missing asf header
masahi
committed
7aa5755
run black
masahi
committed
cd149bf
fixing many pylint issues except wildcard import
masahi
committed
b1b3067
fixed wildcard warning
masahi
committed
33a0b8a
add missing CUTLASS.cmake file, restore gemm_profiler.py
masahi
committed
5be1a6e
pylint
masahi
committed
0fa6b75
minor fix
masahi
committed
c11e69f
add license
masahi
committed
cd5326d
start filling in TODO doc
masahi
committed
1e110d4
rename GemmProfiler to GemmProfilerEmitter
masahi
committed
e2abe8f
more renaming and doc
masahi
committed
3eb47fc
add doc to the main compile API
masahi
committed
c641774
refactored generator
masahi
committed
ce09fe8
run black
masahi
committed
9a4c5f7
black fix
masahi
committed
b0f59b7
finish doc TODO
masahi
committed
fc52abd
add test for 32 bit accum
masahi
committed
77fbe43
fixed kernel generator to correctly handle fp32 accum
masahi
committed
5ae5e69
revise build-related API
masahi
committed
9f478a7
add option to profile only one kernel
masahi
committed
d5d03be
add option to enable parallel compilation
masahi
committed
11838fd
clean up gen_gemm
masahi
committed
0fb7d69
doc update
masahi
committed
f86197a
profile_cutlass_kernels -> tune_cutlass_kernels
masahi
committed
e6bec53