[BYOC] [TPAT] [TensorRT] Add the ability to automatically generate TensorRT plugins using TVM - #15526

Closed

Civitasv wants to merge 14 commits into

apache:unityfrom

Civitasv:feat_tpat

Commits on Aug 21, 2023

[tensorrt] [byoc] [plugin] add ability to support generating tensorrt plugin with tvm
Civitasv
committed
c2fbe14
[tensorrt] [byoc] [plugin] add TPAT python lib, make the api clearer
Civitasv
committed
ac896a3
[tensorrt] [byoc] [plugin] make cpp side api clearer
Civitasv
committed
2fea9e2
[tensorrt] [byoc] [plugin] Allow users to specify tunning option
Civitasv
committed
cb1c86c
fix: make extract onnx and rewrite cleaer
Civitasv
committed
83cee7a
[tensorrt] [byoc] [plugin] Make API clearer and remove unneccessary fields
Civitasv
committed
b4726fc
[tensorrt] [byoc] [plugin] remove unused imports
Civitasv
committed
52dd98f
[tensorrt] [byoc] [plugin] Make API clearer
Civitasv
committed
a2c322b
[tensorrt] [byoc] [plugin] change configuration of Makefile.
Civitasv
committed
7881580
[tensorrt] [byoc] [plugin] anyway, better name is better
Civitasv
committed
e13a474
[tensorrt] [plugin] [byoc] fix resolving device function order
Civitasv
committed
f0248b4
[tensorrt] [byoc] [plugin] enhance type inference using ort
Civitasv
committed
d6b1cdb
[tensorrt] [byoc] [plugin] allows save external data
Civitasv
committed
493142d

Commits on Aug 29, 2023

No need to use gc
Civitasv
committed
e9c5a58