GitHub - SKKU-ESLAB/ANT-Model-DB: ANT framework's model database that provides DNN models for the various range of IoT devices

This project includes model database, model profilers, and model dashboard used in ANT framework.

The model database provides DNN models for various range of IoT devices.

Model/Kernel Database

Model database records compressed DNN models.

Kernel database tunes kernel codes of those compressed models and collects them.

Usage

python modeldb_sender.py --table <model_db_table_name> --path <directory_to_record> [--save_as_csv]

Model Profiler

Model profiler can measure latency using programs in latency-predictor, which implemented based on TVM.

References

This project is implemented based on TVM

TVM https://github.com/apache/incubator-tvm

Prerequisites

llvm Download Page
CUDNN Download Page
CUDA

Model Dashboard

Model dashboard is a web page that shows available compressed model in model database and kernel code in kernel database. This dashboard web server is implemented based on Flask.

Usage

License

ANT-Model-DB is open source software under the Apache 2.0 license.