- Published on
Improving edge inference speed by 25-30% via quantization (QAT, TFLite, TensorRT, OpenVINO) and pruning. Building DeepOps for real-time edge device management reducing model management time by 80%.
Quantization
All Posts
- computer-vision (3)
- transformers (2)
- mlops (2)
- nlp (2)
- machine-learning (2)
- yolov8 (1)
- sam (1)
- fastapi (1)
- airflow (1)
- edge-ai (1)
- tensorrt (1)
quantization (1)
- model-optimization (1)
- system-design (1)
- content-moderation (1)
- gpt-2 (1)
- production-ml (1)
- deep-learning (1)
- research (1)
- edge-computing (1)
- social-impact (1)
- iit-delhi (1)
- aws (1)
- kubernetes (1)
- mlflow (1)
- sagemaker (1)