MMDeploy is an open-source deep learning model deployment toolset. It is a part of the OpenMMLab project. Models can be exported and run in several backends, and more will be compatible. All kinds of modules in the SDK can be extended, such as Transform for image processing, Net for Neural Network inference, Module for postprocessing and so on. Install and build your target backend. ONNX Runtime is a cross-platform inference and training accelerator compatible with many popular ML/DNN frameworks. Please read getting_started for the basic usage of MMDeploy.
Features
- Fully support OpenMMLab models
- Multiple inference backends are available
- Build from Docker
- Benchmark and Model zoo
- Test rewritten model
- Test backend ops
Categories
Frameworks, Machine Learning, Neural Network Libraries, Deep Learning Frameworks, Image Processing, LLM InferenceLicense
Apache License V2.0Follow MMDeploy
Other Useful Business Software
Zenflow- The AI Workflow Engine for Software Devs
Zenflow is the AI workflow engine built for real teams. Parallel agents plan, code, test, and verify in one workflow. With spec-driven development and deep context, Zenflow turns requirements into production-ready output so teams ship faster and stay in flow.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of MMDeploy!