Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
The GenAI packages will provide torchsharp implementation for a series of popular GenAI models. The goal is to load the same weight from the corresponding python regular model.
The following models will be added in the first wave
MEAI intergration
Fine-tuning #7287
Along with the benchmark
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
The
GenAIpackages will provide torchsharp implementation for a series of popular GenAI models. The goal is to load the same weight from the corresponding python regular model.Microsoft.ML.GenAI.Core(Add GenAI core package #7177)The following models will be added in the first wave
Microsoft.ML.GenAI.Phi) Add Microsoft.ML.GenAI.Phi, test package and sample project. #7184Microsoft.ML.GenAI.Phiproject [GenAI] Add readme to Microsoft.ML.GenAI.Phi #7206Microsoft.ML.GenAI.LLaMA) [GenAI] Add LLaMA support #7220Microsoft.ML.GenAI.Mistral)Microsoft.ML.GenAI.StableDiffusion)MEAI intergration
Fine-tuning #7287
Along with the benchmark
Benchmark for Phi-3
Flash Attention support [GenAI] Add FlashAttention #7238
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.