From the course: AI Workshop: Advanced Chatbot Development

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

Demo: Deploying to Hugging Face Spaces

Demo: Deploying to Hugging Face Spaces

- [Axel] In this demo, we are going to finally deploy our beloved chatbot. To do that, we are going to use Hugging Face spaces, which offers a really, really easy way to deploy. The model we're going to use is the Microsoft Phi-3 model from before. We're going to use the tokenizer on the model to download it, and then we're going to use the pipeline as before. In Gradio, what we will have is since we are going to select the chatbot interface, we just have to implement the respond method that will have the message. Then, it has the history of messages in case you want to play around with it, which I can absolutely recommend you to do. You will have the system message, which we will set up in the interface. You will see it in a second. And then, some other configurations that we can set up also in the interface. What we are going to do is the simplest possible chatbot. So, we just get the system message and the message from the user, and we're going to pass through the chatbot as we…

Contents