I’m thrilled to announce the launch of my Conversational AI project, https://chat.aisvc.io – a ChatBot designed to provide fast, intelligent, free, and unlimited conversations.
This is a hobby project I created during my AI studies. Please feel free to use it as much as you want. You can send me a feedback via link on that page or direct message from the LinkedIn.
There are some limitations:
- Response tokenization speed may decrease depending on the number of active users
- It may produce hallucinations
- There is no user-based memory
- Model size is 7.25B params (to compare: ChatGPT 4o has over 200B params)
- Some training data might be outdated
Tech Stack:
- Deployment: Cloud deployment via Kubernetes, Cloudflare
- Backend: Python, NodeJS/Express API
- Frontend: Astro, Preact and NGINX
- LLM Inference: vLLM
- LLM: Mistral 7B v0.3 (Special thanks to Mistral team for an Open Source LLM!)
🚀 Try it now: https://chat.aisvc.io