ChatBot with LLMs

Video Demo (click on the image)

Watch video Demo

Architecture

Query processing

Front-end

Sample Outputs

Repo Organization

How to run the app

1. Setup virtual environment with pipenv

2. Install dependencies

   pipenv install
   

   To install exact versions run:

   pipenv install --ignore-pipfile
   

3. Download ollama (Two approaches:)

   • form from github or

   • from the website

4. Download LLM models via ollama

   Explore list of LLM models via ollama here

   e.g. to download llama3.2 run:

   ollama run llama3.2
   

5. Run the app

   python app.py
   

   OR

   python3 app.py
   

   Open in a browser:

   http://127.0.0.1:5000