Create Chatbot Based Using GPT-Index/LlamaIndex | OpenAI | Python

In this article, I’ll show you how can you create a basic chat bot which utilizes the data provided by you. Here we will be using GPT-Index/LlamaIndex, OpenAI and Python.

Let’s get started by installing the required Python module.

Install modules/packages

We need to install, two packages named llama-index and langchain and this can be done using below lines:

pip install llama-index pip install langchain

Importing packages

Next, we need to import those packages so that we can use them:

from llama_index import SimpleDirectoryReader,GPTListIndex,GPTVectorStoreIndex,LLMPredictor,PromptHelper,ServiceContext,StorageContext,load_index_from_storage from langchain import OpenAI import sys

import os

Please note that, here, we don’t need an GPU because we are not doing anything local. All we are doing is using OpenAI server.

Grab OpenAI Key

To grab the OpenAI key, you need to go to https://openai.com/, login and then grab the keys using highlighted way:

Once you got the key, set that inside an environment variable(I’m using Windows). If you do not want to set as an environment, you have to pass this key in each and every function call.

os.environ["OPENAI_API_KEY"] = "YOUR_KEY"

Collect Data

Once our environment is set, next thing we need is data. Here, you can either take an URL having all the data or you can take the data, which is already downloaded and is available in the form of a flat file.

If you are going with URL, then you use wget to download your text file:

!wget <YOUR_URL>/ABC.txt

Once text file is downloaded, make sure to keep it in a directory. If you have multiple text files, you can keep all of them into the same directory.

Now we have the data, we have the knowledge. Next thing is to use this knowledge base.

Create Index

Now, using all the text files, we need to create index. For this, we will create a function, which will take the directory path where our text file is saved.

def create_index(path): max_input = 4096 tokens = 200 chunk_size = 600 #for LLM, we need to define chunk size max_chunk_overlap = 20

promptHelper = PromptHelper(max_input,tokens,max_chunk_overlap,chunk_size_limit=chunk_size) #define prompt

llmPredictor = LLMPredictor(llm=OpenAI(temperature=0, model_name="text-ada-001",max_tokens=tokens)) #define LLM docs = SimpleDirectoryReader(path).load_data() #load data

#create vector index

  service_context = ServiceContext.from_defaults(llm_predictor=llmPredictor,prompt_helper=promptHelper)

  vectorIndex = GPTVectorStoreIndex.from_documents(documents=docs,service_context=service_context)
vectorIndex.storage_context.persist(persist_dir = 'Store')

Above process is called embedding and you need to do this again, only when new data flows in.

Create Answering System

Next, we need to build a system, which can respond to user. Let’s create a function for that.

def answerMe(question):

storage_context = StorageContext.from_defaults(persist_dir = 'Store')
index = load_index_from_storage(storage_context)
query_engine = index.as_query_engine()
response = query_engine.query(question)
return response

Test The System

Finally, it’s the time to test the system. Run your application, ask some questions and get the response.

I hope you enjoyed creating your basic bot.

If you find any thing which is not clear, feel free to watch my video, demonstrating this entire flow.