Giving ChatGPT context from a document ChatGPT responds based on document context This time, ChatGPT provides a different answer, extracted from the article’s text. In the following example, I ask ChatGPT the same question, but I prepend my prompt with “Answer my questions based on the following document:” followed by the text of an article from Investopedia about run rate. However, you can prompt ChatGPT to provide the answer from a specific document. But if you prepend your prompt with custom information, you can modify their behavior.įor example, if you ask ChatGPT the question, “What are the risks of using run rate?” it will provide a long answer (which is not bad). If you give them a plain prompt, they will respond based on the knowledge they have extracted from their training data. In this article, I will show you a framework to give context to ChatGPT or GPT-4 (or any other LLM) with your own data by using document embeddings. To solve this problem, we can augment our LLMs with our own custom documents.

This can be problematic if you are working on an application where the language is highly technical or domain-specific.

If you prompt ChatGPT about something contained within your own organization’s documents, it will provide an inaccurate response. However, these models are limited to the information contained within their training datasets. Large language models ( LLMs) like GPT-4 and ChatGPT can generate high-quality text that is useful for many applications, including chatbots, language translation, and content creation.

Converting pdf to text document