GPT-4 & Pinecone - Ask Questions About Any Website: Academy

In this video tutorial, we'll go through a Colab notebook that shows you how to crawl a website and turn it into a GPT-4 enabled AI assistant.

In this case, I've crawled my own website but you could apply it to many other use cases that involve augmenting GPT-4 with a separate body of knowledge or external database.

This is the video companion to the article below:

GPT-4 & Pinecone: Turning a Website into an AI Assistant

In this guide, we’re going to augment GPT-4 with a separate body of knowledge and use a vector database to create a custom AI assistant.

MLQ.aiPeter Foy

In the notebook, the steps I'll walk through include:

• Scraping my own site MLQ.ai
• Convert the text from each article into embeddings using the OpenAI API
• Store these embeddings in a vector database: Pinecone
• Use GPT-4 to query the site, answer with context, and return relevant article sources