AINRO.IO's ChatGPT website chatbot, AI Expert System, and AI Website Search are based on scraping your website. The technique is actually quite simple. However, how can we end up having so much higher quality than most others?
What we do is really simple. We scrape your website, and then we store your website's text as context snippets in a database. When users ask a question to our ChatGPT website chatbot, we use OpenAI's embedding API to look for the most relevant context snippets and attach this as a "context" to the question before we send the question to ChatGPT. This allows OpenAI to return an answer to your question using the supplied context as the foundation for the answer. Fundamentally you could argue the following.