From PC Mag: With its new GPTBot, AI models from OpenAI can crawl the web for new information, meaning your website and its content can be scraped to train artificial intelligence—unless you opt out.
"Web pages crawled with the GPTBot user agent may potentially be used to improve future models," OpenAI says. "Allowing GPTBot to access your site can help AI models become more accurate and improve their general capabilities and safety."
OpenAI notes that GPTBot will not breach sites that require paywall access, a nod to a recent controversy where ChatGPT Plus members using "Browse with Bing" were able to bypass paywalls to read articles. GPTBot will also filter out sources "known to gather personally identifiable information, or have text that violates our policies."
View: Full Article
