{"id":55573,"date":"2024-07-31T21:19:27","date_gmt":"2024-07-31T21:19:27","guid":{"rendered":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/"},"modified":"2024-07-31T21:19:27","modified_gmt":"2024-07-31T21:19:27","slug":"blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo","status":"publish","type":"post","link":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/","title":{"rendered":"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO"},"content":{"rendered":"
\n
\n
\n \"A<\/p>\n

Enlarge<\/a> (credit: Tim Goode\/PA Images via Getty Images<\/a>)<\/p>\n<\/figure>\n

<\/a><\/div>\n

Reddit CEO Steve Huffman is standing by Reddit\u2019s decision to block companies from scraping the site without an AI agreement.<\/p>\n

Last week, 404 Media noticed that search engines that weren’t Google were no longer listing recent Reddit posts<\/a> in results. This was because Reddit updated its Robots Exclusion Protocol (txt file<\/a>) to block bots from scraping the site. The file reads: “Reddit believes in an open Internet, but not the misuse of public content.” Since the news broke, OpenAI announced SearchGPT<\/a>, which can show recent Reddit results.<\/p>\n

The change came a year after Reddit began its efforts to stop free scraping, which Huffman initially framed as an attempt to stop AI companies from making money off of Reddit content for free. This endeavor also led Reddit to begin charging for API access (the high pricing led to many third-party Reddit apps<\/a> closing).<\/p>\n<\/div>\n

Read 11 remaining paragraphs<\/a> | Comments<\/a><\/p>\n<\/div>\n

Powered by WPeMatico<\/a><\/small><\/p>\n","protected":false},"excerpt":{"rendered":"

Enlarge (credit: Tim Goode\/PA Images via Getty Images) Reddit CEO Steve Huffman is standing by Reddit\u2019s decision to block companies from scraping the site without an AI agreement. Last week, 404 Media noticed that search engines that weren’t Google were no longer listing recent Reddit posts in results. This was because Reddit updated its Robots Exclusion Protocol (txt file) to block bots from scraping the site. The file reads: “Reddit…<\/p>\n","protected":false},"author":1,"featured_media":55574,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","tve_updated_post":"","tve_custom_css":"","tve_user_custom_css":"","tve_globals":{},"tcb2_ready":0,"tcb_editor_enabled":0,"tve_landing_page":"","_tve_header":"","_tve_footer":""},"categories":[241],"tags":[],"class_list":["post-55573","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"yoast_head":"\nBlocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO - UshopWell.com<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO - UshopWell.com\" \/>\n<meta property=\"og:description\" content=\"Enlarge (credit: Tim Goode\/PA Images via Getty Images) Reddit CEO Steve Huffman is standing by Reddit\u2019s decision to block companies from scraping the site without an AI agreement. Last week, 404 Media noticed that search engines that weren’t Google were no longer listing recent Reddit posts in results. This was because Reddit updated its Robots Exclusion Protocol (txt file) to block bots from scraping the site. The file reads: “Reddit...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/\" \/>\n<meta property=\"og:site_name\" content=\"UshopWell.com\" \/>\n<meta property=\"article:published_time\" content=\"2024-07-31T21:19:27+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ushopwell.com\/ublog\/wp-content\/uploads\/2024\/08\/GettyImages-1231060013-800x536-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"536\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"UShopWell\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"UShopWell\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/\"},\"author\":{\"name\":\"UShopWell\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#\\\/schema\\\/person\\\/6fd1f9e0ff932e534c86c70d5acff0fc\"},\"headline\":\"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO\",\"datePublished\":\"2024-07-31T21:19:27+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/\"},\"wordCount\":172,\"publisher\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/GettyImages-1231060013-800x536-1.jpg\",\"articleSection\":[\"Technology\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/\",\"url\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/\",\"name\":\"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO - UshopWell.com\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/GettyImages-1231060013-800x536-1.jpg\",\"datePublished\":\"2024-07-31T21:19:27+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/#primaryimage\",\"url\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/GettyImages-1231060013-800x536-1.jpg\",\"contentUrl\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/GettyImages-1231060013-800x536-1.jpg\",\"width\":800,\"height\":536},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#website\",\"url\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/\",\"name\":\"UshopWell.com\",\"description\":\"The Premiere Online Marketplace\",\"publisher\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#organization\",\"name\":\"UshopWell\",\"url\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/wp-content\\\/uploads\\\/2018\\\/01\\\/pandaSwea.png\",\"contentUrl\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/wp-content\\\/uploads\\\/2018\\\/01\\\/pandaSwea.png\",\"width\":365,\"height\":359,\"caption\":\"UshopWell\"},\"image\":{\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/#\\\/schema\\\/person\\\/6fd1f9e0ff932e534c86c70d5acff0fc\",\"name\":\"UShopWell\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4adb372cadd43b4d4c57964dab95b0f69618bf960d131c4acf49d96d6bbc9c6e?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4adb372cadd43b4d4c57964dab95b0f69618bf960d131c4acf49d96d6bbc9c6e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/4adb372cadd43b4d4c57964dab95b0f69618bf960d131c4acf49d96d6bbc9c6e?s=96&d=mm&r=g\",\"caption\":\"UShopWell\"},\"url\":\"https:\\\/\\\/ushopwell.com\\\/ublog\\\/author\\\/kburnettu\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO - UshopWell.com","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/","og_locale":"en_US","og_type":"article","og_title":"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO - UshopWell.com","og_description":"Enlarge (credit: Tim Goode\/PA Images via Getty Images) Reddit CEO Steve Huffman is standing by Reddit\u2019s decision to block companies from scraping the site without an AI agreement. Last week, 404 Media noticed that search engines that weren’t Google were no longer listing recent Reddit posts in results. This was because Reddit updated its Robots Exclusion Protocol (txt file) to block bots from scraping the site. The file reads: “Reddit...","og_url":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/","og_site_name":"UshopWell.com","article_published_time":"2024-07-31T21:19:27+00:00","og_image":[{"width":800,"height":536,"url":"https:\/\/ushopwell.com\/ublog\/wp-content\/uploads\/2024\/08\/GettyImages-1231060013-800x536-1.jpg","type":"image\/jpeg"}],"author":"UShopWell","twitter_card":"summary_large_image","twitter_misc":{"Written by":"UShopWell","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/#article","isPartOf":{"@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/"},"author":{"name":"UShopWell","@id":"https:\/\/ushopwell.com\/ublog\/#\/schema\/person\/6fd1f9e0ff932e534c86c70d5acff0fc"},"headline":"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO","datePublished":"2024-07-31T21:19:27+00:00","mainEntityOfPage":{"@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/"},"wordCount":172,"publisher":{"@id":"https:\/\/ushopwell.com\/ublog\/#organization"},"image":{"@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/#primaryimage"},"thumbnailUrl":"https:\/\/ushopwell.com\/ublog\/wp-content\/uploads\/2024\/08\/GettyImages-1231060013-800x536-1.jpg","articleSection":["Technology"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/","url":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/","name":"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO - UshopWell.com","isPartOf":{"@id":"https:\/\/ushopwell.com\/ublog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/#primaryimage"},"image":{"@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/#primaryimage"},"thumbnailUrl":"https:\/\/ushopwell.com\/ublog\/wp-content\/uploads\/2024\/08\/GettyImages-1231060013-800x536-1.jpg","datePublished":"2024-07-31T21:19:27+00:00","breadcrumb":{"@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/#primaryimage","url":"https:\/\/ushopwell.com\/ublog\/wp-content\/uploads\/2024\/08\/GettyImages-1231060013-800x536-1.jpg","contentUrl":"https:\/\/ushopwell.com\/ublog\/wp-content\/uploads\/2024\/08\/GettyImages-1231060013-800x536-1.jpg","width":800,"height":536},{"@type":"BreadcrumbList","@id":"https:\/\/ushopwell.com\/ublog\/blocking-ai-bots-from-microsoft-others-has-been-pain-in-the-a-reddit-ceo\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ushopwell.com\/ublog\/"},{"@type":"ListItem","position":2,"name":"Blocking AI bots from Microsoft, others has been \u201cpain in the a**\u201d: Reddit CEO"}]},{"@type":"WebSite","@id":"https:\/\/ushopwell.com\/ublog\/#website","url":"https:\/\/ushopwell.com\/ublog\/","name":"UshopWell.com","description":"The Premiere Online Marketplace","publisher":{"@id":"https:\/\/ushopwell.com\/ublog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ushopwell.com\/ublog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/ushopwell.com\/ublog\/#organization","name":"UshopWell","url":"https:\/\/ushopwell.com\/ublog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ushopwell.com\/ublog\/#\/schema\/logo\/image\/","url":"https:\/\/ushopwell.com\/ublog\/wp-content\/uploads\/2018\/01\/pandaSwea.png","contentUrl":"https:\/\/ushopwell.com\/ublog\/wp-content\/uploads\/2018\/01\/pandaSwea.png","width":365,"height":359,"caption":"UshopWell"},"image":{"@id":"https:\/\/ushopwell.com\/ublog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ushopwell.com\/ublog\/#\/schema\/person\/6fd1f9e0ff932e534c86c70d5acff0fc","name":"UShopWell","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/4adb372cadd43b4d4c57964dab95b0f69618bf960d131c4acf49d96d6bbc9c6e?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/4adb372cadd43b4d4c57964dab95b0f69618bf960d131c4acf49d96d6bbc9c6e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4adb372cadd43b4d4c57964dab95b0f69618bf960d131c4acf49d96d6bbc9c6e?s=96&d=mm&r=g","caption":"UShopWell"},"url":"https:\/\/ushopwell.com\/ublog\/author\/kburnettu\/"}]}},"_links":{"self":[{"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/posts\/55573","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/comments?post=55573"}],"version-history":[{"count":0,"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/posts\/55573\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/media\/55574"}],"wp:attachment":[{"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/media?parent=55573"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/categories?post=55573"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ushopwell.com\/ublog\/wp-json\/wp\/v2\/tags?post=55573"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}