According to a cloud flair report, AI search startup has allegedly preventing its AI web crallers from accessing some websites. In the report, Cloud Flair claims that when the problem is facing a block, the startup will hide its creeping identity “in an attempt to stop the website’s priorities”.
The report only raises concerns about eliminating disturbing content without any permission, as the company was trapped last year to stop the paywills of the past and ignore site robots. At that time, CEO of the hassle, Irund Sri Navas, used this activity through a site on third party crawls.
Now, one of the world’s largest Internet architecture providers, Cloud Flair says he received complaints from users who claim that Felixi’s boats have access to their websites after giving priority to their websites’ websites robot dot TST file and access to their websites. By forming.
To examine this, Cloud Flair says he has created new domains with similar sanctions against the AI scripts of anxiety. It has been found that the beginning will first try to access the sites by identifying yourself as the names of your crawlers: “disturbing boot” or “the use of anxiety.”
But if there are restrictions on AI scraping on the website, Cloud Flair claims that anxiety will change its user agent – the information that tells a website how you are using a browser and device, or if the visitors are a boot – “to compromise Google Chrome on Macos.” Cloud Flare says that this “unannounced crawler” uses “rotating” IP addresses that the company does not add to the list of IP addresses used by its boats.
In addition, Cloud Flair claims that anxiety changes its independent system networks (ASN), which is used to identify groups of IP networks in a large number of IP networks, which are controlled by an operator, to get blocks. Cloud Flair writes, “This activity was seen in tens of thousands of domains and millions of requests every day.
In a statement StuffyDouyer, a spokesman for the hassle, called the cloud flair report “stunt of advertising”, adding that “there are many misunderstandings in the blog post.” Cloud Flare has then made a list of anxiety as a certified boot and has developed ways to stop the “stealth creep” of anxiety.
