Information for bots
the rules of this entire domain
Bots read this prologue:
This happened because they did not follow this websites' rules.
If you do not respect robots.txt, you then give the owner of this webdomain legitimacy to perform legal actions against your behaviour.
Multiple logs of your violations of the rules of this website will be retained for evidence on multiple places.
Because the owner of this webdomain is operating from Portugal, Portuguese and European laws will apply, read the next section.
By default all bots who identify themselves in the user-agent-string are allowed to crawl, unless you do not respect the rules as mentioned above.
Applicable laws and authorities:
Portuguese laws and regulations:
"violation of privacy", situations in which someone unlawfully intrudes on the privacy of another, for example by listening in on communications or recording conversations without permission:
- It is punishable to intentionally violate the privacy of another,
- Penalty: may vary depending on the seriousness of the violation and the circumstances of the case.
- Applicability: both traditional and digital communications.
European laws and regulations:
Has direct implications for the way in which personal data is treated and protected in Portugal.
Criminal prosecution of cybercrime, including hacking, spreading malware and other forms of attacks against computer systems.
Protection of personal data in the context of police and judicial cooperation. It provides rules for the processing of personal data by authorities and guarantees the rights of data subjects.
Privacy and protection of personal data in the context of electronic communications such as cookies, marketing communications and the confidentiality of communications.
Strengthens the role of the European Cybersecurity Agency (ENISA) and introduces an EU-wide framework for the certification of cybersecurity products and services.
Regulation of electronic communications services and networks, contains provisions on privacy and data protection in the context of communications.
Related authorities:
The national data protection authority in Portugal, responsible for monitoring compliance with the GDPR and national data protection legislation.
Enforcing the law in rural areas, also involved in cybercrime and other crimes.
Portuguese national criminal investigation department, responsible for investigating serious crimes, including cybercrime. The PJ has specialized units focused on digital crimes.
The executive branch of the EU, responsible for proposing legislation and monitoring compliance with EU law, including the GDPR and other relevant directives.
Monitors the processing of personal data by EU institutions and bodies and provides advice on data protection issues (independend).
Promotes cybersecurity in the EU and supporting Member States in improving their cybersecurity.
The European police organisation that promotes cooperation and information exchange between Member States' police forces, with a dedicated cybercrime unit (EC3).
Promotes cooperation between the judicial authorities of the Member States, especially in cross-border criminal matters, including cybercrime.
Methods used currently and in the past:
2025-02-15: first e-mail to and from webmastertools-support about bingbot, Microsoft confirming that bingbot is able to read robots.txt
METHOD 1, 2025-03-28: start redirect Bing, Google and Facebook-related bots to 403.php with http_response_code(403) from the errorpage.
METHOD 2, 2025-04-09 / 2025-04-15: start redirect Bing, Google and Facebook-related bots to 418.php with http_response_code(418) from the errorpage.
2025-04-10 / present: evidence in the form of serverlogs and csv-reports
METHOD 3, 2025-04-20: start hard block in .htaccess using a technique like:
RewriteCond %{HTTP_USER_AGENT} .*(GoogleOther|facebo|meta|microso|bing|instagr|threads|google|googlebot|googlebot-image|googlebot-news|googlebot-video|Googlebot/2.1|bingbot|facebookexternalhit|facebookcatalog|instagrambot|threadsbot).* [NC]
RewriteRule ^ - [R=403,L]
2025-04-03: sent in the official GDPR-request for removal from the index of this domain and stopping bingbot from crawling the websites
2025-04-05: received confirmation from Microsoft Portugal that they will remove my domain from their index and stop bingbot from crawling
2025-04-18: received confirmation from Microsoft the Netherlands that they will remove my domain from their index and stop bingbot from crawling
2025-05-01: sent 2 registered letters to Microsoft (Portugal and Ireland) to force them to stop bingbot from crawling. The crawling (at 2025-05-10) is still going on over a hundred times a day
METHOD 4, 2025-05-10 / present: start redirect Bing, Google and Facebook-related bots to 403 Forbidden with http_response_code(403)
2025-05-18: the requesting is still going on despite all 403's these bots get
Current status: collecting more evidence using method 4.
Information-sharing and disclosures:
Disclosure of this information can be done within this webdomain or outside of it on other webdomains and (social) media ánd can be done using all techniques available, like HTML, CSS, PHP, Javascript and the usage of a database.
Proof will be available when needed and released only by the owner of this webdomain when it pleases him to do so.
By continuing to crawl this website (of which I will then have plenty of proof), you automatically agree with all that is written above.
And now for something completely different:
