At Eregos, we believe that open access to information should never come at the cost of digital integrity. Our commitment to transparency is built into the very code of our products, ensuring that as we score the world’s information, we remain a responsible citizen of the web.
EregosBot
Unlike intrusive scrapers that bypass security or overload servers, EregosBot is designed to be a "polite" crawler. We follow strict industry standards to ensure our presence on the web is helpful, not harmful.
-
Always Asks for Permission: EregosBot identifies itself clearly via its User-Agent string. Before accessing any page, it checks for a
robots.txtfile to see what the site owner has permitted. -
Respects the Gatekeepers: If a site owner marks a directory as "Disallow," EregosBot will not enter. We believe the owner’s choice is final.
-
Rate Limiting: We implement intelligent throttling. EregosBot never "floods" a server with requests; it staggers its activity to ensure the target website remains fast and stable for its human users.
Respect for Global Laws
Digital borders are complex, and Eregos is built to respect them. We monitor and adapt to country-level regulations regarding data collection and automated scraping.
-
Compliance by Region: Whether it is the GDPR in Europe, CCPA in California, or regional scraping regulations in Asia and Australia, EregosBot operates within the legal frameworks of the territory it is accessing.
-
Public Data Only: We do not scrape data behind logins, paywalls, or private portals. Our mission is to make publicly accessible information more useful, not to intrude on private spaces.
-
No IP Exploitation: As stated in our Privacy Policy, we do not use IP addresses to track user behavior or lookups, maintaining a clean line between data collection and user privacy.
Accountability in Action
Transparency isn't just a word; it’s a practice. We hold ourselves accountable through:
-
Clear Identification: Every request made by our bot includes a link to our documentation, so webmasters can see exactly who we are and how to contact us.
-
Content Integrity: We do not alter the source information we find. We provide a bridge to existing data, ensuring that the original creators receive the credit and traffic they deserve.
-
Constant Evolution: As web standards like
ai.txtor new ethical scraping protocols emerge, Eregos is at the forefront of adopting them.