How does google protect its javascripts against being executed by bots?

Web Technologies Web Development 2 years ago

0 1 0 0 0 tuteeHUB earn credit +10 pts

5 Star Rating 1 Rating
_x000D_ _x000D_ I want to make certain areas of my website accessible to browser users only, and not accessible to automated multithread bots. I am doing this to protect my data, and this is one of the measures I plan to use. I thought of requiring all the requests to contain a pair of numbers, which must be computed with javascript, which is going to be obfuscated and obscured. But, after that, there's nothing that should stop a bot writer from grabbing a javascrpt bot engine like htmlunit and just executing the javascripts. Google seems to had solved this problem somehow. I remember that most times I run HtmlUnit on a page with adwords enabled, the script engine crashed. Yet, in real browsers, the pages work just fine. There must be a trick to it. Can anyone point me to a good info on how I could do this on my page?

Posted on 16 Aug 2022, this text provides information on Web Development related to Web Technologies. Please note that while accuracy is prioritized, the data presented might not be entirely correct or up-to-date. This information is offered for general knowledge and informational purposes only, and should not be considered as a substitute for professional advice.

Take Quiz To Earn Credits!

Turn Your Knowledge into Earnings.

tuteehub_quiz

Answers (1)

Post Answer
profilepic.png
manpreet Tuteehub forum best answer Best Answer 2 years ago
_x000D_ Based on your requirements, I'd implement some type of authentication. Of course, with respect to how big and known your user base is. Some options are: Have data included from javascript file or ajax call. Most bots won't scrape javascript-included text off of a webpage. Maybe load a blank page, give a short delay (2-3 seconds), and then load the content. That way, most (?) bots will simply detect a blank page. HTTP Authentication would require that users enter a username and password, but it's very simple to manage. Captcha User accounts using maybe php. This may be more overhead than you want though.

No matter what stage you're at in your education or career, TuteeHub will help you reach the next level that you're aiming for. Simply,Choose a subject/topic and get started in self-paced practice sessions to improve your knowledge and scores.

Important Web Technologies Links