Computer Science · Web Technology

What is the purpose of the 'robots.txt' file in relation to search engines?

Verified Solution4 OptionsUpdated: October 2026👁️1 View

1It improves website loading speed.
2It enhances the underlying website security.
3It instructs search engine crawlers on which pages to index or ignore.✓
4It automatically redirects users to different URLs.

Correct answer

It instructs search engine crawlers on which pages to index or ignore.

Download Single Question PDF

Save this question and verified answer as a clean study sheet with live clickable link.

👥

Share with Friends & Study Groups

Challenge your peer aspirants on WhatsApp or Telegram to solve this question!

Online Test Series

Preparing for Computer Science?

Practice full-length mock tests with real exam timers, instant score analysis, and all-India ranking.

Start Free Mock Test →

Chapter Practice

Want more practice questions on Web Technology?

Solve complete topic-wise tests with detailed solutions on GkGet.

Practice Web Technology MCQs →

Recommended practice questions in Computer Science · Web Technology

Browse More Computer Science →

Which of the following events is considered a major turning point that fueled Indian nationalism during British rule due to its brutal nature and widespread condemnation?

Solve Question→

Which of the following events is considered the first major peasant uprising against the British in India?

Solve Question→

What is the purpose of the 'robots.txt' file in relation to search engines?

Download Single Question PDF

Share with Friends & Study Groups

Preparing for Computer Science?

Practice by Subject

Practice by Exam

Topic-Wise Solved Questions

What is the purpose of the 'robots.txt' file in relation to search engines?

Download Single Question PDF

Share with Friends & Study Groups

Preparing for Computer Science?

Related Practice Questions

Practice by Subject

Practice by Exam

Topic-Wise Solved Questions