Edit Robots.txt website.robots

Test your robots.txt with Google Search Console

Example of rule:
Disallow: /web/login
Allow: *