index.html
Kod
<!DOCTYPE html>
<head>
<meta charset="UTF-8">
<meta name="robots" content="index,follow,noarchive">
<title>Robots everywhere!!!</title>
</head>
<body>
<img src="uploads/robots/bot.jpg">
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Quisque malesuada ultrices aliquet. Nam elementum, dolor quis pharetra rutrum, augue velit vehicula quam, nec sollicitudin sem mauris quis velit. Maecenas porttitor tempor tristique. Praesent venenatis commodo lorem sit amet gravida. Ut a quam justo. Proin eleifend massa eget lorem tincidunt in lobortis ante hendrerit. Nulla dignissim, tellus quis pulvinar rutrum, neque tortor mattis justo, vitae facilisis tellus felis congue urna. Donec volutpat libero lobortis est lobortis imperdiet. Fusce adipiscing malesuada tortor, id accumsan magna facilisis nec. Proin a nisi sed sapien consectetur volutpat. Praesent mi nibh, aliquet sit amet lobortis ac, cursus eget orci.
</body>
</html>
<head>
<meta charset="UTF-8">
<meta name="robots" content="index,follow,noarchive">
<title>Robots everywhere!!!</title>
</head>
<body>
<img src="uploads/robots/bot.jpg">
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Quisque malesuada ultrices aliquet. Nam elementum, dolor quis pharetra rutrum, augue velit vehicula quam, nec sollicitudin sem mauris quis velit. Maecenas porttitor tempor tristique. Praesent venenatis commodo lorem sit amet gravida. Ut a quam justo. Proin eleifend massa eget lorem tincidunt in lobortis ante hendrerit. Nulla dignissim, tellus quis pulvinar rutrum, neque tortor mattis justo, vitae facilisis tellus felis congue urna. Donec volutpat libero lobortis est lobortis imperdiet. Fusce adipiscing malesuada tortor, id accumsan magna facilisis nec. Proin a nisi sed sapien consectetur volutpat. Praesent mi nibh, aliquet sit amet lobortis ac, cursus eget orci.
</body>
</html>
robots.txt
Kod
User-agent: *
Disallow: /uploads/robots/
Disallow: /uploads/robots/
Zawartość strony zostanie zindeksowana, ale plik *.jpg nie trafi do wszukiwarek grafiki?