User-agent: * Disallow: /images-files/ Disallow: /css-files/ Disallow: /media-files/ Disallow: /backup-files/ Disallow: /404.html