Wordpress and file ROBOTS.TXT

Consider the possibility to use such file ROBOTS.TXT

User-agent: *
Disallow: /page/
Disallow: /category/
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /wp-admin/
Disallow: /cgi-bin/

which means any agent may grab anywhere on site, except of these directories and below /page/, /category/, /wp-content/, /wp-includes/, /wp-admin/, /cgi-bin/
[TS]