User-Agent: *
Disallow: /doc*
Disallow: /api-doc*
Disallow: /register*
Disallow: /comments*
Disallow: /browse*
Disallow: /google*
Disallow: /shop*
Disallow: /contact*
Disallow: /group*
Disallow: /flush*
Disallow: /flush.tcl
Disallow: archives*
Disallow: /rezo/admin*
Disallow: /tmp*
Disallow: *print_p*
Disallow: /send-this-page

User-Agent:Slurp
Disallow:*

User-Agent:twiceler
Disallow:*