User-agent: *
Disallow: /redirect
Disallow: /go
User-agent: ia_archiver
Disallow: /