User-agent: * Allow: /$ Allow: /top.html$ Disallow: /api/* Disallow: /rss* #Disallow: /search*