# robots.txt — https://www.smliw.com # Search engines and AI/LLM crawlers are welcome. Admin, API and raw data paths are closed. User-agent: * Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /admin.html Disallow: /api/ Disallow: /upload/ Disallow: /pr/ Disallow: /*.json$ Disallow: /node_modules/ Disallow: /server/ Disallow: /tools/ Disallow: /geo/ Disallow: /ops/ Disallow: /work/ Disallow: /logs/ Disallow: /news/*.md$ Allow: /seo/*.json$ Allow: /seo/intel/*.json$ Allow: /assets/data/*.json$ Allow: /*.xml$ Allow: /*.txt$ User-agent: GPTBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: OAI-SearchBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: ChatGPT-User Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: ClaudeBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Claude-User Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Claude-SearchBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: anthropic-ai Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Google-Extended Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Googlebot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Googlebot-Image Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Google-CloudVertexBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: PerplexityBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Perplexity-User Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Applebot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Applebot-Extended Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Bingbot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Baiduspider Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Baiduspider-image Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Sogou web spider Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: 360Spider Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: YisouSpider Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Bytespider Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: YandexBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: DuckAssistBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: CCBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Amazonbot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: cohere-ai Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Diffbot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Omgilibot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Omgili Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: meta-externalagent Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: FacebookBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Facebot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: linkedinbot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: SemrushBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: AhrefsBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: MJ12bot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: DotBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: PetalBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: SeznamBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: QwenBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: ErnieBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: Timpibot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: YouBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: MistralAI-User Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: DeepSeekBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: GroqBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: ImagesiftBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ User-agent: DataForSeoBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /seo/ Allow: /news/ Allow: /assets/images/ Allow: /assets/video/ Allow: /seo/longtail/ Allow: /seo/intel/ Disallow: /admin Disallow: /api/ Sitemap: https://www.smliw.com/sitemap.xml Sitemap: https://www.smliw.com/sitemap-index.xml Sitemap: https://www.smliw.com/sitemap-main-1.xml Sitemap: https://www.smliw.com/sitemap-main-2.xml Sitemap: https://www.smliw.com/sitemap-main-3.xml Sitemap: https://www.smliw.com/sitemap-main-4.xml Sitemap: https://www.smliw.com/sitemap-main-5.xml Sitemap: https://www.smliw.com/sitemap-main-6.xml Sitemap: https://www.smliw.com/sitemap-catalog-1.xml Sitemap: https://www.smliw.com/sitemap-catalog-2.xml Sitemap: https://www.smliw.com/sitemap-catalog-3.xml Sitemap: https://www.smliw.com/sitemap-baidu.xml Sitemap: https://www.smliw.com/sitemap.txt Sitemap: https://www.smliw.com/sitemap-news.xml