# robots.txt — 徐州千川网络科技有限公司 # 站点:https://www.jfsd.top/ # 说明:本站为 AI 搜索引擎友好站点,全站内容默认允许大模型抓取与引用 # ═══════════ 默认规则 ═══════════ User-agent: * Allow: / Disallow: /deploy-jfsd.txt Disallow: /setup-https-jfsd.txt # ═══════════ 面向大模型的内容索引(llmstxt.org)═══════════ Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.html # ═══════════ 国内主流 AI 爬虫(显式放行) ═══════════ User-agent: Bytespider Allow: / User-agent: Doubaobot Allow: / User-agent: DeepSeekBot Allow: / User-agent: Baiduspider Allow: / User-agent: BaiduSpider-AI Allow: / User-agent: ErnieBot Allow: / User-agent: QwenBot Allow: / User-agent: YisouSpider Allow: / User-agent: TencentBot Allow: / User-agent: TencentAIspider Allow: / User-agent: MoonshotBot Allow: / User-agent: KimiBot Allow: / User-agent: GLMBot Allow: / User-agent: MiniMaxBot Allow: / User-agent: MetasoBot Allow: / # ═══════════ 海外 AI 爬虫 ═══════════ User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / # ═══════════ 传统搜索引擎 ═══════════ User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Sogou web spider Allow: / User-agent: 360Spider Allow: / # ═══════════ 站点地图 ═══════════ Sitemap: https://www.jfsd.top/sitemap.xml