AHMED
0161924088
- launch.ts policy: LAUNCH_MODE=free_early_access default; effective access = published && (free || early); intended tier (access) never rewritten - Billing off server-side: /api/subscribe 503 honest copy; subscribe CTAs render disabled 'قريباً' from first paint; /subscription early-access panel + /api/notify (LaunchNotifications) with honest 503 when mail transport off - Signup trust: verification email at signup (Users afterChange), no confirm-password, 429 message fidelity, typo suggestion, live password hint - Agent pipeline: pickFields strips access/readingMinutes, sourceId dedup, secret-scan 422 (pattern names only), string-content rejected (was silently replaced), publish stays explicit opt-in - lexical.ts: root unwrap fix — lexicalToText/countLexicalWords returned 0 for real serialized trees (secret scan + readingMinutes were inert) - llms-full.txt: fetchIndexDocs(true) — bodies were never selected - Content honesty: contentType/authorName/sourceId fields + migration, readingMinutes computed at write (160 wpm) + backfill script, byline, 'حُدّث' freshness - SEO/AI-SEO: metadata rewrite (published-only, og:image 1200x630), Article + BreadcrumbList + FAQPage + Organization JSON-LD, isAccessibleForFree honest, table renderer, robots AI-crawler policy (10 named bots), llms.txt + llms-full.txt, /topics/* hubs + sitemap, noindex auth pages, www 301 - Ops: backup-db.sh (restore rehearsed on VPS), docs copies (launch readiness + marketing audit + owner-inputs for L-03), GLOSSARY.md entries Verified: tsc --noEmit 0, npm run build 0, local smoke (ghost VIP read, subscribe/notify/agent APIs, signup token, 429 on 6th, llms/topics/sitemap, og:image/JSON-LD)
36 lines
996 B
TypeScript
36 lines
996 B
TypeScript
import type { MetadataRoute } from 'next'
|
|
const base = process.env.NEXT_PUBLIC_SITE_URL ?? 'https://anwarpi.ai'
|
|
|
|
/* Owner decision: allow all named search/AI crawlers explicitly. The `*`
|
|
group keeps its `/api` disallow; the named groups opt back into the
|
|
public content APIs and the llms.txt feeds. */
|
|
const AI_BOTS = [
|
|
'GPTBot',
|
|
'OAI-SearchBot',
|
|
'ChatGPT-User',
|
|
'ClaudeBot',
|
|
'Claude-User',
|
|
'Claude-SearchBot',
|
|
'PerplexityBot',
|
|
'Google-Extended',
|
|
'Applebot',
|
|
'Bingbot',
|
|
]
|
|
|
|
export default function robots(): MetadataRoute.Robots {
|
|
return {
|
|
rules: [
|
|
...AI_BOTS.map(userAgent => ({
|
|
userAgent,
|
|
allow: ['/', '/api/posts', '/llms.txt', '/llms-full.txt'],
|
|
})),
|
|
{
|
|
userAgent: '*',
|
|
allow: '/',
|
|
disallow: ['/admin', '/api', '/account-settings', '/onboarding', '/vip-onboarding', '/verify-email', '/payment-success', '/payment-cancelled', '/forgot-password'],
|
|
},
|
|
],
|
|
sitemap: `${base}/sitemap.xml`,
|
|
}
|
|
}
|