← DashboardHardware & Chipsets

Documentation

Disclaimer: This site is for informational purposes only. Model rankings, usage data, pricing, capabilities and hardware results change frequently and may vary by benchmark, provider and workload. Verify current source data, licensing, security, privacy, compliance and deployment requirements before making production or purchasing decisions.

AI SOTA Shift Tracker

Tracks state-of-the-art (SOTA) shifts across public LLM leaderboards, token-utilisation rankings and the AI-SOTA KG knowledge graph.

Live app: https://ai-sota-atlas.lovable.app · Docs in the app: /docs · Architecture: docs/ARCHITECTURE.md · How to use: docs/HOW_TO_USE.md · Ontologies: ontology/

Created by Dr Shyam Sundaram.


1. What the dashboard does

SectionRoutePurpose
Leaderboard dashboard/Normalized benchmark results per category, filters, charts, details table, batch status, Refresh now / Auto-refresh
Token utilisation report/tokensKPI band, data-quality panel, charts, country drill-down, granular table, CSV export
AI-SOTA KG/knowledge-graphInteractive graph of models, developers, countries, benchmarks, categories and token slices
API docs/api-docsPublic REST endpoints (OpenAPI JSON at /api/public/docs)
Documentation/docsREADME, How to use, Architecture and Ontology (TTL downloads + metrics)
Hardware & Chipsets/hardwareAccelerator catalogue, server systems, side-by-side comparison, workload memory sizing and measured MLPerf results

Categories

Sources are defined in pipeline/config.json. Pages that draw their tables in the browser, or publish no table, are kept as reference-only — scores are never invented.

2. Using the dashboard

Token report and knowledge graph pages each show a Sources panel listing every feed in the current batch with row counts.

3. Data model

Normalized leaderboard record:

{
  "source_name": "artificial_analysis",
  "source_url": "https://artificialanalysis.ai/leaderboards/models",
  "retrieved_at": "2026-08-02T10:30:00Z",
  "category": "global_frontier",
  "model_name": "Claude Opus",
  "model_version": "4.8",
  "benchmark_name": "AA Leaderboard",
  "metric_name": "intelligence",
  "metric_value": 57.9,
  "metric_unit": "score",
  "rank": 1,
  "date_reported": "2026-07-23",
  "scope_region": "global",
  "task_type": "general",
  "raw_hash": "..."
}

Token records carry slice, model, developer, country (developer home country), weekly tokens, share and week-over-week growth. KPIs are defined in pipeline/token_config.json.

4. REST API

MethodPathDescription
GET/api/public/datasetLatest leaderboard dataset
POST/api/public/scrapeRun collector now (leaderboards + tokens)
POST/api/public/ingestPush a normalized dataset (from the Python pipeline)
GET/api/public/tokensToken records; slice, country, developer, model, group_by, format=csv, limit
POST/api/public/tokens/refreshRe-collect token data only
GET/api/public/graphKnowledge graph; mini, types
GET/api/public/docsOpenAPI 3 spec

5. Offline Python pipeline

python -m pip install -r pipeline/requirements.txt
python pipeline/scraper.py --config pipeline/config.json --out pipeline/out/raw_records.json
python pipeline/process.py --in pipeline/out/raw_records.json --out src/data/records.json
python pipeline/scheduler.py --once --dashboard-url https://ai-sota-atlas.lovable.app

Async, robots.txt-aware, randomized 1–5 s delays, rotating User-Agents, Pydantic extraction schema, exponential backoff; pandas cleaning, snake_case columns, dedup, per-category caps. See pipeline/README.md.

6. Known limitations

7. Ontologies

ontology/leaderboard.ttl, ontology/tokens.ttl, ontology/knowledge-graph.ttl, ontology/hardware.ttl — OWL schemas per section; downloadable at /docs → Ontology. See ontology/README.md.

Hardware & Chipsets

The /hardware section connects model evaluation with deployment constraints. Its source-linked catalogue covers NVIDIA H100/H200/B200 and GB200, AMD MI300X/MI325X/MI350X, Google TPU v5p and AWS Trainium2/Inferentia2. Server configurations include NVIDIA DGX and GB200 NVL72, Dell PowerEdge, Lenovo ThinkSystem and Supermicro; HPE is currently a configuration reference, with unverified values left unknown.

8. Development

git clone <this-repository-url>
cd <repository-name>
npm i
npm run dev

Built with Lovable — changes sync two-way with GitHub.