Website review
This review may include AI-generated content and is not individually verified. Domain, certificate and other facts come from the observed data on this page.
What is CoreWeave Forge?
CoreWeave Forge is the part of the CoreWeave platform aimed at teams that build, evaluate, and run AI models and agents. It groups together tools for experiment tracking, LLM and agent evaluation, notebooks, model and dataset registries, and serverless options for serving, fine-tuning, and sandboxed execution.
From the documentation index, Forge covers:
- Weights & Biases (W&B Models and W&B Weave) — experiment tracking, hyperparameter sweeps, artifacts, reports, and automations; Weave handles LLM and agent evaluation.
- ARIA — an AI research agent that analyzes experiments, explains results, and builds visualizations and reports (listed as Preview).
- Agent Lens — observability and improvement for agents.
- Notebooks — reactive Python notebooks for exploring data, prototyping model workflows, and analyzing runs and artifacts.
- Registry — a versioned hub for models and datasets with lineage and deployment handoff.
- Serverless services — Post-Training (Serverless RL and SFT), Serverless Inference (OpenAI-compatible API integrated with Weave), and Serverless Sandbox (on-demand isolated compute you create and discard from Python).
Forge sits alongside the rest of the CoreWeave stack: infrastructure (instances, capacity, regions, billing, policies), Mission Control, infrastructure control (CKS plus storage and networking), observability (Grafana dashboards, logs, metrics, telemetry, alerts), and access control.
Practical takeaway: Forge is most relevant if your work is model development and evaluation rather than raw cluster operations. A typical path is to prototype in Notebooks, track runs and artifacts in W&B, evaluate an LLM or agent with Weave, version the result in Registry, then hand it off to Serverless Inference or Post-Training. If your main need is managing Kubernetes clusters or hardware, the Infrastructure and Infra Control sections are the better starting points.
Next step: Open the Forge section of the CoreWeave documentation and read the Weights & Biases and Serverless Inference pages first, since together they show the most common develop-to-deploy workflow.
How do I get started with CoreWeave Forge?
Start with the Forge section of the documentation index, then pick the specific Forge product that matches your task — the docs are organized by capability rather than as a single linear tutorial.
What the Forge section covers
- Develop and evaluate — experiment tracking, evaluation, and improvement of agents and LLM applications, plus prototyping in notebooks and model lifecycle management.
- Weights & Biases — W&B Models for experiment tracking, hyperparameter sweeps, artifacts, reports, and automations, with W&B Weave for LLM and agent evaluation.
- ARIA — an AI research agent that analyzes experiments, explains results, and builds visualizations and reports (listed as preview).
- Agent Lens — observability and improvement for agents.
- Notebooks — reactive Python notebooks for exploring data, prototyping model workflows, and analyzing runs and artifacts.
- Registry — a versioned hub for models and datasets with lineage and deployment handoff.
- Serverless services — Post-Training, Serverless Inference, and Serverless Sandbox, for serving, fine-tuning, and running models without managing infrastructure.
A practical first path
If you are new, the lowest-friction entry point is Notebooks: you get a Python environment for exploring data and prototyping without committing to a training or serving setup. If your goal is measuring model or agent quality, start with Weights & Biases instead, since tracking and evaluation are the foundation the other Forge tools build on. If you already have a model and want to expose it, go straight to Serverless Inference.
Choosing between them
| Your immediate goal | Start with |
|---|---|
| Explore data, prototype workflows | Notebooks |
| Track experiments, compare runs | W&B Models |
| Evaluate an LLM app or agent | W&B Weave or Agent Lens |
| Store and version models/datasets | Registry |
| Serve or fine-tune a model | Serverless Inference / Post-Training |
Note that Forge sits alongside separate infrastructure documentation — Platform, Mission Control, Infra Control (including CoreWeave Kubernetes Service), Observability, Workloads, and Access Control. You will likely need the Access Control pages for accounts and authentication before any Forge tool will run against your environment.
Your next step: open the Forge index page, choose the product matching the table above, and follow its own getting-started page rather than the top-level index, which is a map rather than a walkthrough.
What tools does Forge provide for tracking and evaluating machine learning experiments?
Forge's experiment tracking and evaluation tools are centered on Weights & Biases, with ARIA and Agent Lens adding analysis and agent observability on top.
Core tracking and evaluation
- W&B Models — experiment tracking, hyperparameter sweeps, artifacts, reports, and automations.
- W&B Weave — evaluation and monitoring for LLM and agent applications, positioned alongside Models.
- ARIA — an AI research agent that analyzes experiments, explains results, and builds visualizations and reports (listed as preview).
- Agent Lens — observability and improvement for agents.
- Notebooks — reactive Python notebooks for exploring data, prototyping model workflows, and analyzing runs and artifacts.
- Registry — a versioned hub for models and datasets with lineage and deployment handoff.
How the pieces differ
| Need | Likely fit |
|---|---|
| Classic training runs, sweeps, artifacts, reports | W&B Models |
| LLM/agent evaluation and monitoring | W&B Weave |
| Agent-specific observability | Agent Lens |
| Explaining results and generating visualizations | ARIA (preview) |
| Interactive exploration of runs and artifacts | Notebooks |
| Versioning models/datasets with lineage | Registry |
A practical next step
If you are already logging runs with W&B Models, the fastest way to add evaluation is to route your LLM or agent traces through Weave and use Agent Lens for agent behavior; keep Notebooks for exploratory analysis and Registry for promoting evaluated artifacts. If you are starting fresh, begin with W&B Models for training metrics and sweeps, then layer in Weave when you begin evaluating prompts or agents.
One caveat: ARIA and Agent Lens are described as preview or newer additions, so verify current availability before making them a dependency in a production workflow. Start from the Forge section of CoreWeave Docs to confirm which of these are generally available.
How does Weave help with evaluating LLM applications and agents?
Weave is CoreWeave's tool for evaluating LLM applications and agents, positioned alongside W&B Models for experiment tracking. According to the CoreWeave documentation, W&B Weave sits next to W&B Models and is intended specifically for "LLM and agent evaluation," while models themselves are managed across their lifecycle under Forge's develop-and-evaluate section. That tells you the intended division of labor: Weave is the evaluation layer, not the training or serving layer.
What that means in practice
If you are building an agent or an LLM application, evaluation is usually the hardest part to get right. You need to know whether a change to a prompt, a retrieval step, or a tool-calling loop actually improved things. Weave's role, as described, is to give you a place to run and compare those evaluations rather than eyeballing outputs. The docs also mention Serverless Inference is "integrated with Weave," which suggests you can evaluate against served open-source foundation models without wiring up your own inference stack.
A concrete scenario: you have a support agent that calls two tools. You change the system prompt and want to know if resolution quality improved without regressions on edge cases. An evaluation tool like Weave is where you would define those cases, run them against both versions, and compare results — rather than shipping and hoping.
Where it fits among the other tools
| Tool | Primary job |
|---|---|
| W&B Models | Experiment tracking, sweeps, artifacts, reports |
| W&B Weave | LLM and agent evaluation |
| Agent Lens | Agent observability and improvement (marked Preview) |
| ARIA | AI research agent that analyzes experiments and builds reports (marked Preview) |
| Registry | Versioned models and datasets with lineage |
Note that Agent Lens and ARIA are both labeled Preview in the page evidence, so treat them as less settled than Weave itself.
Next step
Decide based on what you lack. If you can already run evaluations but cannot see why an agent failed in production, look at Agent Lens. If your problem is comparing candidate prompts or models systematically, Weave is the direct fit. Start from the Forge section of the documentation to see how Weave connects to Models and Serverless Inference.
What options does Forge offer for serving and fine-tuning models without managing infrastructure?
Forge covers this through its Serverless services group, which is explicitly framed as serving, fine-tuning, and running models on CoreWeave infrastructure without you managing it. Two entries sit under that heading:
- Serverless Inference — open-source foundation models exposed through an OpenAI-compatible API, integrated with Weave. The OpenAI-compatible interface matters practically: code already written against the OpenAI client libraries can often be repointed at this endpoint with minimal changes, which lowers migration effort for teams prototyping or comparing models.
- Serverless Sandbox — on-demand, isolated compute environments created and discarded from Python. This suits short-lived jobs (testing a fine-tune, running an evaluation, reproducing a result) where you do not want a persistent cluster.
Fine-tuning specifically is addressed under Post-Training, described as post-training and fine-tuning LLMs with Serverless RL and SFT, plus distilling specialized models from real application traffic. So the "no infrastructure management" path splits by intent: inference for serving, post-training for adapting models, sandbox for throwaway compute.
A useful next step: decide which of the three you actually need before reading further. If you only need to call an existing open-source model, start with Serverless Inference. If you have your own data and want a model tailored to it, start with Post-Training. If you are still experimenting, the Sandbox is the cheapest place to be wrong.
Note that Forge also includes adjacent tooling that is not itself serverless: Weights & Biases for experiment tracking, sweeps, artifacts and reports; Weave for LLM and agent evaluation; ARIA, an AI research agent that analyzes experiments and builds visualizations; Agent Lens for agent observability; Notebooks for prototyping; and a Registry for versioned models and datasets with lineage and deployment handoff. These are the layers you would typically pair with the serverless endpoints rather than replacements for them. ARIA is marked as a preview, so treat it as unproven for production workflows.
For the authoritative, current list and any limits, see CoreWeave Docs.
How can I use CoreWeave Forge for developing and evaluating AI agents?
CoreWeave Forge is the part of the CoreWeave documentation aimed at developing and evaluating AI agents and LLM applications. Its building blocks map to the agent-development loop: track experiments, evaluate and improve agents, prototype in notebooks, and manage models across their lifecycle.
What each component is for
- Weights & Biases (W&B Models) — experiment tracking, hyperparameter sweeps, artifacts, reports, and automations. This is where you record runs and compare configurations.
- W&B Weave — LLM and agent evaluation, sitting alongside W&B Models. Use it to score agent outputs and iterate on prompts or workflows.
- ARIA — an AI research agent that analyzes experiments, explains results, and builds visualizations and reports. Marked as a preview.
- Agent Lens — intelligent agent observability and improvement.
- Notebooks — reactive Python notebooks for exploring data, prototyping model workflows, and analyzing runs and artifacts.
- Registry — a versioned hub for models and datasets with lineage and deployment handoff.
A practical way to use it
A common pattern is to prototype the agent in Notebooks, log each run to W&B Models, evaluate outputs with Weave, and register the winning model or dataset version in Registry before handing it off to a serving path. Agent Lens and ARIA add observability and automated analysis on top.
Choosing between them
| Need | Component |
|---|---|
| Compare runs, sweeps, artifacts | W&B Models |
| Score and improve agent/LLM outputs | W&B Weave |
| Understand why an agent behaves as it does | Agent Lens |
| Automated analysis and reporting | ARIA (preview) |
| Interactive prototyping and analysis | Notebooks |
| Versioning and deployment handoff | Registry |
For serving the finished agent, the same docs point to Serverless Inference with an OpenAI-compatible API integrated with Weave, plus Serverless Sandbox for isolated, disposable compute environments created from Python.
A useful next step: start with one Notebooks prototype, log it to W&B Models, and add a Weave evaluation before investing in sweeps or registry workflows. Confirm current capabilities, preview status, and availability in the official CoreWeave documentation at CoreWeave Docs.
User reviews (0)