Sold by: LangChain
Deployed on AWS
LangSmith is an agent engineering platform to build, test, deploy and observe your agents. It helps you trace requests, evaluate outputs, test prompts, and manage deployments in one place. LangSmith is framework agnostic, so you can use it with or without LangChain open-source libraries langchain and langgraph. Prototype locally, then move to production with integrated monitoring and evaluation to build more reliable AI systems. LangSmith provides: - Observability to see exactly how your agent thinks and acts with detailed tracing and aggregate trend metrics. - Evaluation to test and score agent behavior on production data and offline datasets for continuous improvement. - Deployment to ship your agent in one click, using scalable infrastructure built for long-running tasks.
Overview
Image
LangSmith Observability
Image
LangSmith Deployments
Image
LangSmith Evaluations
Image
LangSmith Fleet
Image
Agent Development Lifecycle
LangSmith Observability and Evals is a unified observability & evals platform where teams can debug, test, and monitor AI app performance - whether building with LangChain or not. Find failures fast with agent observability. Quickly debug and understand non-deterministic LLM app behavior with tracing. See what your agent is doing step by step, then fix issues to improve latency and response quality. Evaluate your agent's performance. Evaluate your app by saving production traces to datasets, then score performance with LLM-as-Judge evaluators. Gather human feedback from subject-matter experts to assess response relevance, correctness, harmfulness, and other criteria. Experiment with models and prompts in the Playground, and compare outputs across different prompt versions. Any teammate can use the Prompt Canvas UI to directly recommend and improve prompts. Track business-critical metrics like costs, latency, and response quality with live dashboards, then get alerted when problems arise and drill into root cause. LangSmith Deployments is a purpose-built infrastructure and management layer for deploying and scaling long-running, stateful agents -- offering: - 1-click deployment to go live in minutes, - 30 API endpoints for designing custom user experiences that fit any interaction pattern - Horizontal scaling to handle bursty, long-running traffic - A persistence layer to support memory, conversational history, and async collaboration with human-in-the-loop or multi-agent workflows - Native LangSmith Studio, the agent IDE, for easy debugging, visibility, and iteration
Highlights
- LangSmith is the framework agnostic agent engineering platform for observing, evaluating, and deploying agents. It's hard to build agents because you can't plan for every input, and LLMs decide every output on the fly at runtime.
- LangSmith Fleet is a no-code platform for creating and managing AI agents. It allows you to create agents from templates, connect your accounts, and let the agent handle routine work while you stay in control.
Details
Sold by
Categories
Delivery method
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Trust Center
Access real-time vendor security and compliance information through their Trust Center powered by Drata or Vanta. Review certifications and security standards before purchase.
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Description | Cost/unit |
|---|---|---|
Usage Fee | Units of metered usage as calculated based on platform activity | $0.01 |
Vendor refund policy
Custom pricing options
Request a private offer to receive a custom quote.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
LangSmith provides tools for developing, debugging, and deploying LLM applications. It helps you trace requests, evaluate outputs, test prompts, and manage deployments in one place.
LangSmith is framework agnostic, so you can use it with or without LangChain open-source libraries langchain and langgraph.
Prototype locally, then move to production with integrated monitoring and evaluation to build more reliable AI systems.
LangSmith provides:
Observability to see exactly how your agent thinks and acts with detailed tracing and aggregate trend metrics.
Evaluation to test and score agent behavior on production data and offline datasets for continuous improvement.
Deployment to ship your agent in one click, using scalable infrastructure built for long-running tasks.
Kriv AI instruments your Claude-on-Bedrock agents with OpenTelemetry + AWS X-Ray + Amazon CloudWatch GenAI Observability. Defines SRE-grade Service Level Objectives (latency p95 / p99, success rate, tool-use correctness, grounding score, cost-per-successful-invocation) with error budgets. Alerts to PagerDuty / Opsgenie / Jira / ServiceNow / Slack / Microsoft Teams. Runbook library + blameless post-mortem templates (Google SRE format). Hybrid engagement: $40K 3-week Implementation + optional $8K / $14K / $20K monthly Managed-Service retainer (up to 3 / 10 / unlimited agents). 12-month minimum term on retainer. Enterprise tier adds 0.25 FTE dedicated Kriv SRE engineer embedded with Customer SRE team + regulated-industry evidence (SOC 2 CC7 + SR 11-7 + EU AI Act Article 72 + HIPAA §164.308(a)(1)(ii)(D)). AWS Select + Databricks + Anthropic CPN.
Observability, prompt management and evaluation for LLM applications.
Self-hosted LangChain application server. Deploy chains, agents, and RAG pipelines as production REST APIs with playground and monitoring.
We help customers design and implement Agentic applications on AWS using our modular GenAI Building Block approach. Our experts support rapid PoCs and production deployments, guiding you in selecting and integrating the right LLM for your use case. This ensures flexibility, scalability, and cost-efficiency in your AWS environment.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.