Overview
Embedding 2 is a compact yet powerful multilingual embedding model purpose-built for retrieval. Fine-tuned for Retrieval-Augmented Generation (RAG), it delivers strong search accuracy in Korean and English while remaining far smaller than previous-generation embedding models, enabling lower-cost, higher-throughput serving.
Compact and Efficient: At a fraction of the size of prior embedding models, it loads with minimal GPU memory and serves at low latency, making large-scale retrieval more cost-effective without sacrificing quality.
Optimized for Retrieval & RAG: Trained specifically on the retrieval task with dedicated query and passage encoding, it maximizes the precision and recall of the document search at the heart of RAG pipelines.
Long-Context, Multilingual: With a 32K-token context window and robust performance across Korean, English, and beyond, it handles long passages and multiple languages in a single model.
Highlights
- Optimized for Retrieval & RAG: Dedicated query and passage encoding maximizes search precision and recall, directly improving the accuracy of Retrieval-Augmented Generation (RAG) pipelines.
- Multilingual with Long Context: Strong retrieval performance across Korean and English, paired with a 32K-token context window to handle long passages and multiple languages in a single model.
- Key Tasks: Retrieval-Augmented Generation - Semantic Search - Passage Retrieval - Multilingual Search - Text Embeddings
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
Free trial
Dimension | Description | Cost/host/hour |
|---|---|---|
ml.g6.2xlarge Inference (Batch) Recommended | Model inference on the ml.g6.2xlarge instance type, batch mode | $3.00 |
ml.g6e.2xlarge Inference (Real-Time) Recommended | Model inference on the ml.g6e.2xlarge instance type, real-time mode | $3.00 |
ml.g6.12xlarge Inference (Batch) | Model inference on the ml.g6.12xlarge instance type, batch mode | $3.00 |
ml.g6.12xlarge Inference (Real-Time) | Model inference on the ml.g6.12xlarge instance type, real-time mode | $3.00 |
ml.g6.16xlarge Inference (Batch) | Model inference on the ml.g6.16xlarge instance type, batch mode | $3.00 |
ml.g6.16xlarge Inference (Real-Time) | Model inference on the ml.g6.16xlarge instance type, real-time mode | $3.00 |
ml.g6.24xlarge Inference (Batch) | Model inference on the ml.g6.24xlarge instance type, batch mode | $3.00 |
ml.g6.24xlarge Inference (Real-Time) | Model inference on the ml.g6.24xlarge instance type, real-time mode | $3.00 |
ml.g6.2xlarge Inference (Real-Time) | Model inference on the ml.g6.2xlarge instance type, real-time mode | $3.00 |
ml.g6.48xlarge Inference (Batch) | Model inference on the ml.g6.48xlarge instance type, batch mode | $3.00 |
Vendor refund policy
Contact us for refund inquiries. https://www.upstage.ai/contact-us?utm_source=marketplace
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Amazon SageMaker model
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Version release notes
Initial release of Embedding 2 model
Additional details
Inputs
- Summary
Provide input data in JSON request body. The model field selects one of two specialized aliases:
- embedding-query — for embedding the user's search query
- embedding-passage — for embedding documents to be retrieved
The input field accepts a single string or an array of strings.
Request body format: {"model": "embedding-query" | "embedding-passage", "input": "" | ["", ...]}
- Input MIME type
- application/json, application/jsonlines
Resources
Vendor resources
Support
Vendor support
Contact us for model, usage and enterprise integration inquiries.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.