Sold by: cloudimg
Deployed on AWS
Free Trial
AWS Free Tier
This product has charges associated with it for seller support. LocalAI, the free open source drop in replacement for the OpenAI API that runs local inference on your own hardware with no GPU required, preinstalled as a system service with a ready to use model, the OpenAI compatible REST API and the built in web UI published behind an authenticating nginx proxy. A unique API key and admin password are generated on first boot. Backed by 24/7 cloudimg support.
Overview
Image
LocalAI chat interface
Image
LocalAI home dashboard
Image
LocalAI model gallery
This is a repackaged open source software product wherein additional charges apply for cloudimg support services.
Overview LocalAI is a free, open source, self hosted alternative to the OpenAI API. It exposes the same OpenAI compatible REST API for chat completions, completions, embeddings, audio and image generation, but runs entirely on your own infrastructure with no external API calls and no GPU required. This image delivers LocalAI fully installed and configured as a system service, with a small instruct model pre pulled so the chat API and the web interface work the moment the instance boots.
Application Stack The LocalAI single binary installed under /opt/localai and run by a dedicated unprivileged service account. The models directory stored on a dedicated data disk so your downloaded models are independently resizable and survive instance replacement. A systemd service that starts LocalAI on boot and restarts it on failure. An nginx reverse proxy that publishes the web UI and the OpenAI compatible API on port 80 behind HTTP Basic authentication.
OpenAI Compatible API Point any OpenAI client library or tool at the instance and change only the base URL. LocalAI serves the chat completions, completions, embeddings, models and other OpenAI compatible endpoints, so existing applications work unchanged against models running on your own hardware. A small CPU friendly instruct model is pre pulled and ready, and you can install hundreds more from the built in gallery through the web UI or the model apply API.
Secure First Boot On the first boot of your instance a one shot service generates a fresh LocalAI API key and a fresh admin password, both unique to that instance, wires the API key into the runtime and the password into the nginx credentials file, and writes them to a root only file. The inference server itself binds to loopback only and is never exposed without authentication. No shared or default credentials ship in the image.
Ready To Use The web UI is served on port 80 through nginx. Sign in with the generated administrator credentials to chat with the pre pulled model, browse and install gallery models, and inspect the running backends. The OpenAI compatible API is served on the same port behind the same login plus the generated API key as a bearer token.
cloudimg Support 24/7 technical support by email and chat. Help with deployment, model installation and configuration, the OpenAI compatible API, prompt templates, embeddings, the model gallery, TLS and performance tuning.
Use Cases A private, self hosted drop in for the OpenAI API. Running local language models with no data leaving your infrastructure. Powering chat, retrieval augmented generation and agent applications on your own hardware. Generating embeddings for search and similarity. Air gapped and compliance constrained inference.
All product and company names are trademarks or registered trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.
Highlights
- LocalAI drop in OpenAI API replacement preinstalled as a systemd service with a small instruct model pre pulled, so the chat completions API and the web UI work on port 80 the moment the instance boots, no GPU required
- Serves the OpenAI compatible chat, completions, embeddings and models endpoints behind an authenticating nginx proxy, with the models directory on a dedicated independently resizable data disk and hundreds of gallery models installable from the web UI
- Hardened first boot generates a fresh API key and admin password for every instance and stores them in a file only the root user can read, with 24/7 technical support from cloudimg
Details
Sold by
Categories
Delivery method
Delivery option
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 24.04
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Free trial
Try this product free for 7 days according to the free trial terms set by the vendor. Usage-based pricing is in effect for usage beyond the free trial terms. Your free trial gets automatically converted to a paid subscription when the trial ends, but may be canceled any time before that.
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time. Alternatively, you can pay upfront for a contract, which typically covers your anticipated usage for the contract duration. Any usage beyond contract will incur additional usage-based costs.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
If you are an AWS Free Tier customer with a free plan, you are eligible to subscribe to this offer. You can use free credits to cover the cost of eligible AWS infrastructure. See AWS Free Tier for more details. If you created an AWS account before July 15th, 2025, and qualify for the Legacy AWS Free Tier, Amazon EC2 charges for Micro instances are free for up to 750 hours per month. See Legacy AWS Free Tier for more details.
Dimension | Description | Cost/hour |
|---|---|---|
t3.large Recommended | t3.large | $0.10 |
t2.micro | t2.micro instance type | $0.04 |
t3.micro | t3.micro instance type | $0.04 |
c5a.12xlarge | c5a.12xlarge instance type | $0.24 |
c5a.16xlarge | c5a.16xlarge instance type | $0.24 |
c5a.24xlarge | c5a.24xlarge instance type | $0.24 |
c5a.2xlarge | c5a.2xlarge instance type | $0.24 |
c5a.4xlarge | c5a.4xlarge instance type | $0.24 |
c5a.8xlarge | c5a.8xlarge instance type | $0.24 |
c5a.large | c5a.large instance type | $0.08 |
Vendor refund policy
Refunds available on request.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Initial release of LocalAI 4.4.3, the open source drop in OpenAI API replacement for local inference.
Additional details
Usage instructions
Connect via SSH on port 22 as the default login user for your operating system variant (the user guide lists it per variant). The LocalAI web UI is served on port 80: browse to http://<instance-public-ip>/ and sign in with user admin and the generated password. Retrieve the credentials with: sudo cat /root/localai-aws-credentials.txt. The OpenAI compatible REST API (/v1/models, /v1/chat/completions, /v1/embeddings and more) is served on the same port 80 under /v1/ and is gated by the generated LocalAI API key sent as an Authorization Bearer token (point any OpenAI client at http://<instance-public-ip>/v1 with that key). A small instruct model named smollm2-135m-instruct is pre pulled and ready; install more from the gallery through the web UI. The models directory lives on a dedicated data disk mounted at /var/lib/localai.
Resources
Vendor resources
Support
Vendor support
cloudimg provides 24/7 technical support for this product by email and live chat. Our engineers help with deployment, configuration, updates, performance tuning and troubleshooting; critical issues receive a one hour average response. Contact support@cloudimg.co.uk .
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
This product includes additional charges for seller support. Root partition and filesystem automatically expands at boot for volumes larger than 8 GiB, for seamless scalability. Preconfigured with Cloud-init and ENA support for enhanced network performance. LocalAI.io provides a cutting-edge solution for running and deploying AI models directly on your local infrastructure. With support for advanced machine learning frameworks, seamless integrations, and optimized performance, LocalAI.io enables businesses to achieve low-latency, cost-effective AI capabilities while maintaining full data sovereignty and control. Ideal for privacy-sensitive applications and edge deployments, LocalAI.io empowers users to scale AI workflows without relying on external cloud providers.
Preconfigured LocalAI virtual machine for running AI models on your own infrastructure. Unified platform for AI Chat, image and voice generation, LLMs and embeddings with OpenAI API compatibility.
Available in both CPU and GPU configurations.
This product has charges associated with it for hardening, security configuration, and support.
LocalAI is an open-source, drop-in OpenAI-compatible API server delivered as a single statically linked Go binary - chat, embeddings, images, and audio served from your own VM with no GPU and no cloud egress. Unlike bare LocalAI AMIs that expose port 8080 unauthenticated to the public internet and ship without any TLS termination, this Lynxroute build is ready out of the box: per-instance LOCALAIAPIKEY at first boot, host Nginx with TLS in front of the API, the LocalAI process bound to loopback, UFW firewall pre-configured, and a CIS Level 1 hardened Ubuntu 24.04 LTS base.
MIT license - fully auditable, no vendor lock-in.
Self-hosted AI inference server providing an OpenAI-compatible API for running LLMs, image, and audio models on EC2 without external dependencies.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.