← Back
AWS ML Blog

Introducing Kimi K3.1 Pro on Amazon Bedrock

•9 min read•
#amazon#bedrock#llm
Level:Advanced
For:AI Engineers
✦TL;DR

Moonshot AI’s Kimi K3.1 Pro Highspeed, a post‑trained 3‑trillion‑parameter model with a 1‑million‑token context window, is now available on Amazon Bedrock and delivers 2–3× faster token generation than Kimi K3.1 Pro. It supports tool calling, structured output, configurable reasoning, image input, and streaming via the same Bedrock endpoints and APIs as Kimi K3. Engineers can switch to it simply by changing the model ID in existing code, and can lower costs using the Flex tier and explicit prompt caching. The service guarantees zero data retention and no operator access, keeping inference data within the AWS boundary.

⚡ Key Takeaways

  • 3‑trillion‑parameter open‑weight architecture with a 1‑million‑token context window.
  • Generates output tokens 2–3× faster than Kimi K3.1 Pro (Highspeed mode).
  • Supports tool calling, structured output, configurable reasoning, image input, and streaming.
  • Uses the same Bedrock endpoint, APIs, and features as Kimi K3, so migration is just a model‑ID change.
  • Cost‑saving options include the Flex tier and explicit prompt caching for repeated context.
💡 Why It Matters

Faster token throughput and drop‑in compatibility let production teams upgrade to a higher‑performance LLM without code rewrites, while Bedrock’s data‑privacy guarantees simplify compliance for enterprise workloads.

✅ Practical Steps

  1. Install the required SDKs: `pip install -U openai aws-bedrock-token-generator boto3`.
  2. Replace your existing model ID with `global.moonshotai.kimi-k3.1` (or the region‑specific ID) and point the OpenAI SDK to the Bedrock endpoint.
  3. Enable cost reduction by selecting the Flex tier and using explicit prompt caching as shown in the Bedrock console examples.

Want the full story? Read the original article.

Read on AWS ML Blog ↗

More like this

Introducing workload recovery and expanded infrastructure checks on Amazon SageMaker HyperPod

AWS ML Blog•#deployment

Introducing Gemini 4 Neon

Google DeepMind•#llm

DaisyRose-27B: Pushing the Frontier of Post-Training Efficiency

Hugging Face Blog•#llm

NVIDIA RTX Spark Compact Desktops Out Now

NVIDIA Blog•#compute

EXPLORE AI NEWS

Daily hand-picked stories on LLMs, RAG, agents and production AI — curated for engineers who ship.

BROWSE NEWS

GET THE WEEKLY DIGEST

Join engineers getting the Monday signal-over-noise AI breakdown. No spam, unsubscribe anytime.

LEARN AI ENGINEERING

Curated courses, research papers, repos and tutorials built for engineers leveling up in AI.

START LEARNING