Introducing Reflection Beam: an open-weight model for agentic coding on AWS
Reflection AI unveiled Beam, a 501 B‑parameter sparse mixture‑of‑experts model (23 B active parameters) designed for agentic coding and long‑horizon software tasks, now released with open weights on Hugging Face under Apache 2.0. Beam can be deployed via Amazon SageMaker JumpStart real‑time endpoints or on SageMaker HyperPod Inference clusters using SGLang or vLLM, supporting BF16, FP8, and NVFP4 checkpoint formats. The launch provides immediate availability in US East (N. Virginia) and US East (Ohio), giving engineers full control over runtime, scaling, and customization for multi‑step tool‑using workflows.
⚡ Key Takeaways
- Beam has 501 B total parameters and 23 B active parameters with an effective context length of 1 M tokens.
- It is a sparse mixture‑of‑experts architecture released as open weights on Hugging Face (Apache 2.0).
- Deployment options include SageMaker JumpStart real‑time endpoints for managed serving or HyperPod Inference with SGLang/vLLM for Kubernetes‑native distributed GPU control.
- Checkpoint variants (BF16, FP8, NVFP4) let you trade memory footprint against hardware compatibility.
- Beam is currently available in SageMaker JumpStart in US East (N. Virginia) and US East (Ohio) only.
Engineers can now run a high‑capacity, agentic coding model in production with fine‑grained control over scaling and quantization, accelerating development of autonomous code‑maintenance tools without vendor lock‑in.
✅ Practical Steps
- Deploy Beam using the SageMaker JumpStart real‑time endpoint in the desired AWS region (US East (N. Virginia) or US East (Ohio)).
- For custom scaling, launch a SageMaker HyperPod Inference cluster on Amazon EKS and run the Beam container with SGLang or vLLM, selecting the appropriate checkpoint format (BF16, FP8, or NVFP4).
- Configure replicas, caching, routing, and autoscaling based on measured concurrency and latency targets.
Want the full story? Read the original article.
Read on AWS ML Blog ↗