Pegasus 1.5 from TwelveLabs is now available in Amazon Bedrock
TwelveLabs’ Pegasus 1.5 video language model is now offered on Amazon Bedrock, enabling on‑the‑fly analysis of videos up to two hours long and returning timestamped segment metadata as JSON. The model adds time‑based metadata generation, multimodal prompting with visual references, and eliminates the need for pre‑indexing by accepting Amazon S3 URIs or base64 strings directly. Engineers can invoke Pegasus 1.5 via the Bedrock runtime InvokeModel or InvokeModelWithResponseStream APIs, keeping data within the AWS boundary.
⚡ Key Takeaways
- Pegasus 1.5 processes videos up to **2 hours** per request (vs. 1 hour in Pegasus 1.2).
- Supports **multimodal prompting** where segment definitions combine text and reference images.
- Returns **structured JSON** with start/end timestamps for every matching segment.
- Invoked through **Bedrock‑runtime InvokeModel** or **InvokeModelWithResponseStream** APIs.
- No pre‑indexing required; videos can be supplied via **Amazon S3 URI** or **base64** payload.
Engineers can now add searchable, timestamped video insights to applications without building custom ingestion pipelines, reducing latency and operational overhead while staying within AWS data residency.
✅ Practical Steps
- Call the model on Bedrock using the **InvokeModel** API with `ModelId = "twelvelabs.pegasus-1-5-v1:0"` and provide an S3 URI or base64 video payload.
- For streaming results, replace InvokeModel with **InvokeModelWithResponseStream** to receive JSON segments as they are generated.
- Define segment criteria using a JSON payload that includes text descriptions and optional reference images to leverage multimodal prompting.
Want the full story? Read the original article.
Read on AWS ML Blog ↗