Milestone Systems, a world leader in data-driven video technology, today released an advanced vision language model (VLM) specializing in traffic understanding and powered by NVIDIA Cosmos Reason. The VLM powers two new products: a Video Summarization tool for XProtect® video management software and a VLM as a Service for third-party integrations.
Today’s video systems capture vast amounts of data, and reviewing footage remains time consuming and largely manual. With Milestone Systems’ new Video Summarization tool – a generative AI-powered plug-in for the XProtect Smart Client – users and operators can now rely on a specialized product that automates operator workflows, saves valuable time, and reduces false alarm fatigue significantly. Early reports show video summarization could reduce operator false alarm fatigue by up to 30%.
The Video Summarization tool analyzes camera footage and describes what's happening. Users simply send a snippet of video and a prompt describing their request, and the model will generate a text summary in seconds.
- Convert video segments into structured text summaries inside XProtect Smart Client
- Search summaries based on video content, rather than timestamps or manual tagging
- Bookmark and filter summaries to streamline review workflows
- Integrate seamlessly with existing XProtect event and rule logic to trigger automated summaries based on specific alarms or alerts
- Focus attention on valid events by filtering out irrelevant motion or noise
- Access customized, sovereign VLM’s per region, starting with the US and EU. More regions to follow.
The Video Summarization is free to download and takes only a few minutes to install directly in the XProtect Smart Client. And users only pay when prompting the VLM.
With Milestone’s Hafnia VLM as a Service (VLMaaS), developers, integrators and partners get API access to production-ready video intelligence built on NVIDIA’s latest technology and fine-tuned on responsibly sourced data.
The VLMaaS helps developers create AI-powered solutions quickly without needing to set up, fine-tune or manage their own AI systems – it enhances any existing solutions with generative AI, regardless of the level of analytics currently in place. This makes it fast and simple to add advanced video intelligence features to applications, whether it’s testing a minimum viable product (MVP) or scaling a platform.
With VLMaaS, the development of AI and analytics can be accelerated significantly – up to 70 times less effort than doing the work to fine-tune a VLM model to do the same.
- Access high accuracy vision language model, fine-tune on traffic optimized data and built on NVIDIA Cosmos Reason
- Follow prompt-based instructions for traffic-related operations
- API-first delivery – simple integration via HTTPS
- Fine-tuned models for US and EU markets, with more regions to follow
- Designed to build standalone solutions or integrate with the Milestone product portfolio
- 100% responsibly sourced training data with auditable data lineage, GDPR- and EU AI Act-compliant, used for the fine-tuning of the model
Pricing for the VLMaaS is pay-per-use (based on API calls) – no large upfront investments or custom training costs.
Sign up for early access at https://hafnia.milestonesys.com/.
Andrew Burnett, Acting Chief Technology Officer, Milestone Systems, said: “With the Vision Language Model as a Service and Video Summarization for XProtect, we’re tackling some of the most challenging bottlenecks: video overload and time-consuming manual work. Operators get immediate insight directly within XProtect; builders get API‑first access to production‑ready intelligence without bespoke training or heavy infrastructure.
Because this model is specialized for real-world traffic video and fine-tuned on responsibly sourced data, customers can trust the results, deploy with confidence, and enhance all existing solutions in place. It’s the fastest, most advanced and impactful path to turning video into actionable outcomes.”
XProtect customers like the cities of Genoa, Italy, and Dubuque, Iowa, US, are excited to use these new capabilities, leading the way in adopting advanced video intelligence solutions to enhance traffic management.
The two new offerings are powered by Milestone’s Hafnia VLM, which has been fine-tuned on 75,000 hours of responsibly sourced, real-world video data from either Europe or the US, using NVIDIA Cosmos Curator for data preparation and running either on cloud infrastructure or regional data centers. Leveraging NVIDIA Cosmos Reason VLM and Milestone’s data for fine-tuning makes it one of the most advanced video AI platforms in the industry.
Milestone Systems is a world leader in data-driven video technology used in industries as diverse as manufacturing, airports, law enforcement, retail, and traffic management. We provide a clear picture of how to create a safer, better and more prosperous world. Our XProtect video management software, BriefCam AI-powered analytics, and Arcules cloud VSaaS help our customers learn from the past, understand the present, and predict the future. Founded in 1998 and headquartered in Copenhagen, Milestone employs more than 1,500 people worldwide and has been an independent company in the Canon Group since 2014. For more information visit: www.milestonesys.com. For news and other press releases, visit our Newsroom.