Delegance Brokerage Surpasses Human Memory Benchmark in Commercial Insurance
Delegance Brokerage scored 88 percent on the LoCoMo long term conversational memory benchmark, exceeding the published human performance ceiling of 87.9 percent, announced in a press release.
The LoCoMo benchmark, created by Snap Research and published at ACL 2024, measures an AI system’s ability to recall facts, reason across multiple conversations, and handle temporal and adversarial queries. It includes 1,542 questions covering 10 dialogues with over 300 turns each, designed to assess memory across weeks or months of interaction.
Delegance evaluated its production memory system on the full benchmark. The company stated that the same system serves its commercial insurance clients daily, tracking details such as client expansions, fleet changes, and policy updates across extended time periods.
The company noted that LoCoMo reflects the type of long term, multi session recall required in commercial insurance, where brokers manage numerous clients with evolving coverage needs and renewal schedules.
We hope you enjoyed this article.
Consider subscribing to one of our newsletters like Finance AI Weekly or Daily AI Brief.
Also, consider following us on social media:
More from: Finance
Subscribe to Finance AI Weekly
Weekly newsletter about AI in finance. Covers AI-driven trading, fintech innovations, and data analytics transforming markets
Industry analysis
2025 Global Business Services Agenda: Gen AI Takes Center Stage
This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.
Read more