Delegance Brokerage Surpasses Human Memory Benchmark in Commercial Insurance
Delegance Brokerage scored 88 percent on the LoCoMo long term conversational memory benchmark, exceeding the published human performance ceiling of 87.9 percent, announced in a press release.
The LoCoMo benchmark, created by Snap Research and published at ACL 2024, measures an AI system’s ability to recall facts, reason across multiple conversations, and handle temporal and adversarial queries. It includes 1,542 questions covering 10 dialogues with over 300 turns each, designed to assess memory across weeks or months of interaction.
Delegance evaluated its production memory system on the full benchmark. The company stated that the same system serves its commercial insurance clients daily, tracking details such as client expansions, fleet changes, and policy updates across extended time periods.
The company noted that LoCoMo reflects the type of long term, multi session recall required in commercial insurance, where brokers manage numerous clients with evolving coverage needs and renewal schedules.
We hope you enjoyed this article.
Consider subscribing to one of our newsletters like Finance AI Weekly or Daily AI Brief.
Also, consider following us on social media:
More from: Finance
Subscribe to Finance AI Weekly
Weekly newsletter about AI in finance. Covers AI-driven trading, fintech innovations, and data analytics transforming markets
Market report
AI’s Time-to-Market Quagmire: Why Enterprises Struggle to Scale AI Innovation
The 2025 AI Governance Benchmark Report by ModelOp provides insights from 100 senior AI and data leaders across various industries, highlighting the challenges enterprises face in scaling AI initiatives. The report emphasizes the importance of AI governance and automation in overcoming fragmented systems and inconsistent practices, showcasing how early adoption correlates with faster deployment and stronger ROI.
Read more