Over the past year we have been suffering a situation where many different queries at the same time will fail with the following error
(or a variation in a different resource Governor group): There is insufficient system memory in resource pool 'default' to run this query.
Recently we have encountered it with more and more frequency. Any ideas on what is causing the issue and how to resolve?
@@version:Microsoft SQL Server 2012 (SP3) (KB3072779) - 11.0.6020.0 (X64) Oct 20 2015 15:36:27 Copyright (c) Microsoft Corporation Enterprise
Edition: Core-based Licensing (64-bit) on Windows NT 6.1 (Build 7601: Service Pack 1)
sample errors which all occur at the exact same time:
Error:701, Severity:17, State:54.There is insufficient system memory in resource pool 'default'to run this query.Error:701, Severity:17, State:123.There is insufficient system memory in resource pool 'dm'to run this query.Error:701, Severity:17, State:89.There is insufficient system memory in resource pool 'default'to run this query.Error:701, Severity:17, State:123.There is insufficient system memory in resource pool 'default'to run this query.Error:701, Severity:17, State:123.There is insufficient system memory in resource pool 'default'to run this query.Error:701, Severity:17, State:123.There is insufficient system memory in resource pool 'dm'to run this query.Error:701, Severity:17, State:123.Memory valuesfrom the log:
full text here due to formatting/char limit: http://pastebin.com/WCAtRBdP
TotalProcs 435TotalPages22156InUsePages 9414Global Memory Objects Pages---------------------------------------- ----------Resource 5696Locks497346XDES 3161DirtyPageTracking32SETLS32SubpDesc Allocators 68SE SchemaManager 2481SE Column Metadata Cache 6414SE Column Metadata Cache Store6SQLCache442Replication2ServerGlobal 72XP Global 2SortTables3Query Memory Objects (internal) Value---------------------------------------- ----------Grants0Waiting 0Available492067CurrentMax492067Future Max492067Physical Max16549102Next Request 0Waiting For0Cost 0Timeout 0Wait Time 0Small Query Memory Objects (internal) Value---------------------------------------- ----------Grants0Waiting 0Available 25898CurrentMax25898Future Max25898Remote Query Memory Objects (internal)Value---------------------------------------- ----------Grants0Waiting 0Available 8274551CurrentMax8274551Query Memory Objects (default)Value---------------------------------------- ----------Grants 22Waiting 2Available 0Current Max14706463Future Max13657740Physical Max15954870Next Request482Waiting For723Cost 6Timeout 157Wait Time 484Small Query Memory Objects (default) Value---------------------------------------- ----------Grants3Waiting 0Available122428CurrentMax122880Future Max122880Remote Query Memory Objects (default) Value---------------------------------------- ----------Grants0Waiting 0Available 7977435CurrentMax7977435Query Memory Objects (fm) Value---------------------------------------- ----------Grants0Waiting 0Available 49206CurrentMax49206Future Max49206Physical Max1654911Next Request 0Waiting For0Cost 0Timeout 0Wait Time 0Small Query Memory Objects (fm) Value---------------------------------------- ----------Grants0Waiting 0Available 2589Current Max2589Future Max2589Remote Query Memory Objects (fm) Value---------------------------------------- ----------Grants0Waiting 0Available827455CurrentMax827455Query Memory Objects (dm)Value---------------------------------------- ----------Grants0Waiting 0Available477304CurrentMax477304Future Max477304Physical Max16052629Next Request 0Waiting For0Cost 0Timeout 0Wait Time 0Small Query Memory Objects (dm) Value---------------------------------------- ----------Grants0Waiting 0Available 25121CurrentMax25121Future Max25121Remote Query Memory Objects (dm) Value---------------------------------------- ----------Grants0Waiting 0Available 8026314CurrentMax8026314Query Memory Objects (J) Value---------------------------------------- ----------Grants0Waiting 0Available477304CurrentMax477304Future Max477304Physical Max16052629Next Request 0Waiting For0Cost 0Timeout 0Wait Time 0Small Query Memory Objects (J)Value---------------------------------------- ----------Grants0Waiting 0Available 25121CurrentMax25121Future Max25121Remote Query Memory Objects (J) Value---------------------------------------- ----------Grants0Waiting 0Available 8026314CurrentMax8026314Query Memory Objects (c) Value---------------------------------------- ----------Grants2Waiting 0Available 0CurrentMax303105Future Max269810Physical Max1643300Next Request 0Waiting For0Cost 0Timeout 0Wait Time 0Small Query Memory Objects (c) Value---------------------------------------- ----------Grants0Waiting 0Available 14200CurrentMax14200Future Max14200Remote Query Memory Objects (c) Value---------------------------------------- ----------Grants0Waiting 0Available821650CurrentMax821650Query Memory Objects (d8) Value---------------------------------------- ----------Grants0Waiting 0Available472388CurrentMax472388Future Max472388Physical Max15887138Next Request 0Waiting For0Cost 0Timeout 0Wait Time 0Small Query Memory Objects (d8) Value---------------------------------------- ----------Grants0Waiting 0Available 24862CurrentMax24862Future Max24862Remote Query Memory Objects (d8)Value---------------------------------------- ----------Grants0Waiting 0Available 7943569CurrentMax7943569Query Memory Objects (d4) Value---------------------------------------- ----------Grants0Waiting 0Available472388CurrentMax472388Future Max472388Physical Max15887138Next Request 0Waiting For0Cost 0Timeout 0Wait Time 0Small Query Memory Objects (d4) Value---------------------------------------- ----------Grants0Waiting 0Available 24862CurrentMax24862Future Max24862Remote Query Memory Objects (d4)Value---------------------------------------- ----------Grants0Waiting 0Available 7943569CurrentMax7943569Query Memory Objects (b)Value---------------------------------------- ----------Grants0Waiting 0Available 49206CurrentMax49206Future Max49206Physical Max1654911Next Request 0Waiting For0Cost 0Timeout 0Wait Time 0Small Query Memory Objects (b) Value---------------------------------------- ----------Grants0Waiting 0Available 2589Current Max2589Future Max2589Remote Query Memory Objects (b) Value---------------------------------------- ----------Grants0Waiting 0Available827455CurrentMax827455Optimization Queue (internal) Value---------------------------------------- ----------Overall Memory 144834560000Target Memory4526080000Last Notification 0Timeout 6Early Termination Factor 5Small Gateway (internal) Value---------------------------------------- ----------Configured Units128Available Units 128Acquires 0Waiters 0Threshold Factor 380000Threshold380000