更新数据库mq_exclusive_spec表支持开启堆外内存

作者: 漩涡佐助栋 | 来源:发表于2024-02-04 16:45 被阅读0次

直接内存与 JVM 源码分析
堆外内存
JVM如何分配和回收堆外内存
MySQL知识集
Netty-内存管理
堆外内存之 DirectByteBuffer 详解
堆外内存之 DirectByteBuffer 详解
堆外内存整理
Netty系列之Direct Buffers
Java堆外内存的回收机制

大于等于5w tps开启堆外内存规格数据修改
修改前数据：

TPS	BROKER_MASTER_XMS	BROKER_MASTER_XMX	BROKER_MASTER_MAX_DIRECT_MEMORY_SIZE	BROKER_MASTER_LIMIT_CPU	BROKER_MASTER_LIMIT_MEMORY	BROKER_MASTER_RESOURCE_REQUEST_CPU	BROKER_MASTER_RESOURCE_REQUEST_MEMORY	BROKER_SLAVE_XMS	BROKER_SLAVE_XMX	BROKER_SLAVE_LIMIT_CPU	BROKER_SLAVE_LIMIT_MEMORY	BROKER_SLAVE_RESOURCE_REQUEST_CPU	BROKER_SLAVE_RESOURCE_REQUEST_MEMORY
10000	4G	4G	15G	2000m	8G	2000m	8G	4G	4G	2000m	8G	2000m	8G
20000	4G	4G	15G	2000m	8G	2000m	8G	4G	4G	2000m	8G	2000m	8G
50000	8G	8G	15G	4500m	12G	4500m	12G	4G	4G	2000m	8G	2000m	8G
80000	12G	12G	15G	6500m	16G	6500m	16G	4G	4G	2000m	8G	2000m	8G
100000	12G	12G	15G	6500m	18G	6500m	18G	4G	4G	2000m	8G	2000m	8G
120000	16G	16G	15G	6500m	20G	6500m	20G	6G	6G	3000m	10G	3000m	10G
150000	16G	16G	15G	6500m	20G	6500m	20G	6G	6G	3000m	10G	3000m	10G
200000	24G	24G	15G	6500m	30G	6500m	30G	6G	6G	3000m	10G	3000m	10G

修改后规格数据，其中大于等于5w的tps的master节点开启堆外内存：

TPS	BROKER_MASTER_XMS	BROKER_MASTER_XMX	BROKER_MASTER_MAX_DIRECT_MEMORY_SIZE	BROKER_MASTER_LIMIT_CPU	BROKER_MASTER_LIMIT_MEMORY	BROKER_MASTER_RESOURCE_REQUEST_CPU	BROKER_MASTER_RESOURCE_REQUEST_MEMORY	BROKER_SLAVE_XMS	BROKER_SLAVE_XMX	BROKER_SLAVE_LIMIT_CPU	BROKER_SLAVE_LIMIT_MEMORY	BROKER_SLAVE_RESOURCE_REQUEST_CPU	BROKER_SLAVE_RESOURCE_REQUEST_MEMORY
10000	4G	4G	15G	2000m	8G	2000m	8G	4G	4G	2000m	8G	2000m	8G
20000	4G	4G	15G	2000m	8G	2000m	8G	4G	4G	2000m	8G	2000m	8G
50000	8G	8G	8G	4500m	20G	4500m	20G	4G	4G	2000m	8G	2000m	8G
80000	12G	12G	8G	6500m	24G	6500m	24G	4G	4G	2000m	8G	2000m	8G
100000	12G	12G	8G	6500m	26G	6500m	26G	4G	4G	2000m	8G	2000m	8G
120000	16G	16G	8G	6500m	28G	6500m	28G	6G	6G	3000m	10G	3000m	10G
150000	16G	16G	8G	6500m	30G	6500m	30G	6G	6G	3000m	10G	3000m	10G
200000	24G	24G	8G	6500m	38G	6500m	38G	6G	6G	3000m	10G	3000m	10G

update语句:

update `mq_exclusive_spec` set BROKER_MASTER_MAX_DIRECT_MEMORY_SIZE = "8G", BROKER_MASTER_LIMIT_MEMORY="20G", BROKER_MASTER_RESOURCE_REQUEST_MEMORY="20G" WHERE TPS = "50000";
update `mq_exclusive_spec` set BROKER_MASTER_MAX_DIRECT_MEMORY_SIZE = "8G", BROKER_MASTER_LIMIT_MEMORY="24G", BROKER_MASTER_RESOURCE_REQUEST_MEMORY="24G" WHERE TPS = "80000";
update `mq_exclusive_spec` set BROKER_MASTER_MAX_DIRECT_MEMORY_SIZE = "8G", BROKER_MASTER_LIMIT_MEMORY="26G", BROKER_MASTER_RESOURCE_REQUEST_MEMORY="26G" WHERE TPS = "100000";
update `mq_exclusive_spec` set BROKER_MASTER_MAX_DIRECT_MEMORY_SIZE = "8G", BROKER_MASTER_LIMIT_MEMORY="28G", BROKER_MASTER_RESOURCE_REQUEST_MEMORY="28G" WHERE TPS = "120000";
update `mq_exclusive_spec` set BROKER_MASTER_MAX_DIRECT_MEMORY_SIZE = "8G", BROKER_MASTER_LIMIT_MEMORY="30G", BROKER_MASTER_RESOURCE_REQUEST_MEMORY="30G" WHERE TPS = "150000";
update `mq_exclusive_spec` set BROKER_MASTER_MAX_DIRECT_MEMORY_SIZE = "8G", BROKER_MASTER_LIMIT_MEMORY="38G", BROKER_MASTER_RESOURCE_REQUEST_MEMORY="38G" WHERE TPS = "200000";