I have SingleStore DB CLI (Cluster in a Box) deployed in a AWS EC2 Instance r6i.4xlarge with Almalinux 9 OS. At the moment of load data by pipelines the following error appears:
line 34: ER_MEMSQL_OOM (1712), Leaf Error (127.0.0.1:3307): The operating system failed to allocate memory (MemSQL memory use 18658.88 Mb). The request was not processed. See Memory Errors · SingleStore Documentation
The table I need to load is almost 5GB.
The Server is a 32CPU/128GB and never reach this amount.
Here is my /etc/sysctl.conf file:
vm.max_map_count = 1000000000
vm.min_free_kbytes = 4194304
net.core.wmem_max = 8388608
net.core.rmem_max = 8388608
vm.overcommit_memory = 0
#vm.overcommit_ratio = 99
vm.swappiness = 10
From Singlestore everything seems to be ok, does anyone experimented this kind of errors?