如何缩放node.js / socket.io服务器？

Question

我当前正在运行一个node.js应用程序，并且即将引入socket.io以允许实时更新（聊天，应用程序内通知等）。目前，我正在为Node.js服务器运行DigitalOcean的最小可用设置（1个vCPU，1 GB RAM）。我使用Artillery对连接到socket.io的node.js应用程序进行了压力测试：

config:
  target: "https://my.server.com"
  socketio:
    - transports: ["websocket"] // optional, same results if I remove this
  phases:
    - duration: 600
      arrivalRate: 20
scenarios:
- name: "A user that just connects"
  weight: 90
  engine: "socketio"
  flow:
    - get:
        url: "/"
    - think: 600

它可以处理数百个并发连接。之后，我开始出现以下错误：

Errors:
  ECONNRESET: 1
  Error: xhr poll error: 12

当我将DigitalOcean Droplet的大小调整为8个vCPU和32 GB RAM时，我可以获得多达1700个并发连接。无论我调整大小多少，它始终会停留在该数字附近。

我的第一个问题：这是正常行为吗？有什么方法可以增加每个Droplet的数量，因此我可以在单个节点实例上拥有更多并发连接吗？这是我的配置：

sysctl -p

fs.file-max = 2097152
vm.swappiness = 10
vm.dirty_ratio = 60
vm.dirty_background_ratio = 2
net.ipv4.tcp_synack_retries = 2
net.ipv4.ip_local_port_range = 2000 65535
net.ipv4.tcp_rfc1337 = 1
net.ipv4.tcp_fin_timeout = 15
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_keepalive_probes = 5
net.ipv4.tcp_keepalive_intvl = 15
net.core.rmem_default = 31457280
net.core.rmem_max = 12582912
net.core.wmem_default = 31457280
net.core.wmem_max = 12582912
net.core.somaxconn = 4096
net.core.netdev_max_backlog = 65536
net.core.optmem_max = 25165824
net.ipv4.tcp_mem = 65536 131072 262144
net.ipv4.udp_mem = 65536 131072 262144
net.ipv4.tcp_rmem = 8192 87380 16777216
net.ipv4.udp_rmem_min = 16384
net.ipv4.tcp_wmem = 8192 65536 16777216
net.ipv4.udp_wmem_min = 16384
net.ipv4.tcp_max_tw_buckets = 1440000
net.ipv4.tcp_tw_reuse = 1

ulimit

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 3838
max locked memory       (kbytes, -l) 16384
max memory size         (kbytes, -m) unlimited
open files                      (-n) 65535
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 10000000
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

nginx.conf

user www-data;
worker_processes auto;
worker_rlimit_nofile 1000000;
pid /run/nginx.pid;
include /etc/nginx/modules-enabled/*.conf;

events {
        multi_accept on;
        use epoll;
        worker_connections 1000000;
}

http {

        ##
        # Basic Settings
        ##

        client_max_body_size 50M;
        sendfile on;
        tcp_nopush on;
        tcp_nodelay on;
        keepalive_timeout 120;
        keepalive_requests 10000;
        types_hash_max_size 2048;
        # server_tokens off;

        # server_names_hash_bucket_size 64;
        # server_name_in_redirect off;

        include /etc/nginx/mime.types;
        default_type application/octet-stream;

        ##
        # SSL Settings
        ##

        ssl_protocols TLSv1 TLSv1.1 TLSv1.2; # Dropping SSLv3, ref: POODLE
        ssl_prefer_server_ciphers on;

        ##
        # Logging Settings
        ##

        access_log /var/log/nginx/access.log;
        error_log /var/log/nginx/error.log;
        ##
        # Gzip Settings
        ##

        gzip on;

        # gzip_vary on;
        # gzip_proxied any;
        # gzip_comp_level 6;
        # gzip_buffers 16 8k;
        # gzip_http_version 1.1;
        # gzip_types text/plain text/css application/json application/javascript text/xml application/xml application/xml+rss text/javascript;

        ##
        # Virtual Host Configs
        ##

        include /etc/nginx/conf.d/*.conf;
        include /etc/nginx/sites-enabled/*;
}

另一个问题：我正在考虑水平缩放并旋转更多的液滴。假设有4个Droplet代理所有连接。实际上如何设置？我将使用Redis通过socket.io向所有连接的客户端发出信号。我是否使用具有相同配置的4个墨滴？我是否对所有四个都运行相同的东西？例如，是否应该在所有4个Droplet上上传相同的server.js应用程序？欢迎任何建议。

Answer 1

我无法真正回答您的第一个问题，但是我可以尽全力解决您的第二个问题。

[如果要设置负载平衡，则在每个Droplet上运行相同的server.js应用程序，并处理一个流量。我对Redis不太了解，但是发现了这一点：https://redis.io/topics/cluster-tutorial希望对您有所帮助。