I found out the source of the issue, the streaming poll timeout and the flush interval.
(我发现了问题的根源,流式轮询超时和刷新间隔。)
once I added the following to users.xml and restarted, the ingestion rate increased significantly
(将以下内容添加到users.xml并重新启动后,摄取率显着提高)
<stream_poll_timeout_ms>5000</stream_poll_timeout_ms>
<stream_flush_interval_ms>1500</stream_flush_interval_ms>
<max_streams_to_max_threads_ratio>4</max_streams_to_max_threads_ratio>
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…