Reuse HTTP connection for multiple posts? #24

Closed
opened 2026-02-04 07:03:24 +00:00 by mih · 1 comment
Owner

I am posting 18k records. Running with --debug is see

.DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): pool.v0.trr379.de:443

for each record.

Wouldn't it be possible to continue to use a session for multiple uploads? I imagine that this would take some latency off. Right now I see a rate of maybe 3/s. The ~90min are still ok-ish, but not fast.

I am posting 18k records. Running with `--debug` is see ``` .DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): pool.v0.trr379.de:443 ``` for each record. Wouldn't it be possible to continue to use a session for multiple uploads? I imagine that this would take some latency off. Right now I see a rate of maybe 3/s. The ~90min are still ok-ish, but not fast.
Owner

Version 0.2.6 (published on pypi) uses request sessions to reuse existing connections

Version 0.2.6 (published on pypi) uses request sessions to reuse existing connections
cmo closed this issue 2026-02-04 22:28:45 +00:00
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
orinoco/dump-things-pyclient#24
No description provided.