feat: Prevent overloading system memory when running locally by janbuchar · Pull Request #1270 · apify/crawlee-python
label
Jun 25, 2025
| current_size: ByteSize | ||
| """Memory usage of the current Python process and its children.""" | ||
|
|
||
| system_wide_used_size: ByteSize | None |
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe these two new values can have default None, I saw it is anyway initialized with None both in code and test
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
But I already updated all the call sites... and I'd need to reorder the fields in the dataclass ☹️ I'd prefer to leave it this way.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
janbuchar
deleted the
autoscaling-memory-failsafe
branch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters