Pubchem may have made some rate limit updates and seems to be more burdened than before. Increase the retry time. And add a secondary (a tertiary) sweep to capture missing drugs at the end (just wrap current script in for loop).
This will ensure that when when Errno 101 (Network is unreachable) occurs for several minutes, these drugs are not missing in final result.
This will also ensure that Errno 503 (Rate Limit) occurs, we back off and resume more effectively to avoid cascading 503 errors.
Pubchem may have made some rate limit updates and seems to be more burdened than before. Increase the retry time. And add a secondary (a tertiary) sweep to capture missing drugs at the end (just wrap current script in for loop).
This will ensure that when when Errno 101 (Network is unreachable) occurs for several minutes, these drugs are not missing in final result.
This will also ensure that Errno 503 (Rate Limit) occurs, we back off and resume more effectively to avoid cascading 503 errors.