Very slow response

[MyraBaba]

Hi,

I am testing example/form_server both my Mac Pro and also raspi4 . its super slower than the python (fastapi) ? almost 10 times slower

Why is this ? am I missed something ?

Best

[MyraBaba]

Any idea @sprinfall

[sprinfall]

Any idea @sprinfall

Because the file data is all cached in the memory. What is the size of your test file?

[MyraBaba]

its 10K image file . almost 1 second for each post very slow. There should be something that missed . Test yourself please

[MyraBaba]

I am posting with curl for test :

curl -X POST "http://127.0.0.1:8000/predict/image" -H "accept: application/json" -H "Content-Type: multipart/form-data" -F "name=mmm" -F "file=@/Users/xxx/Charles_Bronson/Charles_Bronson_0003.jpg;type=image/jpg"

[MyraBaba]

@sprinfall
if you advise I would love to use your solution in our small non profit org. production.

Best

[sprinfall]

@MyraBaba Please feel free to use.
I just pushed the code with a small improvement for the parsing of form data. I'm still investigating the performance issue.

[MyraBaba]

Ok I will test the new code . But you wll see the slowness of the response.. Something stalling / delaying.

Best

[sprinfall]

Ok I will test the new code . But you wll see the slowness of the response.. Something stalling / delaying.

Best

Hi, I use Python Requests library to post a JPG file, the 1s delay disappears. Just for your information.

BTW, if you want to post large files, please consider to NOT use multipart form data. Please use a normal post with streaming instead.

[MyraBaba]

Hi @sprinfall

My files mostly around 10K to 30K so small ones. What is the curl post and python post differences. ?
Would you mind to share your python / Post code?

Best

[sprinfall]

@MyraBaba

import requests

url = 'http://127.0.0.1:8000/upload'
files = {'file': open('path/to/jpg', 'rb')}

r = requests.post(url, files=files)
print(r.text)

[MyraBaba]

@sprinfall can you test in aloop ?

for i in range(100):
r = requests.post(url, files=files)
print(i , " " ,r.text)

gives error

[sprinfall]

@MyraBaba Sorry, that issue was introduced by my last small optimization. I have reverted the change.
I will keep you informed when I find a better solution to optimize the performance of form data parsing.

[MyraBaba]

@sprinfall any perf fix?

[sprinfall]

@sprinfall any perf fix?

I have two suggestions:

1. Use a larger buffer to read the requests. I tested using 10240, it did improve the speed. Please see new added method of Server: set_buffer_size().
2. Set log level to USER to avoid logging VERB and INFO logs.