MultipartParseError: Did not find boundary character 48 at index 2 when uploading large files #452
-
|
I'm encountering the following error while attempting to upload files using multipart/form-data requests in the Esmerald framework I would greatly appreciate any assistance or suggestions on how to resolve this issue with file uploads exceeding 1 MB in the Esmerald framework. Thank you in advance for your time and help. |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments 6 replies
-
|
Hi @prashikdewtale10 that is a new one. In order to be able to assist you, could you please provide more details in how you did implement it, like code examples please? |
Beta Was this translation helpful? Give feedback.
-
|
@prashikdewtale10 I literally did this: from esmerald import Esmerald, post, Body, Gatewaym UploadFile
from esmerald.enums import EncodingType
@post("/upload-file")
async def upload(data: UploadFile = Body(media_type=EncodingType.MULTI_PART)) -> dict[str, str]:
return {"name": data.filename}
app = Esmerald(
routes=[
Gateway(handler=upload),
]
)You can also do: from esmerald import Esmerald, post, File, Gatewaym UploadFile
@post("/upload-file")
async def upload(data: UploadFile = File() -> dict[str, str]:
return {"name": data.filename}
app = Esmerald(
routes=[
Gateway(handler=upload),
]
)Tested even using the OpenAPI documentation at https://localhost:8000/docs/swagger As per documentation and uploaded a 7MB file and it works. I'm not sure about your side of the implementation? Apologies for taking so long but we have been quite busy. |
Beta Was this translation helpful? Give feedback.
-
|
Hi, I'm trying to implement a file upload API using the Esmerald framework. The API should accept a file and some contextual data (file_context and applicable_date) via form data submitted through Postman. Below is the current implementation: async def upload_files(
request: Request,
data: Any = Form(),
) -> Response:
# Parse form data
request_file = data.get('file')
# for validating type of file_context it should be str only
context_name = data.get("file_context")
applicable_date = data.get("applicable_date")
app = Esmerald(
routes=[
Gateway(handler=upload_files),
]
)What I'm Trying to Achieve
Issues and Questions
|
Beta Was this translation helpful? Give feedback.
-
|
Traceback (most recent call last): This is the traceback I encountered while attempting to upload a .csv file larger than 1MB. |
Beta Was this translation helpful? Give feedback.
-
|
@prashikdewtale10 I understand but when you use the Form, the media type is not for multipart. What you need to do it's to replace the Form() with Body(media_type=EncodingType.MULTI_PART)) as per example above. Can you do that and come back to me with the result, please? This is not an Emerald limitation. Its HTTP protocol. Answering your question for best practices in general, you should have clear separate endpoints doing one thing and one thing only. Mixing a payload of plaintext and binary (file) can do more harm then good. Advice? Create different endpoints. One just for the file upload or uploads and another for data. That will also help you with testing. |
Beta Was this translation helpful? Give feedback.
-
|
Hi @tarsil, Thank you for your suggestion to replace Form() with Body(media_type=EncodingType.MULTI_PART). I implemented the changes as recommended, but unfortunately, I’m still encountering the same issue when uploading a .csv file larger than 1MB. Here are the steps I followed: Replaced Form() with Body(media_type=EncodingType.MULTI_PART) in my handler function. |
Beta Was this translation helpful? Give feedback.
-
|
@prashikdewtale10 I literally added a test proving that passes with more than 1MB, maybe something its not right on your side? Let me share an example with you: import httpx
from io import BytesIO
from pathlib import Path
from typing import Any, Dict
from esmerald import Esmerald, Form, Gateway, Request, post
def create_dummy_file(size_in_bytes: int, filename: str = "test.txt"):
file_buffer = BytesIO()
file_buffer.write(b"0" * size_in_bytes)
file_buffer.name = filename
file_buffer.seek(0)
return file_buffer
@post("/upload-data/")
async def create_upload_file(request: Request, data: Any = Form()) -> Dict[str, Any]:
return {
"filename": data.get("file").filename,
"name": data.get("name"),
"size": data.get("file").size,
}
app = Esmerald(routes=[Gateway(handler=create_upload_file)])
# Now you can use httpx or requests to do something like this
data = {"name": "Test"}
seven_mb_file = create_dummy_file(size_in_bytes=7 * 1024 * 1024)
httpx.post('http://localhost:8000/upload-data', files={"file": seven_mb_file}, data=data)This works like a charm. A form that contains data and contains a file. This is literally one of our tests. |
Beta Was this translation helpful? Give feedback.
-
|
Hi @tarsil, thank you for your quick response, and I apologize for any confusion. I really appreciate the work you and the team have put into Esmerald. it’s an impressive framework! After further investigation, it seems the issue was with the Postman application I was using for API testing. When I executed the API using a Python script with urllib3 and curl, it worked properly without any issues. |
Beta Was this translation helpful? Give feedback.
-
|
Not a problem my friend. I'm happy that you are using Esmerald. How do you feel so far with Esmerald? Production applications? |
Beta Was this translation helpful? Give feedback.
@prashikdewtale10 I literally added a test proving that passes with more than 1MB, maybe something its not right on your side? Let me share an example with you: