使用服务器来计算元数据 #2

Merged
LittleSheep merged 9 commits from features/calc-in-backend into master 2024-07-29 06:47:22 +00:00
Showing only changes of commit 2a94bb20f8 - Show all commits

View File

@ -5,7 +5,20 @@ It contains file metadata compute, instant upload, calculating hashing, multi de
## Features
Paperclip store and processing uploaded files with pipeline flow.
When a user try to upload files. The file will store in local first for media processing.
Then the server will publish a message into the message queue.
And the background consumer will start dealing with the uploaded files.
The background consumer will hash the file and merge the files with same hashcode.
The background consumer will decode the image and generate ratio and read more info from image file too.
After the processing done. The consumer will upload the file to the persistent storage like a s3 bucket and remove local cache.
While the processing, the file record in database will marked to the temporary and load file from the temporary storage.
When the processing done, the file record will be updated.
### Supported Destinations
- Local filesystem
- S3 compilable bucket
- S3 compilable bucket