Chris Lu
|
a29abd8600
add a {X-,}Idempotency-Key header for http POST
|
4 years ago |
Chris Lu
|
8708e7a64d
print out data size
|
4 years ago |
Chris Lu
|
0ecff9521d
avoid []byte reuse
|
4 years ago |
Chris Lu
|
031aa70da6
Revert "revert bytebufferpool, seems problematic"
|
4 years ago |
Chris Lu
|
e0fcab47c0
revert bytebufferpool, seems problematic
|
4 years ago |
Chris Lu
|
c057dd1f64
add back upload retries
|
4 years ago |
Chris Lu
|
19772d70d7
print for debugging
|
4 years ago |
Chris Lu
|
ef9c32ea0d
adjust compression threshold
|
4 years ago |
Chris Lu
|
29c9fa2ef2
byte buffer for uploading
|
4 years ago |
Chris Lu
|
2579edbc60
fix bug found by tests
|
4 years ago |
Chris Lu
|
e0c8507d93
memory pool to reduce memory allocation
|
4 years ago |
Chris Lu
|
c31b254248
mount: shortcut when there is only one chunk
|
4 years ago |
Chris Lu
|
f64252023e
Revert "a better byte buffer pool"
|
4 years ago |
Chris Lu
|
59c6422777
a better byte buffer pool
|
4 years ago |
Chris Lu
|
387ab6796f
filer: cross cluster synchronization
|
4 years ago |
Chris Lu
|
50f7e2e89f
add log messages
|
4 years ago |
Chris Lu
|
5f55a87101
close http response
|
4 years ago |
Chris Lu
|
0b301b0b47
consume all response body in order to release requests
|
4 years ago |
Chris Lu
|
003d48da21
adjust logs
|
4 years ago |
Chris Lu
|
83cad3da79
add retry file upload
|
4 years ago |
Chris Lu
|
20e2ac1add
filer: store md5 metadata for files uploaded by filer
|
4 years ago |
Chris Lu
|
bbc8ae110f
report errors
|
4 years ago |
Chris Lu
|
2ff37ccdbd
testing parsing the upload
|
4 years ago |
Chris Lu
|
fe60db404a
prepare for zstd
|
4 years ago |
Chris Lu
|
3080c197e3
rename UnCompressData to DecompressData
|
4 years ago |
Chris Lu
|
97239ce6f1
rename filechunk is_gzipped to is_compressed
|
4 years ago |
Chris Lu
|
e912fd15e3
renaming
|
4 years ago |
Chris Lu
|
16fe132a20
detect mime type before replicating to other volume servers
|
4 years ago |
Chris Lu
|
871efa4fc1
refactoring
|
4 years ago |
Chris Lu
|
9cacaf5eca
better detect file mime type
|
4 years ago |
Chris Lu
|
3f1d79512f
only detect when not sure about the types
|
4 years ago |
Chris Lu
|
d2d1597850
volume: detect gzip effectiveness only when content type is empty
|
4 years ago |
Chris Lu
|
8a73276602
refactor a bit
|
4 years ago |
Chris Lu
|
eedd33dda3
refactoring
|
4 years ago |
Chris Lu
|
e1911760a7
refactoring
|
4 years ago |
Chris Lu
|
2286eda575
sampling whether the data can be gzipped
|
4 years ago |
Chris Lu
|
f9b3750ad1
volume: handle repeated writes response
|
4 years ago |
Chris Lu
|
ee635dcc36
refactoring
|
4 years ago |
Chris Lu
|
18cda6adbb
cleaner fix
|
4 years ago |
Chris Lu
|
17efa361f9
fix possible nil
|
4 years ago |
Chris Lu
|
3934c69757
clean up
|
4 years ago |
Chris Lu
|
2e3f6ad3a9
filer: remember content is gzipped or not
|
4 years ago |
Chris Lu
|
5ac6297c68
adjust parameter names
|
4 years ago |
Chris Lu
|
9228ff192c
encryption works
|
4 years ago |
Chris Lu
|
0375ce2c2e
filer: set mime type from volume server
|
4 years ago |
Chris Lu
|
ea1169dc80
filer cipher: single chunk http POST and PUT and read
|
4 years ago |
Chris Lu
|
13e215ee5c
filer: option to encrypt data on volume server
|
4 years ago |
Chris Lu
|
e5506152c0
refactoring
|
5 years ago |
Chris Lu
|
a2d34d4802
filer.copy: add adjustable compression level
|
5 years ago |
Chris Lu
|
a32abda1a3
adjust compression to optimize for speed
|
5 years ago |