 Chris Lu
|
d335f04de6
support env variables to overwrite toml file
|
4 years ago |
|
Chris Lu
|
c8b2dac6c1
volume: avoid sharing volume dat file handle
|
4 years ago |
|
Chris Lu
|
acf7ca7b93
volume: fix compaction
|
4 years ago |
|
Chris Lu
|
efd2f50ede
compaction changed to .idx based deletion
|
4 years ago |
|
Chris Lu
|
abffe857a1
change btree map to in memory level db
|
4 years ago |
|
Chris Lu
|
72a561ab7c
refactoring
|
4 years ago |
|
Chris Lu
|
09ca936c78
shell: add ec.decode command
|
4 years ago |
|
Chris Lu
|
f60154f330
master load backend storage config from master.toml
|
4 years ago |
|
Chris Lu
|
85f8649320
refactor memory mapped file into backend storage
|
4 years ago |
|
Chris Lu
|
db30a46050
skip memory mapped file when compacting
|
4 years ago |
|
Chris Lu
|
5b950c735e
Merge branch 'master' into refactoring_dat_backend
|
4 years ago |
|
Chris Lu
|
57e441d67b
fix compaction logic
|
4 years ago |
|
Chris Lu
|
4b5ba4927f
adjust NewDiskFile() paramaters
|
4 years ago |
|
Chris Lu
|
19b6a16003
changed from os.file to backend.DataStorageBackend
|
4 years ago |
|
Chris Lu
|
fc412e428b
refactor ScanVolumeFileFrom()
|
4 years ago |
|
Chris Lu
|
faec9076a4
adjust parameter names
|
4 years ago |
|
j.laycock
|
6fc6322c90
Change joeslay paths to chrislusf paths
|
4 years ago |
|
j.laycock
|
5885ab67b3
rename volume property MemoryMap to MemoryMapMaxSizeMB
|
4 years ago |
|
Tom Maxwell
|
4a878c0006
Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve
|
4 years ago |
|
j.laycock
|
1f01eb78e8
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
|
5 years ago |
|
Tom Maxwell
|
d637d86d22
Changes to try and pass the URL parameters through - in memory flag not working still
|
5 years ago |
|
j.laycock
|
9a459d984b
Do not vacuum memory mapped files
|
5 years ago |
|
j.laycock
|
595a1beff0
Swap imports to use joeslay
|
5 years ago |
|
Chris Lu
|
d829df4f59
volume: protect against nil needle map
|
5 years ago |
|
Chris Lu
|
e40634e6b4
volume: fail the volume deletion if compaction is in progress
|
5 years ago |
|
Chris Lu
|
f3b99cbfe5
fix wrong alignment fix
|
5 years ago |
|
Chris Lu
|
644c5c27b4
refactoring
|
5 years ago |
|
Chris Lu
|
33b3366043
volume: avoid compacting wait group
|
5 years ago |
|
Chris Lu
|
a7b1b23c58
fix wrong volume count
|
5 years ago |
|
Chris Lu
|
115558e5f5
adjust counters
|
5 years ago |
|
Chris Lu
|
289fd7eb39
count number of volumes and ec shards
|
5 years ago |
|
Chris Lu
|
17ac1290c0
volume: load ec shards during heartbeats to master
|
5 years ago |
|
Chris Lu
|
cf58fc0e63
refactor: extract out the write throttler
|
5 years ago |
|
Chris Lu
|
b335f81a4f
volume: add option to limit compaction speed
|
5 years ago |
|
Chris Lu
|
3b3651dea3
volume: atomic copying file, adds version and stopOffset
|
5 years ago |
|
Chris Lu
|
ac2727853f
fix needle map entry size
|
5 years ago |
|
Chris Lu
|
e5506152c0
refactoring
|
5 years ago |
|
Chris Lu
|
000ee725fc
refactor Offset into a struct of bytes
|
5 years ago |
|
Chris Lu
|
df95ce0b6c
weed backup: efficient delta backup
|
5 years ago |
|
Chris Lu
|
70815e9124
WIP
|
5 years ago |
|
Chris Lu
|
da871896c3
weed filer: set grpc port to port + 10000
|
5 years ago |
|
Chris Lu
|
916b809c08
add error checking
|
5 years ago |
|
bingoohuang
|
ab6be025d7
go fmt and fix some typo
|
5 years ago |
|
bingoohuang
|
6ddfaf33cb
extract VolumeFileScanner for ScanVolumeFile
|
5 years ago |
|
Chris Lu
|
9383c91eb1
wait to read again if the volume is compacting
|
5 years ago |
|
Chris Lu
|
1478d7ea21
reduce file seek when writing
|
5 years ago |
|
Chris Lu
|
f050b22d6c
close file in ScanVolumeFile()
|
5 years ago |
|
Chris Lu
|
496a7398d1
adjust logging
|
5 years ago |
|
Chris Lu
|
333709657c
adjust log level
|
5 years ago |
|
Chris Lu
|
a362261972
avoid possible racing issue if leveldb or boltdb is used.
|
5 years ago |
