HFO4
841a2e258d
fix: ignore folder name conflict while creating upload session
2 years ago
HFO4
a26183875f
fix: in decompress, file stream should be closed after copy it to temp file.
2 years ago
HFO4
00e2b26294
fix: remove filesystem upload log
2 years ago
HFO4
4f65d0e859
fix: use default chunk size if it is set as 0
2 years ago
HFO4
18f5bffed1
test: fix failed test
2 years ago
HFO4
478d390867
Fix: show modified date instead of creating date in file list
2 years ago
HFO4
febbd0c5a0
Feat: batch download in streamming paradism
...
Fix: add cache-controler header in API call responses
2 years ago
HFO4
20e90e3963
Improve error message when uploading is conflicted
2 years ago
HFO4
d117080991
Test: new changes pkg filesystem
2 years ago
HFO4
1c0a735df8
Test: new changes pkg remote, fsctx, part of filesystem
2 years ago
HFO4
c6130ab078
Feat: new changes in pkg: chunk, backoff, local, onedrive
2 years ago
HFO4
31315c86ee
Feat: support option for cache streamed chunk data into temp file for potential retry.
2 years ago
HFO4
e51c5cd70d
Fix: root folder should not be deleted
2 years ago
HFO4
eaa8c9e12d
Refactor: move thumbnail config from ini file to database
2 years ago
HFO4
7eb8173101
Feat: adapt new uploader for s3 like policy
...
This commit also fix #730 , #713 , #756 , #5
2 years ago
HFO4
d3016b60af
Feat: adapt new uploader for upyun policy
2 years ago
HFO4
9e5713b139
Feat: adapt new uploader for COS policy
2 years ago
HFO4
07f13cc350
Refactor: factory method for OSS client
...
Fix: use HTTPS schema by default in OSS client
Feat: new handler for Qiniu policy
2 years ago
HFO4
0df9529b32
Feat: generating token and callback url for OSS muiltpart upload, support resume upload in sever-side uploading for OSS
2 years ago
HFO4
015ccd5026
Feat: use new ChunkManager for OneDrive API client
2 years ago
HFO4
b6efca1878
Feat: uploading OneDrive files in client side
2 years ago
HFO4
c89327631e
Fix: panics inside of task was not correctly logged into DB
...
Feat: slave node use new API to upload file to master
2 years ago
HFO4
9136f3caec
Fix: while placeholder file got conflict, original file might be deleted
2 years ago
HFO4
0650684dd9
Feat: cancel upload session in slave node
2 years ago
HFO4
effbc8607e
Refactor: use chunk manager to manage resume upload in server side
2 years ago
HFO4
b96019be7c
Feat: client method to upload file from master node to slave node
2 years ago
HFO4
e0714fdd53
Feat: process upload callback sent from slave node
3 years ago
HFO4
4925a356e3
Enable overwrite for non-first chunk uploading request
3 years ago
HFO4
7214e59c25
Feat: creating upload session and credential from master server
3 years ago
HFO4
118d738797
Feat: support apply append mode and overwrite mode for FileStream
3 years ago
HFO4
285611baf7
Feat: truncate file if uploaded chunk is overlapped
3 years ago
HFO4
521c5c8dc4
Feat: use transactions to manipulate user's used storage
3 years ago
HFO4
285e80ba76
Feat: use database transactions to delete / update file size
3 years ago
HFO4
2811ee3285
Feat: slave policy creating upload session API
3 years ago
HFO4
7dd636da74
Feat: upload session recycle crontab job / API for cleanup all upload session
3 years ago
HFO4
3444b4a75e
Feat: chunk upload handling for local policy
3 years ago
HFO4
c301bd6045
Feat: API for receiviing chunk data
3 years ago
HFO4
72173bf894
Refactor: create placeholder file and record upload session id in it
3 years ago
HFO4
6fdf77e00e
Feat: support setting "last modified" props when creating upload session
3 years ago
HFO4
e37e93a7b6
Feat: create hidden file when creating upload session
3 years ago
HFO4
868a88e5fc
Refactor: use universal FileHeader when handling file upload, remove usage of global ctx with FileHeader, SavePath, DisableOverwrite
3 years ago
KAAAsS
8a222e7df4
fix: nil pointer in qiniu and upyun driver ( #1146 )
3 years ago
HFO4
8443a30fb1
Feat: support chunk size option in policy
3 years ago
HFO4
de9c41082c
Feat: create upload session and pre-upload check
3 years ago
HFO4
855c9d92c4
Feat: get policy from directory props / Feat: return source enabled flag in file list
3 years ago
HFO4
af4d9767c2
Fix: slave node cannot transfer files to other slave node
3 years ago
HFO4
3948ee7f3a
Fix: use `X-Cr-` as custom header prefix
3 years ago
HFO4
700e13384e
Fix: using url escape instead of unescape in remote handler ( #1051 )
3 years ago
HFO4
9056ef9171
Test: new changes in 3.4.0
3 years ago
HFO4
532bff820a
Test: new modifications in filesystem pkg
3 years ago
kikoqiu
54ed7e43ca
Feat: improve thumbnails proformance and GC for local policy ( #1044 )
...
* thumb generating improvement
Replace "github.com/nfnt/resize" with "golang.org/x/image/draw". Add thumb task queue to avoid oom when batch thumb operation
* thumb improvement
* Add some tests for thumbnail generation
3 years ago
HFO4
e41ec9defa
Refactor: move slave pkg inside of cluster
...
Test: middleware for node communication
3 years ago
AaronLiu
056de22edb
Feat: aria2 download and transfer in slave node ( #1040 )
...
* Feat: retrieve nodes from data table
* Feat: master node ping slave node in REST API
* Feat: master send scheduled ping request
* Feat: inactive nodes recover loop
* Modify: remove database operations from aria2 RPC caller implementation
* Feat: init aria2 client in master node
* Feat: Round Robin load balancer
* Feat: create and monitor aria2 task in master node
* Feat: salve receive and handle heartbeat
* Fix: Node ID will be 0 in download record generated in older version
* Feat: sign request headers with all `X-` prefix
* Feat: API call to slave node will carry meta data in headers
* Feat: call slave aria2 rpc method from master
* Feat: get slave aria2 task status
Feat: encode slave response data using gob
* Feat: aria2 callback to master node / cancel or select task to slave node
* Fix: use dummy aria2 client when caller initialize failed in master node
* Feat: slave aria2 status event callback / salve RPC auth
* Feat: prototype for slave driven filesystem
* Feat: retry for init aria2 client in master node
* Feat: init request client with global options
* Feat: slave receive async task from master
* Fix: competition write in request header
* Refactor: dependency initialize order
* Feat: generic message queue implementation
* Feat: message queue implementation
* Feat: master waiting slave transfer result
* Feat: slave transfer file in stateless policy
* Feat: slave transfer file in slave policy
* Feat: slave transfer file in local policy
* Feat: slave transfer file in OneDrive policy
* Fix: failed to initialize update checker http client
* Feat: list slave nodes for dashboard
* Feat: test aria2 rpc connection in slave
* Feat: add and save node
* Feat: add and delete node in node pool
* Fix: temp file cannot be removed when aria2 task fails
* Fix: delete node in admin panel
* Feat: edit node and get node info
* Modify: delete unused settings
3 years ago
AaronLiu
65c4367689
Revert "delete $name policy ( #831 )" ( #961 )
...
This reverts commit e6959a5026
.
3 years ago
Songtao
e6959a5026
delete $name policy ( #831 )
3 years ago
HFO4
8659bdcf77
Fix: unable to read file from UPYUN ( #472 , #472 , #836 )
3 years ago
HFO4
96712fb066
Feat: use RFC3339 time format in returned results ( #811 )
3 years ago
HFO4
c0f7214cdb
Revert "Fix: OSS SDK will encode all object key ( #694 )"
...
This reverts commit 270f617b
and fix #802
3 years ago
HFO4
595f4a1350
Test: get parament source in OneDrive handler
3 years ago
HFO4
a5f80a4431
Feat: get permanent URL for OneDrive policy
3 years ago
ihipop
270f617b9d
Fix: OSS SDK will encode all object key ( #694 )
...
(cherry picked from commit b9cd82b849065f0d1ad093708f09c8722339bf2a)
3 years ago
HFO4
170f2279c1
Fix: failed to get thumbnails under global OneDrive policy
4 years ago
HFO4
4e2f243436
Feat: support using SharePoint site to store files
4 years ago
HFO4
a93b964d8b
Modify: OneDrive file URL cache will refreshed after file is updated
4 years ago
HFO4
4cf6c81534
Fix: failed unit test
4 years ago
HFO4
5a66af3105
Fix: failed unit test
4 years ago
HFO4
fc5c67cc20
Feat: disable overwrite for OneDrive policy
4 years ago
HFO4
5e226efea1
Feat: disable overwrite for non-updating put request, only works under local,slave,OneDrive,OSS policy. ( #764 )
4 years ago
HFO4
e699287ffd
Modify: mark as success when deleting a file that does not exist;
...
Fix: minio is not usable in S3 policy
Modify: use batch request to delete S3 files
4 years ago
Breeze Chen
488e62f762
Fix qiniu last modify time. ( #691 )
4 years ago
HFO4
5b44606276
Test: replace cdn proxy url for OneDrive policy
4 years ago
HFO4
bd2bdf253b
Feat: using custom reverse proxying in OneDrive file downloading
4 years ago
HFO4
7279be2924
Fix: user storage might be returned twice when OneDrive uploading canceled in WebDAV requests
4 years ago
HFO4
a5805b022a
Feat: enable using LAN endpoint in serverside request of OSS policy ( #399 )
4 years ago
HFO4
d97bc26042
Fix: add recycleLock preventing recycle FileSystem used by another goroutine
4 years ago
Loyalsoldier
79b8784934
Comply with Golang semantic import versioning ( #630 )
...
* Code: compatible with semantic import versioning
* Tools & Docs: compatible with semantic import versioning
* Clean go.mod & go.sum
4 years ago
HFO4
746aa3e8ef
Test: s3 policy
4 years ago
HFO4
95f318e069
Feat: adapt minio for S3 policy and fix listing files
4 years ago
HFO4
77394313aa
Fix: S3 adaption for minio
4 years ago
ZZF
dd50ef1c25
添加S3策略的支持 ( #425 )
...
* 添加亚马逊S3策略的支持
* 添加CDN支持,公有目录删除无用参数
* 增加Region
4 years ago
HFO4
a7ba357cb8
Fix: hash mark in file name lead to 404 error ( #405 )
4 years ago
HFO4
5af3c4e244
Fix: directory renaming should not be limited by file extensions ( #395 )
4 years ago
HFO4
280308bc05
Modify: increase OneDrive client uploading chunk size to 100MB
4 years ago
HFO4
e8a6df9a86
Feat: import file from existing outer folder
4 years ago
HFO4
79daf92896
Test: List files in OneDrive
4 years ago
HFO4
8a2be58ef3
Feat: List files in OneDrive
4 years ago
HFO4
ce7784090f
Feat: List files in upyun bucket
4 years ago
HFO4
dfb663a6e0
Feat: List files in Qiniu bucket
4 years ago
HFO4
cfaf20926f
Feat: List files in COS bucket
4 years ago
HFO4
305497e7cb
Test: oss.List
4 years ago
HFO4
52c2422be9
Feat: list oss files
4 years ago
HFO4
1afc750dae
Modify: create folder if not exist while importing files
4 years ago
HFO4
960c886496
Test: slave side list file
4 years ago
HFO4
5d579cdadc
Feat: slave side list file
4 years ago
HFO4
36e5b31f73
Modify: add recursive options for list method
...
Test: local.List
4 years ago
HFO4
8c547a05fd
Fix: mismatched pointer receiver in oss.Driver
4 years ago
HFO4
f7311f906b
Feat: add List method to Handler interface / implement local.List
4 years ago
HFO4
6006ff4d22
Feat: regenerate when thumbnail files not exist
4 years ago
HFO4
8c3287d380
Test: Policy.IsThumbExist / filesystem.AddFile
4 years ago
HFO4
304e7b502c
Feat: thumbnail support for COS policy
4 years ago