c6130ab078
Feat: new changes in pkg: chunk, backoff, local, onedrive
2 years ago
31315c86ee
Feat: support option for cache streamed chunk data into temp file for potential retry.
2 years ago
e51c5cd70d
Fix: root folder should not be deleted
2 years ago
eaa8c9e12d
Refactor: move thumbnail config from ini file to database
2 years ago
7eb8173101
Feat: adapt new uploader for s3 like policy
...
This commit also fix #730 , #713 , #756 , #5
2 years ago
d3016b60af
Feat: adapt new uploader for upyun policy
2 years ago
9e5713b139
Feat: adapt new uploader for COS policy
2 years ago
07f13cc350
Refactor: factory method for OSS client
...
Fix: use HTTPS schema by default in OSS client
Feat: new handler for Qiniu policy
2 years ago
0df9529b32
Feat: generating token and callback url for OSS muiltpart upload, support resume upload in sever-side uploading for OSS
2 years ago
015ccd5026
Feat: use new ChunkManager for OneDrive API client
2 years ago
b6efca1878
Feat: uploading OneDrive files in client side
2 years ago
c89327631e
Fix: panics inside of task was not correctly logged into DB
...
Feat: slave node use new API to upload file to master
2 years ago
9136f3caec
Fix: while placeholder file got conflict, original file might be deleted
2 years ago
0650684dd9
Feat: cancel upload session in slave node
2 years ago
effbc8607e
Refactor: use chunk manager to manage resume upload in server side
2 years ago
b96019be7c
Feat: client method to upload file from master node to slave node
2 years ago
e0714fdd53
Feat: process upload callback sent from slave node
2 years ago
4925a356e3
Enable overwrite for non-first chunk uploading request
2 years ago
7214e59c25
Feat: creating upload session and credential from master server
2 years ago
118d738797
Feat: support apply append mode and overwrite mode for FileStream
2 years ago
285611baf7
Feat: truncate file if uploaded chunk is overlapped
2 years ago
521c5c8dc4
Feat: use transactions to manipulate user's used storage
2 years ago
285e80ba76
Feat: use database transactions to delete / update file size
2 years ago
2811ee3285
Feat: slave policy creating upload session API
2 years ago
7dd636da74
Feat: upload session recycle crontab job / API for cleanup all upload session
2 years ago
3444b4a75e
Feat: chunk upload handling for local policy
2 years ago
c301bd6045
Feat: API for receiviing chunk data
2 years ago
72173bf894
Refactor: create placeholder file and record upload session id in it
2 years ago
6fdf77e00e
Feat: support setting "last modified" props when creating upload session
2 years ago
e37e93a7b6
Feat: create hidden file when creating upload session
2 years ago
868a88e5fc
Refactor: use universal FileHeader when handling file upload, remove usage of global ctx with FileHeader, SavePath, DisableOverwrite
2 years ago
8a222e7df4
fix: nil pointer in qiniu and upyun driver ( #1146 )
2 years ago
8443a30fb1
Feat: support chunk size option in policy
2 years ago
de9c41082c
Feat: create upload session and pre-upload check
2 years ago
855c9d92c4
Feat: get policy from directory props / Feat: return source enabled flag in file list
2 years ago
af4d9767c2
Fix: slave node cannot transfer files to other slave node
3 years ago
3948ee7f3a
Fix: use `X-Cr-` as custom header prefix
3 years ago
700e13384e
Fix: using url escape instead of unescape in remote handler ( #1051 )
3 years ago
9056ef9171
Test: new changes in 3.4.0
3 years ago
532bff820a
Test: new modifications in filesystem pkg
3 years ago
54ed7e43ca
Feat: improve thumbnails proformance and GC for local policy ( #1044 )
...
* thumb generating improvement
Replace "github.com/nfnt/resize" with "golang.org/x/image/draw". Add thumb task queue to avoid oom when batch thumb operation
* thumb improvement
* Add some tests for thumbnail generation
3 years ago
e41ec9defa
Refactor: move slave pkg inside of cluster
...
Test: middleware for node communication
3 years ago
056de22edb
Feat: aria2 download and transfer in slave node ( #1040 )
...
* Feat: retrieve nodes from data table
* Feat: master node ping slave node in REST API
* Feat: master send scheduled ping request
* Feat: inactive nodes recover loop
* Modify: remove database operations from aria2 RPC caller implementation
* Feat: init aria2 client in master node
* Feat: Round Robin load balancer
* Feat: create and monitor aria2 task in master node
* Feat: salve receive and handle heartbeat
* Fix: Node ID will be 0 in download record generated in older version
* Feat: sign request headers with all `X-` prefix
* Feat: API call to slave node will carry meta data in headers
* Feat: call slave aria2 rpc method from master
* Feat: get slave aria2 task status
Feat: encode slave response data using gob
* Feat: aria2 callback to master node / cancel or select task to slave node
* Fix: use dummy aria2 client when caller initialize failed in master node
* Feat: slave aria2 status event callback / salve RPC auth
* Feat: prototype for slave driven filesystem
* Feat: retry for init aria2 client in master node
* Feat: init request client with global options
* Feat: slave receive async task from master
* Fix: competition write in request header
* Refactor: dependency initialize order
* Feat: generic message queue implementation
* Feat: message queue implementation
* Feat: master waiting slave transfer result
* Feat: slave transfer file in stateless policy
* Feat: slave transfer file in slave policy
* Feat: slave transfer file in local policy
* Feat: slave transfer file in OneDrive policy
* Fix: failed to initialize update checker http client
* Feat: list slave nodes for dashboard
* Feat: test aria2 rpc connection in slave
* Feat: add and save node
* Feat: add and delete node in node pool
* Fix: temp file cannot be removed when aria2 task fails
* Fix: delete node in admin panel
* Feat: edit node and get node info
* Modify: delete unused settings
3 years ago
65c4367689
Revert "delete $name policy ( #831 )" ( #961 )
...
This reverts commit e6959a5026
3 years ago
e6959a5026
delete $name policy ( #831 )
3 years ago
8659bdcf77
Fix: unable to read file from UPYUN ( #472 , #472 , #836 )
3 years ago
96712fb066
Feat: use RFC3339 time format in returned results ( #811 )
3 years ago
c0f7214cdb
Revert "Fix: OSS SDK will encode all object key ( #694 )"
...
This reverts commit 270f617bfix #802
3 years ago
595f4a1350
Test: get parament source in OneDrive handler
3 years ago
a5f80a4431
Feat: get permanent URL for OneDrive policy
3 years ago
270f617b9d
Fix: OSS SDK will encode all object key ( #694 )
...
(cherry picked from commit b9cd82b849065f0d1ad093708f09c8722339bf2a)
3 years ago
170f2279c1
Fix: failed to get thumbnails under global OneDrive policy
3 years ago
4e2f243436
Feat: support using SharePoint site to store files
3 years ago
a93b964d8b
Modify: OneDrive file URL cache will refreshed after file is updated
3 years ago
4cf6c81534
Fix: failed unit test
3 years ago
5a66af3105
Fix: failed unit test
3 years ago
fc5c67cc20
Feat: disable overwrite for OneDrive policy
3 years ago
5e226efea1
Feat: disable overwrite for non-updating put request, only works under local,slave,OneDrive,OSS policy. ( #764 )
3 years ago
e699287ffd
Modify: mark as success when deleting a file that does not exist;
...
Fix: minio is not usable in S3 policy
Modify: use batch request to delete S3 files
3 years ago
488e62f762
Fix qiniu last modify time. ( #691 )
4 years ago
5b44606276
Test: replace cdn proxy url for OneDrive policy
4 years ago
bd2bdf253b
Feat: using custom reverse proxying in OneDrive file downloading
4 years ago
7279be2924
Fix: user storage might be returned twice when OneDrive uploading canceled in WebDAV requests
4 years ago
a5805b022a
Feat: enable using LAN endpoint in serverside request of OSS policy ( #399 )
4 years ago
d97bc26042
Fix: add recycleLock preventing recycle FileSystem used by another goroutine
4 years ago
79b8784934
Comply with Golang semantic import versioning ( #630 )
...
* Code: compatible with semantic import versioning
* Tools & Docs: compatible with semantic import versioning
* Clean go.mod & go.sum
4 years ago
746aa3e8ef
Test: s3 policy
4 years ago
95f318e069
Feat: adapt minio for S3 policy and fix listing files
4 years ago
77394313aa
Fix: S3 adaption for minio
4 years ago
dd50ef1c25
添加S3策略的支持 ( #425 )
...
* 添加亚马逊S3策略的支持
* 添加CDN支持，公有目录删除无用参数
* 增加Region
4 years ago
a7ba357cb8
Fix: hash mark in file name lead to 404 error ( #405 )
4 years ago
5af3c4e244
Fix: directory renaming should not be limited by file extensions ( #395 )
4 years ago
280308bc05
Modify: increase OneDrive client uploading chunk size to 100MB
4 years ago
e8a6df9a86
Feat: import file from existing outer folder
4 years ago
79daf92896
Test: List files in OneDrive
4 years ago
8a2be58ef3
Feat: List files in OneDrive
4 years ago
ce7784090f
Feat: List files in upyun bucket
4 years ago
dfb663a6e0
Feat: List files in Qiniu bucket
4 years ago
cfaf20926f
Feat: List files in COS bucket
4 years ago
305497e7cb
Test: oss.List
4 years ago
52c2422be9
Feat: list oss files
4 years ago
1afc750dae
Modify: create folder if not exist while importing files
4 years ago
960c886496
Test: slave side list file
4 years ago
5d579cdadc
Feat: slave side list file
4 years ago
36e5b31f73
Modify: add recursive options for list method
...
Test: local.List
4 years ago
8c547a05fd
Fix: mismatched pointer receiver in oss.Driver
4 years ago
f7311f906b
Feat: add List method to Handler interface / implement local.List
4 years ago
6006ff4d22
Feat: regenerate when thumbnail files not exist
4 years ago
8c3287d380
Test: Policy.IsThumbExist / filesystem.AddFile
4 years ago
304e7b502c
Feat: thumbnail support for COS policy
4 years ago
514e069113
Refactor: decide if there is a thumbnail based on the file extension
4 years ago
ab3b59e63d
Feat: add option to force delete file record in database
4 years ago
816b537787
Fix: permission error while creating folder recursively
4 years ago
e07b09186d
Modify: use 644 permission when creating a new physical directory ( #274 )
4 years ago
8c7d075484
Fix: repeated return of capacity when OneDrive WebDAV upload canceled
4 years ago
46743f3c1e
Fix: unsupported GET parameters in public OSS bucket
4 years ago
6285e45e34
Fix: filename and code typo ( #260 )
...
* Rename handller.go to handler.go
* Rename handller.go to handler.go
* Rename handller_test.go to handler_test.go
* Rename handller.go to handler.go
* Rename handller.go to handler.go
* Rename handller.go to handler.go
* Rename handller.go to handler.go
* Fix typo
4 years ago
87fde687eb
Fix: files with percent sign (%) cannot be deleted in OneDrive
4 years ago
0eb04ed0ea
Feat: cache for OneDrive META request
4 years ago
ff2dae80f0
Fix: incorrect thumb path detect while deleting files
4 years ago
HFO4
KAAAsS
kikoqiu
AaronLiu
Songtao
ihipop
Breeze Chen
Loyalsoldier
ZZF
yeungc