DeOSS

DeOSS ( Decentralized Object Storage Service ) is a decentralized object-based mass storage service that provides low-cost, secure and scalable distributed data storage services for the web3 domain.

Reporting a Vulnerability

If you find out any system bugs or you have a better suggestions, please send an email to frode@cess.one or join CESS discord to communicate with us.

System Requirements

Linux 64-bit Intel/AMD

⚠️ The following commands are executed with root privileges, if the prompt Permission denied appears, you need to switch to root privileges, or add sudo at the top of these commands.

System configuration

Install application tools

For the Debian and ubuntu families of linux systems:

apt install git curl wget vim util-linux -y

For the Fedora, RedHat and CentOS families of linux systems:

yum install git curl wget vim util-linux -y

Firewall configuration

By default, DeOSS uses port 8080 to listen for incoming connections and internally uses port 4001 for p2p communication, if your platform blocks these two ports by default, you may need to enable access to these port.

ufw

For hosts with ufw enabled (Debian, Ubuntu, etc.), you can use the ufw command to allow traffic to flow to specific ports. Use the following command to allow access to a port:

ufw allow 8080
ufw allow 4001

firewall-cmd

For hosts with firewall-cmd enabled (CentOS), you can use the firewall-cmd command to allow traffic on specific ports. Use the following command to allow access to a port:

firewall-cmd --get-active-zones

This command gets the active zone(s). Now, apply port rules to the relevant zones returned above. For example if the zone is public, use

firewall-cmd --zone=public --add-port=4001/tcp --permanent
firewall-cmd --zone=public --add-port=8080/tcp --permanent

Note that permanent makes sure the rules are persistent across firewall start, restart or reload. Finally reload the firewall for changes to take effect.

firewall-cmd --reload

iptables

For hosts with iptables enabled (RHEL, CentOS, etc.), you can use the iptables command to enable all traffic to a specific port. Use the following command to allow access to a port:

iptables -A INPUT -p tcp --dport 4001 -j ACCEPT
iptables -A INPUT -p tcp --dport 8080 -j ACCEPT
service iptables restart

Build from source

Step 1: Install go

DeOSS requires Go 1.19 or higher, See the official Golang installation instructions.

Open go mod mode:

go env -w GO111MODULE="on"

Users in China can add go proxy to speed up the download:

go env -w GOPROXY="https://goproxy.cn,direct"

Step 2: Clone code

git clone https://github.com/CESSProject/DeOSS.git

Run unit test:

cd DeOSS/
go test -v ./...

Step 3: Build a deoss

go build -o deoss cmd/main.go

Step 4: Grant execute permission

chmod +x deoss

Configure Wallet

Step 1: create a wallet account

The wallet is your unique identity in the cess network, it allows you to do transactions with the cess chain, provided that you have some balance in your wallet.

Please refer to Create-CESS-Wallet to create your cess wallet.

Step 2: Recharge your wallet

If you are using the test network, Please join the CESS discord to get it for free. If you are using the official network, please buy CESS tokens.

Configuration file

Use deoss to generate configuration file templates directly in the current directory:

./deoss config

The contents of the configuration file template are as follows. The contents inside are the defaults and you will need to modify them as appropriate. By default, deoss uses conf.yaml in the current directory as the runtime configuration file. You can use -c or -config to specify the location of the configuration file.

# The rpc endpoint of the chain node
Rpc:
  - "wss://testnet-rpc0.cess.cloud/ws/"
  - "wss://testnet-rpc1.cess.cloud/ws/"
# Bootstrap Nodes
Boot:
  - "_dnsaddr.bootstrap-kldr.cess.cloud"
# Account mnemonic
Mnemonic: "xxx xxx ... xxx"
# Service workspace
Workspace: /
# P2P communication port
P2P_Port: 4001
# Service listening port
HTTP_Port: 8080

Start deoss service

Backend operation mode:

nohup ./deoss run 2>&1 &

View deoss status

./deoss stat

Exit the cess network

./deoss exit

Usage for DeOSS API

The public API endpoint URL of DeOSS is the server you deploy, All endpoints described in this document should be made relative to this root URL,The following example uses URL instead.

Before using DeOSS, you must authorize it as follows:

Create a wallet account and fund it, refer to Configure Wallet
Purchase cess storage space:BuySpace
(Optional operations) The default space purchased is valid for 1 month and can be increased by RenewalSpace.
Authorize the use right of the space to DeOSS:Authorize

If you feel that you do not have enough space, you can expand it by means of ExpansionSpace.

Authentication

The DeOSS API uses bearer tokens to authenticate requests.

Your tokens carry many privileges, so be sure to keep them secure! Do not share your secret tokens in publicly accessible locations such as a GitHub repository, client-side code, and so forth.

The bearer token is a cryptic string, usually generated by the server in response to a auth request. The client must send this token in the Authorization header when making requests to protected resources:

Authorization: token

Get token

POST /auth

The authorization interface is used to generate user tokens.

Request Header

key	value
Content-Type	application/json

Request Body

field	value
account	your account address
message	custom Signature Message
signature	signature data

Reference for signature calculation method: https://github.com/CESSProject/cess-toolset/tree/main/cess-sign

Responses

Response schema: application/json

HTTP Code	Message	Description
200	token	returns a token
400	Invalid.Body	body content error
400	InvalidParameter.Account	account error
400	InvalidParameter.Message	message error
400	InvalidParameter.Signature	signature error
403	NoPermission	signature verification failed
500	InternalError	service internal error

Request example

# curl -X POST URL/auth -d '{"account": "cXgfFb...bjfR", "message": "123456", "signature": [44,30,117,...,109,141]}' -H "Content-Type: application/json"

Create a bucket

PUT /{BucketName}

The put bucket interface is used to create a bucket. When uploading files, the bucket must be specified for storage.

Request Header

key	value
Authorization	token

Responses

Response schema: application/json

HTTP Code	Message	Description
200	Block hash	create bucket block hash
400	InvalidHead.MissingToken	token is empty
400	InvalidHead.Token	token error
400	InvalidParameter.Name	wrong bucket name
403	NoPermission	token verification failed
500	InternalError	service internal error

Request example

# curl -X PUT URL/BucketName -H "Authorization: eyJhbGciOiJIUzI1NiIsI......P0Jrg-hX4bXlIyn5I8ML1g"

Upload a file

PUT /{FileName}

The put file interface is used to upload files to the cess system. You need to submit the file as form data and use provide the specific field. If the upload is successful, you will get the fid of the file.

Request Header

key	description
Authorization	token
BucketName	stored bucket name

Request Body

key	value
file	file[binary]

Responses

Response schema: application/json

HTTP Code	Message	Description
200	fid	file id
400	InvalidHead.MissingToken	token is empty
400	InvalidHead.MissingBucketName	bucketname is empty
400	InvalidHead.BucketName	wrong bucket name
400	InvalidHead.Token	token error
400	Unauthorized	DeOSS is not authorized
400	InvalidParameter.EmptyFile	file is empty
400	InvalidParameter.FormFile	form File
400	InvalidParameter.File	error receiving file
403	NoPermission	token verification failed
500	InternalError	service internal error

Request example

# curl -X PUT URL/test.log -F 'file=@test.log;type=application/octet-stream' -H "Authorization: eyJhbGciOiJIUzI...Iyn5I8ML1g" -H "BucketName: bucket1"

Download a file

GET /{fid}

The get file interface downloads the file in the CESS storage system according to the fid.

Request Header

key	value
Operation	download

Responses

The response schema for the normal return status is: application/octet-stream

The response schema for the exception return status is: application/json, The message returned by the exception is as follows:

HTTP Code	Message	Description
400	InvalidHead.Operation	operation error
403	BackingUp	file is being backed up
404	NotFound	file not found
500	InternalError	service internal error

Request example

# curl -X GET -o <savefilename> URL/fid -H "Operation: download"

Delete a file

The delete file interface is used for delete a put file.

DELETE /{fid}

Request Header

key	value
Authorization	token

Responses

Response schema: application/json

HTTP Code	Message	Description
200	Block hash	delete file block hash
400	InvalidHead.MissToken	token is empty
400	InvalidHead.Token	token error
400	InvalidParameter.Name	fid is error
403	NoPermission	token verification failed
500	InternalError	service internal error

Request example

# curl -X DELETE URL/fid -H "Authorization: eyJhbGciOiJIUzI1Ni......g-hX4bXlIyn5I8ML1g"

Delete multiple files

DELETE /

Request Header

key	value
Authorization	token
Content-Type	application/json

Request Body

{
  "files": [
    "filehash1",
    "filehash2",
    "filehash3"
  ]
}

Responses

Response schema: application/json

HTTP Code	Message	Description
200	Block hash	delete file block hash
400	InvalidHead.MissToken	token is empty
400	InvalidHead.Token	token error
400	ERR_ParseBody	unable to parse body
400	empty files	deleted files is empty
403	InvalidToken.NoPermission	token verification failed
500	InternalError	service internal error

Request example

# curl -X DELETE URL/ -d '{"files": ["filehash1", "filehash2"]}' -H "Content-Type: application/json" -H "Authorization: eyJhbGciOiJIUzI1Ni......g-hX4bXlIyn5I8ML1g"

Delete a bucket

The delete bucket interface is used for delete a bucket, all files in the bucket will also be deleted together.

DELETE /{BucketName}

Request Header

key	value
Authorization	token

Responses

Response schema: application/json

HTTP Code	Message	Description
200	Block hash	delete bucket block hash
400	InvalidHead.MissToken	token is empty
400	InvalidHead.Token	token error
400	InvalidParameter.Name	bucket name is error
403	NoPermission	token verification failed
500	InternalError	service internal error

Request example

# curl -X DELETE URL/BucketName -H "Authorization: eyJhbGciOiJIUzI1Ni......g-hX4bXlIyn5I8ML1g"

View bucket info

GET /{BucketName}

This interface is used to view bucket information, including the number of stored files and file IDs.

Request Header

key	description
Account	account address

Responses

Response schema: application/json

HTTP Code	Message	Description
200	success	total number of files in bucket and file id
400	InvalidHead.MissingAccount	account is empty
400	InvalidHead.Account	account is error
400	InvalidParameter.Name	bucket name is error
404	NotFound	bucket not found
500	InternalError	service internal error

Request example

# curl -X GET URL/BucketName -H "Account: cXgfFbnV9H......PMQLoKbjfR"

View bucket list

GET /*

This interface is used to view all buckets.

Request Header

key	description
Account	account address

Responses

Response schema: application/json

HTTP Code	Message	Description
200	success	all bucket names
400	InvalidHead.MissingAccount	account is empty
400	InvalidHead.Account	account is error
400	InvalidParameter.Name	* is error
404	NotFound	bucket not found
500	InternalError	service internal error

Request example

# curl -X GET URL/* -H "Account: cXgfFbnV9H......PMQLoKbjfR"

View file info

GET /{fid}

This interface is used to view the basic information of a file.

Request Header

key	value
Operation	view

Responses

Response schema: application/json

HTTP Code	Message	Description
200	success	file information
400	InvalidParameter.Name	fid or operation is error
404	NotFound	file not found
500	InternalError	service internal error

Request example

# curl -X GET URL/fid -H "Operation: view"

License

Licensed under Apache 2.0

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

README.md

README.md

DeOSS

Reporting a Vulnerability

System Requirements

System configuration

Install application tools

Firewall configuration

ufw

firewall-cmd

iptables

Build from source

Step 1: Install go

Step 2: Clone code

Step 3: Build a deoss

Step 4: Grant execute permission

Configure Wallet

Step 1: create a wallet account

Step 2: Recharge your wallet

Configuration file

Start deoss service

View deoss status

Exit the cess network

Usage for DeOSS API

Authentication

Get token

Create a bucket

Upload a file

Download a file

Delete a file

Delete multiple files

Delete a bucket

View bucket info

View bucket list

View file info

License

Files

README.md

Latest commit

History

README.md

File metadata and controls

DeOSS

Reporting a Vulnerability

System Requirements

System configuration

Install application tools

Firewall configuration

ufw

firewall-cmd

iptables

Build from source

Step 1: Install go

Step 2: Clone code

Step 3: Build a deoss

Step 4: Grant execute permission

Configure Wallet

Step 1: create a wallet account

Step 2: Recharge your wallet

Configuration file

Start deoss service

View deoss status

Exit the cess network

Usage for DeOSS API

Authentication

Get token

Create a bucket

Upload a file

Download a file

Delete a file

Delete multiple files

Delete a bucket

View bucket info

View bucket list

View file info

License