Storj
Read and write files from a Storj bucket
Introduction to Storj
Storj is a cloud storage service that stands out for its decentralized network, which makes it more secure, fault-tolerant, and fast. It's a great option for anyone who wants an alternative to traditional cloud storage providers. In addition, Storj is known for its affordable pricing, so you can use it without breaking the bank, and it has a 25 GB free storage tier.
Signing up for Storj
To start using Storj, you need to create an account on their platform. Here’s a quick guide to get you set up:
- Visit the Storj Website: Go to Storj.io and explore their services to understand how Storj can benefit your storage needs.
- Sign Up: Click on the ‘Get Started’ button on the homepage. Fill in the required information to create your account.
- Verification: After signing up, verify your email address to activate your account.
- Access the Dashboard: Once your account is active, log in to access the Storj dashboard. Here you can manage your storage buckets, monitor usage, and access various tools.
- Create a Bucket: In the dashboard, create your first storage bucket. This will be the destination or source for your data in ByteNite's computing platform.
- Generate S3-Compatible Credentials: For integration with ByteNite, you’ll need Storj S3-compatible credentials, which can be generated from your account. This video shows how to create S3-compatible credentials from the Access section of your Storj DCS web platform.
For detailed guidance and resources on using Storj, visit their documentation page.
Data origin
On ByteNite, you can retrieve files from a Storj bucket that you have access to. If your bucket is private, make sure you have the necessary permissions and credentials. Specifically, for data origins, you must grant your credentials at least read access to the designated bucket.
Configuration
API Endpoints
dataSource
object:
Key | Value | Mandatory |
---|---|---|
dataSourceDescriptor | "storj" | * |
params → @type | "type.googleapis.com/bytenite.data_source.StorjDataSource" | * |
params → name | The input file path within your bucket | * |
params → accessKey | Your Storj's S3-compatible access key | |
params → secretKey | Your Storj's S3-compatible secret key | |
params → bucketName | The name of your Storj bucket | * |
params → cloudRegion | The Storj cloud region of your bucket | * |
Example
{
"dataSource": {
"dataSourceDescriptor": "storj",
"params": {
"@type": "type.googleapis.com/bytenite.data_source.StorjDataSource",
"name": "/path/to/file.obj",
"accessKey": "your_access_key",
"secretKey": "your_secret_key",
"bucketName": "your_bucket_name",
"cloudRegion": "selected_region"
}
}
}
Data destination
You can upload your output files from ByteNite to a Storj bucket that you have access to. If your bucket is private, ensure you have the necessary permissions and credentials. Specifically, for data destinations, you must grant your credentials at least write access to the designated bucket.
Configuration
API Endpoints
dataDestination
object:
Key | Value | Mandatory |
---|---|---|
dataSourceDescriptor | "storj" | * |
params → @type | "type.googleapis.com/bytenite.data_source.StorjDataSource" | * |
params → name | The output folder path within your bucket. Note: if the output path doesn't exist, it will be created | * |
params → accessKey | Your Storj's S3-compatible access key | |
params → secretKey | Your Storj's S3-compatible secret key | |
params → bucketName | The name of your Storj bucket | * |
params → cloudRegion | The Storj cloud region of your bucket | * |
Example
{
"dataDestination": {
"dataSourceDescriptor": "storj",
"params": {
"@type": "type.googleapis.com/bytenite.data_source.StorjDataSource",
"name": "/output/folder/",
"accessKey": "your_access_key",
"secretKey": "your_secret_key",
"bucketName": "your_bucket_name",
"cloudRegion": "selected_region"
}
}
}
Updated 8 months ago