Storj

Read and write files from a Storj bucket

Introduction to Storj

Storj is a cloud storage service that stands out for its decentralized network, which makes it more secure, fault-tolerant, and fast. It's a great option for anyone who wants an alternative to traditional cloud storage providers. In addition, Storj is known for its affordable pricing, so you can use it without breaking the bank, and it has a 25 GB free storage tier.

Signing up for Storj

To start using Storj, you need to create an account on their platform. Here’s a quick guide to get you set up:

  1. Visit the Storj Website: Go to Storj.io and explore their services to understand how Storj can benefit your storage needs.
  2. Sign Up: Click on the ‘Get Started’ button on the homepage. Fill in the required information to create your account.
  3. Verification: After signing up, verify your email address to activate your account.
  4. Access the Dashboard: Once your account is active, log in to access the Storj dashboard. Here you can manage your storage buckets, monitor usage, and access various tools.
  5. Create a Bucket: In the dashboard, create your first storage bucket. This will be the destination or source for your data in ByteNite's computing platform.
  6. Generate S3-Compatible Credentials: For integration with ByteNite, you’ll need Storj S3-compatible credentials, which can be generated from your account. This video shows how to create S3-compatible credentials from the Access section of your Storj DCS web platform.

For detailed guidance and resources on using Storj, visit their documentation page.


Data origin

On ByteNite, you can retrieve files from a Storj bucket that you have access to. If your bucket is private, make sure you have the necessary permissions and credentials. Specifically, for data origins, you must grant your credentials at least read access to the designated bucket.

Configuration

API Endpoints

Create a new job   •    Set job data source

dataSource object:

KeyValueMandatory
dataSourceDescriptor"storj"*
params@type"type.googleapis.com/bytenite.data_source.StorjDataSource"*
paramsnameThe input file path within your bucket*
paramsaccessKeyYour Storj's S3-compatible access key
paramssecretKeyYour Storj's S3-compatible secret key
paramsbucketNameThe name of your Storj bucket*
paramscloudRegionThe Storj cloud region of your bucket*

Example

{
  "dataSource": {  
    "dataSourceDescriptor": "storj",  
    "params": {  
        "@type": "type.googleapis.com/bytenite.data_source.StorjDataSource",  
        "name": "/path/to/file.obj",  
        "accessKey": "your_access_key",  
        "secretKey": "your_secret_key",  
        "bucketName": "your_bucket_name",  
        "cloudRegion": "selected_region"
    }  
	}
}

Data destination

You can upload your output files from ByteNite to a Storj bucket that you have access to. If your bucket is private, ensure you have the necessary permissions and credentials. Specifically, for data destinations, you must grant your credentials at least write access to the designated bucket.

Configuration

API Endpoints

Create a new job   •    Set job data source

dataDestination object:

KeyValueMandatory
dataSourceDescriptor"storj"*
params@type"type.googleapis.com/bytenite.data_source.StorjDataSource"*
paramsnameThe output folder path within your bucket. Note: if the output path doesn't exist, it will be created*
paramsaccessKeyYour Storj's S3-compatible access key
paramssecretKeyYour Storj's S3-compatible secret key
paramsbucketNameThe name of your Storj bucket*
paramscloudRegionThe Storj cloud region of your bucket*

Example

{
  "dataDestination": {  
    "dataSourceDescriptor": "storj",  
    "params": {  
        "@type": "type.googleapis.com/bytenite.data_source.StorjDataSource",  
        "name": "/output/folder/",  
        "accessKey": "your_access_key",  
        "secretKey": "your_secret_key",  
        "bucketName": "your_bucket_name",  
        "cloudRegion": "selected_region"
    }  
	}
}