When the data economy develops to a certain extent, people will participate in it extensively and deeply, and everyone will inevitably participate in different data storage activities. In addition, with the advent of the Web 3 era, most technological fields will slowly begin to upgrade or transform in the past few years, and decentralized storage, as an important infrastructure of Web 3, will land more applications in the future Scenes. For example, we are familiar with the data storage networks behind social data, short videos, live broadcasts, smart cars, etc., and will also adopt a decentralized storage model in the future.

first level title

From decentralized storage to data availability layer

In the past, data was stored in the cloud through the traditional centralized method, and the data was usually completely stored on the centralized server. Amazon Web Services (AWS) is the originator of cloud storage and currently the world's largest cloud storage provider. With the passage of time, users' demands for personal information security and data storage continue to increase, especially after some large-scale data operators have data leaks, the disadvantages of centralized storage have gradually emerged, and traditional storage methods can no longer meet the current market demand. Coupled with the continuous advancement of the Web 3 era and the development of blockchain applications, data has become diversified and the scale of data has also continued to grow. The dimensions of personal network data are more comprehensive and valuable, making data security and data privacy more complex. The data becomes more important, and the requirements for data storage also begin to rise.

Decentralized data storage came into being. Decentralized storage is one of the earliest and most concerned infrastructures in the Web 3 field. The earliest solution is Filecoin launched in 2017. Compared with AWS, there is an essential difference between decentralization and centralization. AWS has established and maintained its own data center consisting of multiple servers, and users who need to purchase storage services can pay directly to AWS. The decentralized storage follows the sharing economy, using massive edge storage devices to provide storage services, and the data is actually stored on the storage provided by the Provider node. Therefore, the decentralized storage project party cannot control these data. The most essential difference between decentralized storage and AWS is whether users can control their own data. In such a system without centralized control, the safety factor of data is very high.

Decentralized storage is mainly a storage business model in which files or file sets are stored in pieces in storage space through distributed storage. The reason why decentralized storage is important is that it solves the various pain points of Web 2 centralized cloud storage, and is more in line with the needs of the development of the big data era. It can store unstructured edge data at a lower cost and more efficiently. Empower various emerging technologies. Therefore, decentralized storage can also be said to be the cornerstone of Web 3 development.

At present, there are two common decentralized storage projects. One is to generate blocks and use storage for mining. The problem brought about by this model is that storage and downloading on the chain will slow down the actual use speed , it often happens that it takes several hours to download a photo. The other is to use one or several nodes as centralized nodes, which can only be stored and downloaded after being verified by the centralized nodes. Once the centralized nodes are attacked or damaged, the stored data will also be lost.

Compared with the first project, MEMO's storage layering mechanism solves the problem of storage download speed well, making the storage download speed reach the order of seconds. Compared with the second type of project, MEMO adopts the role of Keeper to randomly select verification nodes, avoiding the emergence of centralization and ensuring security at the same time. Moreover, MEMO has created RAFI technology, which can improve the repair ability several times, and greatly improve the security, reliability and availability of storage.

Data Availability DA (Data Availability) essentially means that light nodes do not need to store all data and maintain the status of the entire network in a timely manner without participating in the consensus. For such nodes, an efficient way to ensure data availability and accuracy is required. Because the core of the blockchain lies in the immutability of data. The blockchain can ensure that the data in the entire network is consistent. In order to ensure performance, consensus nodes will tend to be more centralized. Other nodes need to obtain available data confirmed by consensus through DA. The independent data availability layer effectively eliminates the single point of failure problem and maximizes data security.

image description

first level title

Celestia for Independent Data Availability Layer Analysis

An independent data availability layer is a public chain, which is better than a usability committee composed of a group of subjective people. If the private keys of enough committee members are stolen (both happened in Ronin Bridge and Harmony Horizon Bridge), the off-chain If data availability is not available, users can be threatened - only if they pay enough ransom to withdraw from Layer 2.

Since the off-chain data availability committee is not secure enough, what if the blockchain is introduced as a trust subject to ensure off-chain data availability?

What Celestia does is to make the data availability layer more decentralized - equivalent to providing an independent DA public chain, with a series of verification nodes, block producers and consensus mechanisms to improve the security level.

Layer 2 publishes the transaction data to the Celestia main chain, and the Celestia verifier signs the Merkle Root of DA Attestation, and sends it to the DA Bridge Contract on the Ethereum main chain for verification and storage. In this way, the Merkle Root of DA Attestation is actually used to prove the availability of all data. The DA Bridge Contract on the Ethereum main chain only needs to verify and store this Merkle Root, and the overhead is greatly reduced.

first level title

text

MEMO is a new generation of high-capacity, high-availability enterprise-level storage network created by aggregating global edge storage devices through algorithmic features. The team was established in September 2017 and mainly researches the field of decentralized storage. MEMO is a highly secure and highly reliable large-scale decentralized data storage protocol based on blockchain point-to-point technology, which can realize large-scale data storage. Unlike one-to-many centralized storage, MEMO can realize many-to-many storage operations without data centers. In MEMO's main chain, there are mainly smart contracts used to constrain all nodes. A series of key operations such as uploading of stored data, matching of storage nodes, normal operation of the system, and operation of the penalty mechanism are all controlled by smart contracts. control.

In terms of technology, in the existing decentralized storage systems, represented by Filecoin, Arweave, Storj, etc., they allow all computer users to connect and rent out their unused hard disk space in order to obtain a certain fee or tokens. Although they are all decentralized storage, they all have their own characteristics. The difference between MEMO is that it uses erasure coding and data repair technology to improve storage functions, make data more secure, and make storage and download more efficient. Because creating a more pure and practical decentralized storage system is the ultimate goal of MEMO.

MEMO optimizes the incentive mechanism of Provider while enhancing the usability of storage. In addition to User and Provider roles, Keeper is also introduced to prevent nodes from being maliciously attacked. The system maintains economic balance through the mutual restraint of multiple roles. It can support high-capacity and high-availability enterprise-level commercial storage applications. It can provide safe and reliable cloud storage services for NFT, GameFi, DeFi, SocialFi, etc., and is compatible with WEB 2. It is the product of the perfect fusion of blockchain and cloud storage.