从存储过去到计算未来:AO超并行计算机

avatar
YBB Capital
3 months ago
This article is approximately 3299 words,and reading the entire article takes about 5 minutes
Arweave最新提出的AO协议,在存储公链上实现超高性能运算甚至达成准Web2的体验。这与我们目前所熟知的扩容方式和架构设计似乎有着巨大的差别,那么AO究竟是什么?支持其性能的逻辑又从何而来?

Original author: YBB Capital Researcher Zeke

从存储过去到计算未来:AO超并行计算机

Preface

The two mainstream blockchain architecture designs that Web3 has now differentiated have inevitably caused some aesthetic fatigue. Whether it is the rampant modular public chain or the new L1 that always emphasizes performance but fails to reflect performance advantages, its ecology can be said to be... It is a replica or slight improvement of the Ethereum ecosystem. The extremely homogeneous experience has already made users lose their sense of freshness. The latest AO protocol proposed by Arweave is eye-catching, achieving ultra-high-performance computing on the storage public chain and even achieving a quasi-Web2 experience. This seems to be hugely different from the expansion methods and architectural designs we are currently familiar with. So what exactly is AO? Where does the logic to support its performance come from?

How to understand AO

The name of AO comes from the abbreviation of Actor Oriented, a programming paradigm in the concurrent computing model Actor Model. Its overall design idea is derived from the extension of Smart Weave, and it also follows the message passing as the core concept of the Actor Model. Simply put, we can understand AO as a hyper-parallel computer running on the Arweave network through a modular architecture. From an implementation perspective, AO is actually not the modular execution layer we see today, but a communication protocol that standardizes message passing and data processing. The core goal of the protocol is to realize the collaboration of different roles within the network through information transfer, thereby achieving a computing layer whose performance can be infinitely superimposed, ultimately enabling Arweave, the giant hard drive, to have a central authority in a decentralized trust environment. Cloud-level speed, scalable computing power and scalability.

从存储过去到计算未来:AO超并行计算机

AO architecture

The concept of AO seems to be somewhat similar to the Core Time segmentation and recombination proposed by Gavin Wood at last years Polkadot Decoded conference. Both of them achieve the so-called high-performance world through the scheduling and coordination of computing resources. computer. But there are actually some differences between the two in essence. Exotic Scheduling is the deconstruction and reorganization of the relay chain block space resources. It has not changed much to the architecture of Polkadot. Although the computing performance has exceeded that of plug-in The limit of a single parachain under the slot model is still limited by the maximum number of idle cores of Polkadot. AO can theoretically provide nearly unlimited computing power (in actual situations it should depend on the level of network incentives) and a higher degree of freedom through horizontal expansion of nodes. Architecturally, AO standardizes data processing methods and message expressions. , and completes the sorting, scheduling and calculation of information through three network units (subnetworks). Its standardization method and the functions of different units can be summarized as the following points according to official data analysis:

  • Process: A process can be viewed as a collection of execution instructions in AO. When a process is initialized, it can define the computing environment it requires, including virtual machines, schedulers, memory requirements, and necessary extensions. These processes maintain a holographic state (each process data can independently store state in Arweaves message log, and the holographic state will be explained in detail in the Verifiable Issues section below). The holographic state means that the process can Works independently, and execution is dynamic and can be performed by appropriate computing units. In addition to receiving messages from user wallets, processes can also forward messages from other processes through the messenger unit;

  • 从存储过去到计算未来:AO超并行计算机

    Message: Each interaction between a user (or other process) and the process is represented by a message. The message must conform to Arweaves native ANS-104 data items to maintain a consistent native structure and facilitate Arweaves storage of information. From a more understandable perspective, the message is somewhat similar to the transaction ID (TX ID) in the traditional blockchain, but the two are not exactly the same;

从存储过去到计算未来:AO超并行计算机

  • Messenger Unit (MU): The MU relays messages through a process called cranking and is responsible for the delivery of communications in the system to ensure seamless interaction. Once a message is sent, the MU routes it to the appropriate destination (SU) within the network, coordinating the interaction and recursively processing any resulting outbox messages. This process continues until all messages have been processed. In addition to message relay, MU provides a variety of functions, including managing process subscriptions and handling scheduled cron interactions;

  • Scheduler Unit (SU): When a message is received, the SU initiates a series of critical operations to maintain the continuity and integrity of the process. Upon receipt of a message, SU assigns a unique increment nonce to ensure ordering relative to other messages in the same process. This allocation process is formalized through cryptographic signatures, guaranteeing authenticity and sequence integrity. To further improve the reliability of the process, SU uploads signature assignments and messages into the Arweave data layer. This ensures message availability and immutability and prevents data tampering or loss;

  • Computing Unit (CU): CU competes with each other in a peer-to-peer computing market to complete the service of users and SU to resolve the computing process status. Once the state calculation is complete, the CU returns a signed certificate with the specific message result to the caller. In addition, CU can generate and publish signed state certificates that other nodes can load, of course this also requires paying a certain percentage of the fee.

从存储过去到计算未来:AO超并行计算机

Operating system AOS

AOS can be regarded as the operating system or terminal tool in the AO protocol, which can be used to download, run and manage threads. It provides an environment in which developers can develop, deploy and run applications. On AOS, developers can use the AO protocol to develop and deploy applications and interact with the AO network.

Run logic

Actor Model advocates a philosophical view called everything is an actor. All components and entities within this model can be regarded as actors. Each actor has its own state, behavior and mailbox. They communicate and collaborate through asynchronous communication, allowing the entire system to operate in a distributed manner. and organize and run in a concurrent manner. The same is true for the operating logic of the AO network. Components and even users can be abstracted as actors and communicate with each other through the message passing layer, so that processes are linked to each other. A distributed work system that can be calculated in parallel and has no shared state is intertwined. was established.

从存储过去到计算未来:AO超并行计算机

The following is a brief description of the steps in the information transfer flow chart:

1. Initiation of message:

  • Users or processes create messages to send requests to other processes.

  • The MU (Messenger Unit) receives the message and sends it to other services using a POST request.

2. Message processing and forwarding:

  • The MU handles the POST request and forwards the message to the SU (Scheduling Unit).

  • SU interacts with the Arweave storage or data layer to store messages.

3. Retrieve results based on message ID:

  • CU (Compute) receives the GET request, retrieves the results based on the message ID, and evaluates the message on the process. It can return results based on a single message identifier.

4. Retrieve information:

  • SU receives a GET request and retrieves message information based on the given time range and process ID.

5. Push outbox messages:

  • The final step is to push all outbox messages.

  • This step involves checking the message and generation in the result object.

  • Depending on the results of this check, steps 2, 3, and 4 can be repeated for each relevant message or build.

What has changed with AO? 1

Differences from common networks:

  • Parallel processing capabilities: Unlike networks such as Ethereum, where the base layer and each Rollup actually run as a single process, AO supports any number of processes running in parallel while ensuring that the verifiability of calculations remains intact. Furthermore, these networks operate in a globally synchronized state, while the AO processes maintain their own independent state. This independence enables the AO process to handle higher numbers of interactions and computational scalability, making it particularly suitable for applications that require high performance and reliability;

  • Verifiable reproducibility: While some decentralized networks, such as Akash and the peer-to-peer system Urbit, do provide large-scale computing power, unlike AO, they do not provide verifiable reproducibility of interactions, or rely on Non-persistent storage solution to save their interaction logs.

The differences between AOs node network and traditional computing environments:

  • Compatibility: AO supports various forms of threads, whether based on WASM or EVM, and can be connected to AO through certain technical means.

  • Content co-creation projects: AO also supports content co-creation projects. You can publish atomic NFT on AO, upload data and combine it with UDL to build NFT on AO.

  • Data composition: NFT on AR and AO can achieve data composition, allowing an article or content to be shared and displayed on multiple platforms while maintaining the consistency and original attributes of the data source. When content is updated, the AO network can broadcast these update statuses to all relevant platforms to ensure synchronization of content and dissemination of the latest status.

  • Value feedback and ownership: Content creators can sell their works as NFTs and transfer ownership information through the AO network to realize value feedback for the content.

Support for the project:

  • Built on Arweave: AO leverages features of Arweave that eliminate vulnerabilities associated with centralized providers such as single points of failure, data leakage, and censorship. Computations on AO are transparent and verifiable through decentralized trust-minimizing properties and reproducible message logs stored on Arweave;

  • Decentralized Foundation: AO’s decentralized foundation helps overcome scalability limitations imposed by physical infrastructure. Anyone can easily create an AO process from their terminal, with no need for specialized knowledge, tools or infrastructure, ensuring that even individuals and small-scale entities can have global reach and engagement.

Verifiable questions for AO

After we understand the framework and logic of AO, there is usually a common question. AO does not seem to have the global characteristics of traditional decentralized protocols or chains. Can it achieve verifiability and decentralization just by uploading some data to Arweave? ? In fact, this is the secret of AO design. AO itself is an off-chain implementation and does not solve the issue of verifiability or change the consensus. The AR teams idea is to separate the functions of AO and Arweave and then connect them in a modular manner. AO only performs communication and calculation, and Arweave only provides storage and verification. The relationship between the two is more like mapping. AO only needs to ensure that the interaction log is stored on Arweave, and its state can be projected to Arweave to create a hologram. This holographic state projection ensures the consistency and reliability of the output when calculating the state. sex, certainty. In addition, the AO process can be triggered in reverse to perform specific operations through the message log on Arweave (it can wake up on its own according to preset conditions and schedules, and perform corresponding dynamic operations).

从存储过去到计算未来:AO超并行计算机According to what Hill and Outprog shared, if the verification logic is simpler, then AO can be imagined as an inscription calculation framework based on a hyper-parallel indexer. We all know that to verify the inscription, the Bitcoin inscription indexer needs to extract JSON information from the inscription, record the balance information in the off-chain database, and complete the verification through a set of indexing rules. Although the indexer is verified off-chain, users can verify the inscription by changing multiple indexers or running the index themselves, so there is no need to worry about the indexer doing evil. We mentioned above that the data such as the sorting of messages and the holographic status of the process are uploaded to Arweave, so it only needs to be based on the SCP paradigm (storage consensus paradigm, which can be simply understood as SCP is the indexer of the index rules on the chain. In addition It is worth noting that SCP appeared much earlier than the indexer), and anyone can restore AO or any thread on AO through the holographic data on Arweave. Users do not need to run the whole node to verify the trusted status. Just like changing the index, users only need to make query requests to single or multiple CU nodes through SU. Arweave has high storage capacity and low cost, so under this logic, AO developers can implement a supercomputing layer that far exceeds the functions of Bitcoin inscriptions.

AO and ICP

Let’s use some keywords to summarize the features of AO: giant native hard disk, unlimited parallelism, unlimited computing, modular overall architecture, and holographic state processes. This all sounds very good, but friends who are familiar with various public chain projects in the blockchain may find that AO is particularly similar to a Death-level project, which is the once popular Internet Computer ICP.

ICP was once hailed as the last king-level project in the blockchain world. It was highly favored by top institutions and reached an FDV of US$200 billion during the 21 years of madness. But as the wave receded, ICP’s token value also plummeted. Until the 2023 bear market, the value of ICP tokens had dropped nearly 260 times compared to its historical high. However, if the performance of Token price is not considered, even if ICP is re-examined at this time, its technical characteristics still have many unique features. Many of the amazing advantages and features of AO today were also possessed by ICP back then. So will AO fail like ICP? Let’s first understand why the two are so similar. ICP and AO are both designed based on the Actor Model and focus on locally running blockchains, so the characteristics of the two have many similarities. The ICP subnet blockchain is formed by a number of independently owned and controlled high-performance hardware devices (node ​​machines) that run the Internet Computer Protocol (ICP). The Internet Computer Protocol is implemented by a number of software components, which as a bundle are replicas in that they replicate state and computation across all nodes in a subnet blockchain.

ICPs replication architecture can be divided into four layers from top to bottom:

Peer-to-Peer (P2P) Network Layer: Used to collect and advertise messages from users, other nodes in their subnet blockchain, and other subnet blockchains. Messages received by the peer layer are replicated to all nodes in the subnet to ensure security, reliability and resiliency;

Consensus layer: Selects and orders messages received from users and different subnets to create blockchain blocks that can be notarized and finalized through a Byzantine fault-tolerant consensus that forms the evolving blockchain. These finalized chunks are passed to the message routing layer;

Message routing layer: used to route user- and system-generated messages between subnets, manage the Dapp’s input and output queues, and schedule message execution;

Execution Environment Layer: Computes the deterministic computations involved in executing smart contracts by processing messages received from the message routing layer.

从存储过去到计算未来:AO超并行计算机

subnet blockchain

A so-called subnet is a collection of interacting replicas running separate instances of the consensus mechanism in order to create its own blockchain on which a set of containers can run. Each subnet can communicate with other subnets and is controlled by the root subnet, which uses chain key cryptography to delegate its permissions to individual subnets. ICP uses subnets to allow it to scale infinitely. The problem with traditional blockchains (and individual subnets) is that they are limited by the computing power of a single node machine, since each node must run everything that happens on the blockchain in order to participate in the consensus algorithm. Running multiple independent subnets in parallel allows ICP to overcome this single-machine barrier.

why failed

As mentioned above, the purpose that the ICP architecture wants to achieve is simply a decentralized cloud server. This idea was as shocking as AO a few years ago, but why did it fail? To put it simply, it means that if you don’t succeed at the high level, you won’t settle at the low level. You haven’t found a good balance between Web3 and your own ideas, which ultimately leads to the embarrassing situation that the project is neither Web3 nor as easy to use as the centralized cloud. In summary, there are three problems. point. First, ICPs program system Canister, the container mentioned above, is actually somewhat similar to AOS and processes in AO, but they are not the same. The ICP program is implemented by Canister encapsulation and is not visible to the outside world. Data needs to be accessed through a specific interface. Asynchronous communication is very unfriendly to contract calls in DeFi protocols, so in DeFi Summer, ICP did not capture the corresponding financial value.

从存储过去到计算未来:AO超并行计算机The second point is that the hardware requirements are extremely high, resulting in the project not being decentralized. The picture below is the minimum hardware configuration diagram of the node given by ICP at that time. Even now, it is very exaggerated, far exceeding the configuration of Solana, and even the storage requirements are higher than the storage requirements. The public chain is still high.

从存储过去到计算未来:AO超并行计算机

The third point is the lack of ecology. Even now, ICP is still a very high-performance public chain. If there are no DeFi applications, what about other applications? Sorry, ICP has not produced a killer application since its inception. Its ecosystem has neither captured Web2 users nor Web3 users. After all, with so little decentralization, why not just use rich and mature centralized applications? But in the end, it is undeniable that ICP’s technology is still top-notch, and its advantages of reverse gas, high compatibility, and unlimited expansion are still necessary to attract the next billion users. Under the current AI wave, if ICP can be good at It may be possible to turn over using its own structural advantages.

So back to the question above, will AO fail like ICP? I personally think that AO will not repeat the same mistakes. The last two points that led to the failure of ICP in the first place are not problems for AO. Arweave already has a good ecological foundation. Holographic state projection also solves the centralization problem. In terms of compatibility, AO Also more flexible. More challenges may focus on the design of the economic model, support for DeFi, and a century-old problem: In the non-financial and storage fields, what form should Web3 take?

Web3 shouldn’t stop at narrative

The word that appears most frequently in the Web3 world must be narrative, and we have even become accustomed to using narrative perspectives to measure the value of most tokens. This naturally stems from the dilemma that most Web3 projects have great vision but are very embarrassing to use. In comparison, Arweave already has many fully implemented applications, and they all target Web2-level experience. For example, Mirror and ArDrive. If you have used these projects, it will be difficult to feel the difference from traditional applications. However, Arweave still has great limitations in value capture as a storage public chain, and calculation may be the only way to go. Especially in todays external world, AI has become a general trend. There are still many natural barriers to the integration of Web3 at this stage, which we have also talked about in past articles. Now Arweaves AO uses a non-Ethereum modular solution architecture, giving Web3 x AI a good new infrastructure. From the Library of Alexandria to ultra-parallel computers, Arweave is following a paradigm of its own.

Reference article

  1. AO Quick Start: Introduction to Super Parallel Computers:https://medium.com/@permadao/ao-Quick Start-Introduction to Super Parallel Computers-088 ebe 90 e 12 f

  2. X Space Activity Record | Is AO an Ethereum killer? How will it promote the new narrative of blockchain? :https://medium.com/@permadao/x-space-Activity Record-ao-Is it an Ethereum killer-How will it promote the new narrative of blockchain-bea 5 a 2 2d 46 2c

  3. ICP White Paper:https://internetcomputer.org/docs/current/concepts/subnet-types

  4. AO CookBook:https://cookbook_ao.arweave.dev/concepts/tour.html

  5. AO — a super-parallel computer you can’t even imagine:https://medium.com/@permadao/ao-Hyperparallel computers you can’t imagine-1949 f 5 ef 038 f

  6. Analyze the reasons for the decline of ICP from multiple angles: unique technology and thin ecosystem:https://www.chaincatcher.com/article/2098499

Original article, author:YBB Capital。Reprint/Content Collaboration/For Reporting, Please Contact report@odaily.email;Illegal reprinting must be punished by law.

ODAILY reminds readers to establish correct monetary and investment concepts, rationally view blockchain, and effectively improve risk awareness; We can actively report and report any illegal or criminal clues discovered to relevant departments.

Recommended Reading
Editor’s Picks