Integration of Beacon chain data to Dune

Integration of Beacon chain data to Dune

Useful links:

About Dune

Dune is the leading platform for blockchain data, providing the tools to query, analyze, and visualize public blockchain data in stunning dashboards. With data from over 80 chains, 1.5M datasets, and a community of 500k+ active users, Dune makes blockchain data accessible and actionable.

While blockchains are inherently open and transparent, each chain’s unique structure makes data challenging to aggregate and analyze. Dune simplifies this by enabling cross-chain insights on tokens, wallets, and protocols. Share your work with the community, export data for custom use, and integrate it seamlessly into your applications—all on one platform.

Motivation

We propose to make a sub-set of Ethereum mainnet Beacon Chain data publicly available on Dune, including validator performance data with daily granularity and complementary tagging for Lido-related validators, modules, and node operators. This initiative, developed in collaboration with Lido DAO contributors, will empower Dune users with transparent insights into validator performance, fostering better analysis and collaboration within the Ethereum community.

Grant & Implementation Details

I) Integrate Beacon chain data into the Dune platform. The data will be sourced from a Lido-funded Beacon Chain dataset created and maintained by P2P.org as a part of their Lambda product. (more info about the dataset here).

Scope of the data integration:

  • Lido provides access to finalized tables as AVRO files in either S3 or GCS.

  • Dune will ingest and maintain 5 tables from this dataset and use it to index data from genesis block to head of the blockchain (if available at source)

    • t_validator_day_summaries
    • t_validators
    • t_deposits
    • t_operators (note: this is a complementary dataset for easy tagging of Lido-protocol related validators and their respective modules and node operators, it is not direct beacon chain data)
    • t_epoch_summaries
  • New data will be appended only and updated hourly to the tables after full indexing is complete (no row-level updates or deletes). Except for the t_validators table which will be deleted and recreated every time.

  • The data sets will be included in Dune’s official data catalog under the “Beacon Chain” namespace

  • Growing data storage is fully covered and included by Dune

  • Dune will allow additive table schema changes up to 5 times per year. Dune doesn’t support breaking changes (eg. existing columns changes)

  • Full table replacements can be requested on a case-by-case basis

  • S3 or GCS bucket must have “requester pays” disabled and be located in the EU

II) Collaborate with LEGO and key Lido DAO contributors to celebrate the integration of this essential dataset on Dune through co-marketing efforts at launch. Additionally, explore ongoing marketing opportunities throughout the partnership to promote the availability of Beacon Chain data on Dune.

In return for a grant of

  • Fee: 50k USDC (25k USDC per year)
  • ETH mainnet address: 0x32c8726Ab58b2C4ae5580C2669f8275420480C80 (a test transaction will be required)
  • Schedule: annually, 1st payment after grant approval, second payment in a one year time.
  • Effective Date: Dec 15, 2024
  • End Date: Dec 14, 2026
6 Likes

I have been wanting to make this a reality for a while and I’m happy to say that the LEGO council has approved this grant request to bring consensus layer data to Dune!

Super happy to be collaborating with the Dune and P2P teams to make this happen. I can’t wait to see the new and improved dashboards the community will come up with now that this data will be more easily retrievable on Dune.

4 Likes

This is awesome, really happy this is going live. I’m sure it will benefit the entire staking community.

1 Like