> ## Documentation Index
> Fetch the complete documentation index at: https://docs.kamu.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Learning Materials

> Explainer videos, talks, publications and other learning materials

export const Diagram = ({src, alt}) => {
  return <div style={{
    display: "flex",
    "flex-direction": "column",
    "align-items": "center"
  }}>
    <img src={src} alt={alt} style={{
    background: "#dddddd",
    "margin-bottom": 0
  }} />
    <span>{alt}</span>
  </div>;
};

export const YouTubeList = ({id}) => {
  const src = `https://www.youtube.com/embed/videoseries?list=${id}`;
  return <iframe className="w-full aspect-video rounded-xl" src={src} allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowFullScreen></iframe>;
};

export const YouTube = ({id, width}) => {
  const src = `https://www.youtube.com/embed/${id}`;
  return <iframe className="w-full aspect-video rounded-xl" src={src} allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowFullScreen width={width}></iframe>;
};

export const Schema = ({t, id}) => {
  const anchor = id ? id : t.toLowerCase().replace(/\s+/g, "-");
  const link = `/odf/schemas#${anchor}`;
  return <a class="schema-object" href={link}>{t}</a>;
};

export const Term = ({t, id}) => {
  const anchor = id ? id : t.toLowerCase().replace(/\s+/g, "-");
  const link = `/general/glossary#${anchor}`;
  return <a class="glossary-term" href={link}>{t}</a>;
};

## Explainer Videos

| Name                                                                                                                              |   Level  | Description                                                                          |
| --------------------------------------------------------------------------------------------------------------------------------- | :------: | ------------------------------------------------------------------------------------ |
| [Kamu 101: Basics](https://www.youtube.com/watch?v=oUTiWW6W78A\&list=PLV91cS45lwVG20Hicztbv7hsjN6x69MJk)                          | Beginner | Quick overview of the purpose and basic features of the tool                         |
| [Kamu 101: Trust & Collaboration](https://www.youtube.com/watch?v=hN_vpHYmwi0\&list=PLV91cS45lwVG20Hicztbv7hsjN6x69MJk\&index=2)  | Beginner | Theory of what makes data trustworthy and how to verify datasets you get from others |
| [Verifiable Multi-Party Analytics](https://www.youtube.com/watch?v=M7DyV-QUZbk\&list=PLV91cS45lwVG20Hicztbv7hsjN6x69MJk\&index=3) | Advanced | Demonstrates how to verifiably query IoT data from smart contracts                   |

## Talks

| Name                                                                                                                                                           |     Level    | Description                                                                                                 |
| -------------------------------------------------------------------------------------------------------------------------------------------------------------- | :----------: | ----------------------------------------------------------------------------------------------------------- |
| [Time: The most misunderstood dimension in data modelling](https://www.youtube.com/watch?v=XxKnTusccUM)                                                        |   Beginner   | Educational talk from **PyData Global 2021** about event-based data models and stream processing            |
| [Structured Data in Web3 - Rethinking Databases](https://www.youtube.com/watch?v=ZQ-MdKj3BjU\&list=PL_1oLZF_wrbTeLmaYWadPmKCCxjF9zGt0)                         | Intermediate | **Protocol Labs: Compute Over Data Summit 2022** talk about structured data processing in Web3 world        |
| [Supercharging SQL: Global Data Supply Chains for Verifiable AI & Analytics](https://www.youtube.com/watch?v=c9UCjJdvJAU)                                      | Intermediate | **Filecoin Dev Summit 2024** talk about how bringing Web3 properties to stream processing impacts AI        |
| [Oracle-Augmented Generation: Connecting AI to Verifiable Data](https://www.youtube.com/watch?v=RuQQNAgfOlY)                                                   | Intermediate | Proposes a new RAG-inspired method for data-centric AI agents                                               |
| [From Scientific Data Publishing to Collaborative Data Economy](https://www.youtube.com/watch?v=d-Nha1sO0tM)                                                   |   Beginner   | Talk from **DeSci Berlin 2025** about making scientific data exchange sustainable and more collaborative    |
| [Open Data Fabric for Research Data Management](https://www.youtube.com/watch?v=Ivh-YDDmRf8)                                                                   |   Beginner   | Current state and problems of scientific data portals, motivation behind ODF and system's design principles |
| [Building a Distributed Collaborative Data Pipeline](https://databricks.com/session_eu20/building-a-distributed-collaborative-data-pipeline-with-apache-spark) | Intermediate | Technical talk from **Data+AI Summit 2020**                                                                 |

## Publications

| Name                                                                                                                                              | Level        | Description                                                                     |
| ------------------------------------------------------------------------------------------------------------------------------------------------- | ------------ | ------------------------------------------------------------------------------- |
| [Kamu Blog: Introducing Open Data Fabric](https://www.kamu.dev/blog/introducing-odf/)                                                             | Beginner     | Initial announcement of the ODF project                                         |
| [Whitepaper: Open Data Fabric](https://arxiv.org/abs/2111.06364)                                                                                  | Beginner     | Original ODF protocol whitepaper                                                |
| [Kamu Blog: The End of Batch Era](https://www.kamu.dev/blog/end-of-batch-era/)                                                                    | Beginner     | Why we are using stream processing instead of batch                             |
| [Course: Introduction to Multi-Party Data Engineering](https://www.kamu.dev/blog/2024-08-28-intro-to-web3-data-engineering/)                      | Beginner     | How Web3 innovations can be applied to conventional data lakehouse architecture |
| [Next Decade of Data: From algebra to calculus, from silos to real-time supply chains](https://www.kamu.dev/blog/2024-06-27-next-decade-of-data/) | Intermediate | Analysis of the state of the data market and future predictions                 |
| [Open Data Fabric protocol specification](/odf/spec)                                                                                              | Advanced     | Specification itself, for tech-savvy readers                                    |

## External Resources

| Name                                                                                                                         | Level    | Description                                                              |
| ---------------------------------------------------------------------------------------------------------------------------- | -------- | ------------------------------------------------------------------------ |
| [The World Beyond Batch: Streaming 101 by Tyler Akidau](https://www.oreilly.com/radar/the-world-beyond-batch-streaming-101/) | Beginner | Fundamental ideas behind stream (temporal) processing                    |
| [Foundations of streaming SQL by Tyler Akidau](https://youtu.be/UlPsp7LaA38?si=lZyAVZ6Gew5Mr-wl)                             | Beginner | A great visual way to develop intuition in streaming and bitemporal data |

See also:

* [FAQ](/start/faq)
* [First Steps](/start/first-steps)
* [Examples](/examples)