))
41: Trino puts on its Hudi
Manage episode 347235258 series 2796878
Το περιεχόμενο παρέχεται από το Brian Olsen and Trino Community. Όλο το περιεχόμενο podcast, συμπεριλαμβανομένων των επεισοδίων, των γραφικών και των περιγραφών podcast, μεταφορτώνεται και παρέχεται απευθείας από τον Brian Olsen and Trino Community ή τον συνεργάτη της πλατφόρμας podcast. Εάν πιστεύετε ότι κάποιος χρησιμοποιεί το έργο σας που προστατεύεται από πνευματικά δικαιώματα χωρίς την άδειά σας, μπορείτε να ακολουθήσετε τη διαδικασία που περιγράφεται εδώ https://el.player.fm/legal.
Trino's initial use case was around replacing the Apache Hive runtime. As data lakes grew into prominence, it became clear that having a faster query engine didn't solve all problems. The Hive model itself was a huge bottleneck and didn't provide features that companies needed akin to data warehouses and databases. Apache Hudi is a new table format created out of Uber that aims to address many of these issues and usher in a new generation of data lake.
Tune in as we speak to the Trino Hudi connector contributor Sagar Sumit and Grace Lu who uses Trino and Hudi at Robinhood to discuss the new Hudi connector and future plans!
- Intro Music: 0:00
- Intro: 0:32
- Releases: 14:43
- Concept of the episode: Intro to Hudi and the Hudi connector: 22:29
- Concept of the episode: Merge on read and copy on write tables: 28:28
- Concept of the episode: Hudi metadata table: 39:24
- Concept of the episode: Hudi data layout: 46:39
- Concept of the episode: Robinhood Trino and Hudi use cases: 51:12
- Concept of the episode: Current state and roadmap for the Hudi connector: 1:03:15
- Pull request of the episode: PR 14445: Fault-tolerant execution for PostgreSQL and MySQL connectors: 1:08:14
- Demo of the episode: Using the Hudi Connector: 1:13:34
Show Notes: https://trino.io/episodes/41.html
Show Page: https://trino.io/broadcast/
53 επεισόδια
Μοίρασέ το
