We've been seeing what the Databricks Photon engine can do for quite some time now, and it clearly makes a dramatic difference to certain types of query. But how does it actually work? What's the secret sauce that provides the acceleration that we see?

Earlier this year, Databricks released the Photon Whitepaper, digging into the depths of the engine and the design choices they made behind it. In this extra-long video, Simon walks through the photon whitepaper, discussing the design choices and attempting to explain the tech... warning: this is a long and nerdy video!

As always, we recommend you also read the whitepaper yourselves, it can be found here: [ Ссылка ]

свернуть