data build tool materialization: Part II

We looked at tables and view. The other ones are incremental and ephemeral.

Incremental loads implement a very elegant solution. during the first run, the table is populated in the data store. any subsequent runs from that point on, only the new rows will be inserted, existing rows that needs any changes will be changed accordingly and identical rows will stay the same. So if the inserts and updates are relatively low in numbers, then this could be a good strategy.

Ephemeral can be likened to temp tables in the data stores. They are created during run time and they exist only during the build session. Ephemeral does not appear to write data into the data store.

Leave a comment