Yes, that's the approach that I'm taking with the library, but with a simple execution flow.
One of the things that used to bite me a lot with Pandas was having to manually free memory from intermediate dataframes that I would create. I'm expecting Rust to work better in this case, because when executing a 3-step pipeline, step 2 consumes the output from step 1, and the dataframe is freed from memory.
I'll write an experiment on this in the coming weeks/months, to see if my assumption would work.
I'll write an experiment on this in the coming weeks/months, to see if my assumption would work.