Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yes, that's the approach that I'm taking with the library, but with a simple execution flow. One of the things that used to bite me a lot with Pandas was having to manually free memory from intermediate dataframes that I would create. I'm expecting Rust to work better in this case, because when executing a 3-step pipeline, step 2 consumes the output from step 1, and the dataframe is freed from memory.

I'll write an experiment on this in the coming weeks/months, to see if my assumption would work.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: