Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yea, that's exactly what Delta Lake does. All the table metadata is stored in a Parquet file (it's initially stored in JSON files, but eventually compacted into Parquet files). These tables are sometimes so huge that the table metadata is big data also.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: