You don't need the whole file. That would just be silly and it's used for streaming all the time. Also even though I would prefer to see an open standard succeed, the mp4 container does have a lot more support while mkv doesn't have any advantages for this type of use.