Seconded. In my entire North Carolina + Georgia upbringing, with frequent visits to Tennessee and back to NC, and some visits to South Carolina, Florida, and Alabama...never once have I heard y'all referring to a single person.

It's literally a contraction for "you all". That doesn't make sense for talking to one person.