Sadly this is true, even among software engineers and highly qualified people. You can still get a job without speaking Hungarian, and you'll be able to get through mandatory work stuff, but it may be uncomfortable during casual conversations. People often feel uneasy speaking English so they tend to switch to Hungarian if only one or two English speakers are in the group.
But if you can find a good community, then it may work out really well. Budapest is really affordable and SE salaries are very high compared to the average cost of living.