You can add your download folder to $daily_clean_tmps_dirs in /etc/periodic.conf and files not accessed for three days will automatically be deleted. See /etc/defaults/periodic.conf and /etc/periodic/daily/110.clean-tmps