In common case - rtorrent got from tracker some junk instead peer list. For example, html page with message "I'm too busy" or "Access denied".Tracker can't parse the bencoded data (or in other words, tracker can't read or veirfy your torrent data)