Bytespider identifies with the user agent Bytespider. Unlike a search crawler, its purpose is gathering training data for ByteDance's AI models, so allowing it offers little visibility benefit in Western AI search.
Because it reportedly ignores robots.txt in some cases, owners who want to block it usually do so at the server or firewall level by matching the user agent, not in robots.txt alone.