Senior Machine Learning Engineer, Model Serving Infrastructure (Multiple Positions)

About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us. About the Team Our team plays a crucial role in ensuring the company’s success. We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems - you’ll be part of a team that’s developing new solutions to new challenges. It’s working fast, at scale, and we’re making a difference. We are looking for talents to join us on this exciting journey! Responsibilities Design and implement distributed inference infrastructure for feeds, ads, and search ranking models. Build monitoring/managing tools to oversee the reliability and scalability of online inference servers. Triage system inefficiency and bottlenecks improving system performance. Build tools to analyze bottlenecks and sources of instability and design and implement solutions. Research and design Machine Learning (ML) models to optimize systems, features, algorithms, and product strategies. Collaborate with key stakeholders and cross-functional teams to define product strategy and features, and to assist in defining products and driving initiatives from a ML engineering viewpoint. Mentor junior Machine Learning Engineers and interns.