Required Research Scientist – Audiovisual Generation, Model Foundations
The role
Following the success of LTX-2, our widely adopted open-source text-to-audio+video model, we are expanding our efforts to develop cutting-edge audio+video generation models and are hiring Research Scientists to join our LTX-2 Core team.
Weve been at the forefront of innovation in text-to-image and text-to-audio+video generation, with LTX-2 driving our flagship product, LTX Studio, and gaining significant traction in the research and open-source communities, including integrations with platforms like ComfyUI and Diffusers.
This role focuses on pioneering model architecture and pre-training algorithms, shaping the next generation of our foundational generative AI models.
What you will be doing:
Pre-train and fine-tune video, audio, and image generative models to pursue state-of-the-art results.
Publish papers and open source models to benefit the research community and advance the field.
Design and implement machine learning models for text-to-audio and text-to-video generation.
Collaborate with data engineers to curate and preprocess text and video data.
Optimize models for high performance, ensuring efficient training and inference.
Build new controls and capabilities into generative text-to-audio and text-to-video models.
Stay updated with the latest developments in Generative AI, particularly in the fields of image, video, and audio.
Work closely with product teams to integrate AI models into applications and services.
Conduct experiments and prototype new concepts to advance the capabilities of our AI tools.
The role
Following the success of LTX-2, our widely adopted open-source text-to-audio+video model, we are expanding our efforts to develop cutting-edge audio+video generation models and are hiring Research Scientists to join our LTX-2 Core team.
Weve been at the forefront of innovation in text-to-image and text-to-audio+video generation, with LTX-2 driving our flagship product, LTX Studio, and gaining significant traction in the research and open-source communities, including integrations with platforms like ComfyUI and Diffusers.
This role focuses on pioneering model architecture and pre-training algorithms, shaping the next generation of our foundational generative AI models.
What you will be doing:
Pre-train and fine-tune video, audio, and image generative models to pursue state-of-the-art results.
Publish papers and open source models to benefit the research community and advance the field.
Design and implement machine learning models for text-to-audio and text-to-video generation.
Collaborate with data engineers to curate and preprocess text and video data.
Optimize models for high performance, ensuring efficient training and inference.
Build new controls and capabilities into generative text-to-audio and text-to-video models.
Stay updated with the latest developments in Generative AI, particularly in the fields of image, video, and audio.
Work closely with product teams to integrate AI models into applications and services.
Conduct experiments and prototype new concepts to advance the capabilities of our AI tools.
Requirements:
Track record of coming up with new ideas or improving upon existing ideas in generative AI, demonstrated by accomplishments such as first-author publications or projects.
Excellence in engineering as well as research with strong programming skills in Python, and deep familiarity with machine learning frameworks.
Experience in training large diffusion transformer models from scratch.
Proven track record of handling large-scale datasets to train neural networks effectively.
PhD or equivalent experience in the field of generative AI – a plus.
Track record of coming up with new ideas or improving upon existing ideas in generative AI, demonstrated by accomplishments such as first-author publications or projects.
Excellence in engineering as well as research with strong programming skills in Python, and deep familiarity with machine learning frameworks.
Experience in training large diffusion transformer models from scratch.
Proven track record of handling large-scale datasets to train neural networks effectively.
PhD or equivalent experience in the field of generative AI – a plus.
This position is open to all candidates.
