Gen AI Workflow Designer, Env/dmp

Gen AI Workflow Designer

The Technology department at Brahma DNEG-Dedicated Unit (BrahmA DDU) is responsible for creating and supporting the technology and infrastructure that powers DNEG's multi-site, global VFX and Feature Animation studio. With thousands of artists producing tens of thousands of shots across film, TV, and immersive experiences, we face complex scaling and workflow challenges.

Gen AI workflow designers are experts in creating efficient, functional workflows for deploying audiovisual Generative AI models. With ComfyUI as their primary platform, they stay on the cutting edge of the open and closed source Gen AI landscape - identifying and integrating the latest tools and technologies. They are responsible for developing new workflows, finessing them and keeping existing ones aligned with the state of the art.

This team works with creative teams by building templatable workflows tailored to their specific needs, then collaborating with the ML Technology team to transition those into scalable, cross-platform solutions. A key part of the role is also using the developed workflows in Production when direct support on shows is required.

Key Responsibilities

• Design and maintain efficient, functional workflows for deploying audiovisual GenAI models, primarily using ComfyUI.
• Collaborate with GenAI and research teams to develop, evaluate, and refine workflow templates with state-of-the-art tools and technologies.
• Collaborate with creative multi disciplinary teams to transition templatable, tailored workflows into scalable solutions.
• Collaborate with GenAI show team to deliver shots in active Production when needed.
• Work alongside Gen AI pipeline team to maintain and develop our custom ComfyUI environment.
• Create structured training documentation describing the workflows so they can be adopted by creative teams.

Must Haves

• Advanced ComfyUI user - Expertise in ComfyUI. As this will initially be the main workflow development platform, the candidate must be very comfortable and experienced creating custom workflows, nodes and pipelines.
• Background in Digital Matte Painting:
• Thorough knowledge of advanced matte painting techniques including color space, digital paint techniques and Photoshop file management
• Technical proficiency in photography with an emphasis on composition, depth, lighting and color
• Working knowledge of the basic principles of 3D Environment projection and integration
• Proven experience at effectively implementing existing tools and techniques into wider custom pipelines.
• Quick to understand, evaluate and present other potential model deployment platforms to the team, while assisting in developing in house alternatives.
• Ability to communicate both with Creative and Technical teams (developers).
• Professional experience testing photoreal generative models, ideally with a focus on video applications.
• Deep engagement and awareness of the Gen AI communities and offerings, across both open and closed-source spaces.

Nice to Have

• Prior role in a pipeline or RnD-focused environment.
• Ability to read and understand Python.

To apply:

• Provide a reel or portfolio showcasing your advanced use of ComfyUI, using custom workflows, nodes and/or pipeline.
• In a few sentences, include a written presentation of how you've worked with ComfyUI to build solutions or solve creative and technical problems.

Please note that this is a unionized position and will be covered by a collective agreement between DNEG and IATSE, in the coming months. As a unionized employee, you will be required to join the union and will benefit from the conditions set out in the collective agreement. Union dues will be required once the collective agreement is in place. The base salary range for this full-time position is $120,000 CAD to $135,000 CAD. DNEG salary ranges are determined by function, department, level, and location. An individual's pay within a given range is determined by their transferrable or job-related skills and work experience. Salary ranges are modified from time to time based on external market data collected through our third-party surveys.