Engineering Manager, Generative AI Engineering

Success in this role requires the ability to set direction while remaining close to implementation details. The Engineering Manager will define goals, prioritize work, reduce unnecessary rework, and ensure the team’s roadmap aligns with the broader Developer Experience and Generative AI strategy. They will use metrics to assess adoption, usage, quality, reliability, and business value, continuously improving the team’s impact over time.

A strong understanding of current trends in developer productivity, platform engineering, and enterprise Generative AI is essential, along with the ability to translate that understanding into a clear and motivating vision for the team.

This position reports to the Head of Developer Experience and Generative AI. The Engineering Manager will work closely with them to shape strategy, guide execution, and help the team deliver safe, reliable, and useful AI capabilities at enterprise scale.

RESPONSIBILITIES

• Define and lead the technical direction for enterprise Generative AI platform capabilities within Developer Productivity
• Manage and guide the Generative AI Engineering team, working closely with the Head of Developer Experience and Generative AI, engineers, product partners, security teams, identity teams, and internal stakeholders
• Break down ambiguous, high-level problems into clear technical plans, milestones, and deliverables that the team can execute
• Own delivery of team commitments, including prioritization, planning, dependency management, progress tracking, and communication of risks or trade-offs
• Lead the team in building secure, reliable, observable, and maintainable AI platform services, including integrations with AI gateways, LLM providers, identity systems, developer tools, and enterprise systems
• Define and track metrics for adoption, usage, quality, reliability, cost, and business value of the team’s capabilities
• Support organizational health through goal setting, regular feedback, progress monitoring, coaching, and growth of team members
• Manage technical debt and architectural consistency to support long-term maintainability and sustainable delivery
• Stay close to the team’s technical work by contributing to design discussions, reviewing technical proposals, and occasionally contributing directly to implementation when appropriate
• Identify and address technical challenges, delivery risks, operational issues, and cross-team blockers
• Improve engineering excellence across the team by encouraging strong practices for automated testing, CI/CD, code review, observability, documentation, security, and maintainable software design

MINIMUM QUALIFICATIONS

• B.S. or M.S. in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience
• 7+ years of professional software engineering experience, including 3+ years managing or leading a technical team
• Experience leading delivery of complex software platforms, developer tools, infrastructure systems, or enterprise internal tools
• Experience managing engineers through planning, execution, feedback, coaching, performance management, and technical decision-making
• Experience with CI/CD, test automation, infrastructure as code, cloud infrastructure, containers, and production deployment workflows
• Experience building or operating production systems that use LLM APIs, model providers, or Generative AI capabilities
• Understanding of production concerns for GenAI systems, including security, access control, observability, cost management, evaluation, reliability, and data protection
• Experience working with cross-functional stakeholders such as product, security, identity, platform engineering, and internal customer teams
• Strong engineering fundamentals, including system design, software architecture, operational excellence, incident response, and maintainable software design
• Ability to communicate clearly in English, including explaining technical trade-offs, risks, and priorities to both technical and non-technical stakeholders

NICE TO HAVES

• Experience with AI gateway or LLM proxy technologies such as Envoy AI Gateway, Kong AI Gateway, LiteLLM Proxy, OpenAI-compatible gateways, or equivalent systems
• Experience with Model Context Protocol, MCP servers or clients, enterprise authorization patterns, or tool permission models
• Experience leading platform engineering, developer tools, internal tools, or enterprise self-service platform teams
• Experience with enterprise identity, access management, policy enforcement, audit logging, identity-aware proxies, API gateways, or zero-trust architecture
• Experience with production GenAI patterns such as retrieval-augmented generation, agentic workflows, tool use, or LLM evaluation frameworks
• Ability to communicate in Japanese

=========================================================================
Important Points
・All interviews will be arranged via Google Meet, unless otherwise stated.
・The same job descriptions are available in both English and Japanese; therefore, we kindly ask that you apply to only one version.
・We kindly request that you submit your resume in English, if possible. However, Japanese resumes are also acceptable. Please note that, depending on the English proficiency requirements of the role, we may request an English version of your resume later in the process.

WHAT WE OFFER
・Competitive Salary - Based on experience
・Work Hours - Flexible working time
・Paid Holiday - 20 days per year (prorated)
・Sick Leave - 6 days per year (prorated)
・Holiday - Sat & Sun, Japanese National Holidays, and other days defined by our company
・Japanese Social Insurance - Health Insurance, Pension, Workers’ Comp, and Unemployment Insurance, Long-term care insurance
・Housing Allowance
・Retirement Benefits
・Rental Cars Support
・In-house Training Program (software study/language study)

Our Commitment
・We are an equal opportunity employer and value diversity.
・Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.