Senior LLM Scientist

We are currently partnering with a fast-growing AI & Data consulting company in Japan that is actively expanding its Generative AI and Large Language Model (LLM) division and is now looking for both LLM Scientists and Senior LLM Scientists.

*Please note that prior financial industry experience is NOT required.

*For foreign candidates, a valid Japanese work visa and at least JLPT N2-level Japanese (or equivalent business Japanese communication skills) are required to apply.

Position Levels

• Junior / Mid-Level: ¥6M – ¥10M JPY

• Senior Level: ¥10M – ¥25M JPY

The company works directly with major enterprise clients in Japan on cutting-edge AI transformation initiatives involving Generative AI, LLM applications, AI governance, intelligent automation, and next-generation enterprise AI ecosystems.

These positions offer the opportunity to work on real-world Generative AI implementation projects, including Retrieval-Augmented Generation (RAG), AI Agents, enterprise knowledge systems, AI-powered business process transformation, LLM evaluation frameworks, and production-grade AI applications.

The environment is highly collaborative and technology-driven, combining hands-on development, advanced AI implementation, and business-oriented consulting engagements.

Why Apply?

• Work on real-world LLM, RAG, and AI Agent projects

• Join a rapidly growing AI company with excellent career growth opportunities

• International and open-minded work environment

• English-friendly culture with multicultural teams

• Full flex-time and hybrid work style

• Direct exposure to large-scale enterprise AI initiatives

Key Responsibilities

• Design, develop, and evaluate enterprise-grade applications utilizing Large Language Models (LLMs)

• Develop and optimize prompts, workflows, and inference strategies for Generative AI solutions

• Build and support Retrieval-Augmented Generation (RAG) systems and AI Agent-based applications

• Participate in Generative AI proof-of-concepts (PoCs), implementation projects, and production deployments

• Collaborate with AI consultants, data scientists, and data engineers to translate business requirements into AI solutions

• Conduct technical validation, benchmarking, and evaluation of LLM-based systems

• Support AI governance, guardrails, model safety, and responsible AI initiatives

• Contribute to internal AI frameworks, reusable assets, and next-generation Generative AI capabilities

• Participate in enterprise AI transformation projects across multiple business domains

Examples of projects include:

• Enterprise knowledge search and RAG implementation initiatives

• Local/private LLM deployment and operational efficiency projects

• AI governance and guardrail validation initiatives

• Business process transformation through Generative AI and intelligent automation

• Legacy system modernization supported by Generative AI technologies

• AI Agent development and orchestration frameworks

• LLM evaluation and optimization projects

Interview Process: Only 2 Interviews Without Tests.

Required:

• Bachelor's degree or equivalent academic background in Computer Science, Machine Learning, Data Science, Mathematics, Statistics, Engineering, or related fields

• Approximately 1+ years of professional experience in AI, data science, machine learning, or related technical fields

• Experience developing applications utilizing Large Language Models (LLMs) through commercial cloud AI services or equivalent platforms

• Experience with prompt engineering, LLM integration, or Generative AI application development

• Business-level Japanese (JLPT N2 or equivalent)

• Living in Kanto Area

• If possible, English Skills but is not a must.

Compensation & Benefits:

• Annual salary: ¥6M – ¥25M JPY

• Location: Nihonbashi, Chuo-ku, Tokyo

• Hybrid work style available (office + remote work combination)

• Full flex-time system (no core time)

• Standard working hours: 8 hours/day

Benefits:

• Defined contribution pension plan

• Learning & self-development support

• Internal/external networking support budget

• Sports & wellness allowance

• Full annual health check support

• Full influenza vaccination support including dependents

• Full transportation reimbursement

• Relocation support (eligible employees)

• Childcare/babysitter support

• Business trip & training allowances

• Marriage / childbirth / condolence support system

Insurance:

• Health insurance

• Employee pension

• Employment insurance

• Workers’ compensation insurance

Additional Information:

• Flexible internal role mobility and career growth opportunities

This is an excellent opportunity for someone who wants to work at the intersection of enterprise AI, large-scale data architecture, and real business transformation within Japan’s financial industry