Software Engineer III - LLM
JPMorganChase
We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. Serve as an emerging member of an agile team to design and deliver market-leading technology products in a secure and scalable way.
Join an agile Corporate Technology team at JPMorganChase to design AI‑enabled platforms with modern Python services on AWS, integrating LLMs and agentic patterns to solve real enterprise problems. Work with advanced technologies, ship to production at scale, and drive resiliency and security across mission‑critical systems.
As a Software Engineer III with JPMorganChase within the Corporate Sector – AIML Data Platforms LLM Team, you will play a crucial role in the LLM Suite, tackling some of the most pressing challenges in the financial services sector to create meaningful impact for the organization. Your responsibilities will include transforming early-stage code into production-ready solutions and contributing to the continuous improvement of our technology platforms.
Job Job Responsibilities
Designs, develops, and troubleshoots software solutions with a creative mindset, going beyond conventional approaches to solve complex technical challenges
Writes secure, high-quality production code and maintain algorithms that integrate seamlessly with existing systems
Creates architecture and design artifacts for complex applications, ensuring all design constraints are met throughout the development process
Analyzes and synthesize large, diverse data sets to develop visualizations and reports that drive continuous improvement of applications and systems
Builds innovative AI/ML solutions and agentic systems for the LLM Suite platform using public cloud architecture (Azure, AWS) and modern AI Agentic frameworks
Implements cutting-edge GenAI services leveraging Azure OpenAI models and AWS Bedrock
Identifies hidden problems and patterns in data proactively, using insights to improve coding standards and system architecture
Participates in software engineering communities of practice and events focused on emerging technologies
Fosters a team culture built on opportunity, collaboration, and respect
Required Qualifications, Capabilities and Skills
Formal training or certification in software engineering concepts with 3+ years of applied experience
Hands-on experience in system design, application development, testing, and operational stability
Proficiency in Python (FastAPI), Microservices, APIs, LLMs, and AWS services (EC2, ECS, EKS, Lambda, SQS, SNS, RDS Aurora MySQL & Postgres, DynamoDB, EMR, Kinesis)
Experience developing, debugging, and maintaining code in a large corporate environment using modern programming and database querying languages
Strong understanding of the Software Development Life Cycle
Solid grasp of agile methodologies including CI/CD, Application Resiliency, and Security
Knowledge of cloud, AI, ML, and mobile technologies. Experience with agent-to-agent communication, Model Context Protocol (MCP), AI skills, personal AI assistants, agentic orchestrators, AI coding assistants (e.g., GitHub Copilot), and spec-driven frameworks (Speckit, BMAD)
Preferred Qualifications, Capabilities and Skills
Familiarity with modern front-end technologies
Exposure to cloud technologies
Background in machine learning, deep learning, and neural networks
Experience with state-of-the-art GenAI services leveraging Azure OpenAI models and AWS Bedrock
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.
Build GenAI agentic solutions with Python and AWS on JPMorgan's LLM Suite team, driving AI innovation in financial services