LLM-Based Knowledge Extraction and Failure Analysis Internship Job at Confidential, Princeton, NJ

OXM0UDhBYmlUWjJDNXJMWmZBTGVWQnRDdFE9PQ==
  • Confidential
  • Princeton, NJ

Job Description

LLM-Based Knowledge Extraction and Failure Analysis Internship

Here at Siemens, we take pride in enabling sustainable progress through technology. We do this through empowering customers by combining the real and digital worlds. Improving how we live, work, and move today and for the next generation! We know that the only way a business thrive is if our people are thriving. That’s why we always put our people first. Our global, diverse team would be happy to support you and challenge you to grow in new ways.

Siemens Research & Predevelopment (RPD) is the central R&D department of Siemens and thus has a key role to shape the future of our products. RPD acts as a strategic partner to support the executive units of Siemens. In consequence the main research focus is on future technologies for industry, infrastructure, mobility, and healthcare. In this context, we are looking for an Intern that supports our Software Systems and Processes team in Princeton, NJ by researching and developing scalable intelligent systems using LLMs and semantic technologies.

Transform the everyday with us!

Are you passionate about pushing the boundaries of AI and data science? We're looking for an innovative PhD intern to join our team and contribute to groundbreaking research focused on developing and improving knowledge graphs for advanced intelligent systems.

Modern industrial software systems generate large volumes of complex engineering signals, logs, test results, and failure information that are difficult to interpret consistently with traditional automation alone. In this internship, you will work on LLM-based knowledge extraction and failure classification workflows that transform technical inputs into structured, explainable JSON-based outputs. The focus is on prompt engineering, context engineering, model-output debugging, and iterative quality improvement—understanding why a model selected a particular failure class, which evidence influenced the result, where context was missing or misleading, and how to make the pipeline more accurate, transparent, and reliable for industrial use cases.

The internship provides a unique experience to contribute to innovative industrial applications while mentored by experienced professionals in an international setting.

This role is preferred to be on-site in Princeton, NJ, for a hands-on and collaborative experience, however remote candidates will be considered. The position is a full-time role for at least 3 months with the possibility of extension.

Key Responsibilities

  • Design, test, and refine prompts and context-selection strategies that help models classify failures, use relevant evidence, and produce consistent structured JSON outputs.
  • Analyze LLM output quality to understand why models choose incorrect failure classes, overlook important evidence, rely on misleading context, or generate inconsistent explanations.
  • Create evaluation examples, test cases, scoring rubrics, and error-analysis summaries to measure classification accuracy, evidence quality, explanation quality, and robustness.
  • Improve JSON schemas, validation checks, metadata fields, and intermediate representations used by downstream analysis and reporting workflows.
  • Prototype improvements to data preparation, retrieval or context assembly, prompt templates, output formatting, post-processing, and evaluation logic in Python-based AI pipelines.
  • Collaborate with software engineers, AI researchers, and domain experts to understand failure categories, edge cases, expected model behavior, and quality requirements.
  • Document experiments, observed failure modes, design decisions, evaluation results, and recommendations through internal demos, technical reports, and potential scientific publications.

Basic Qualifications

  • Currently enrolled in a Master’s or PhD program in Computer Science, Artificial Intelligence, Data Science, Knowledge Engineering, Information Science, or a closely related technical field.
  • 3+ years of foundational knowledge and research or project experience in Artificial Intelligence, Machine Learning, Generative AI, NLP, Data Engineering, or knowledge-based intelligent systems.
  • 3+ years of hands-on programming experience in Python, including experience with AI/ML libraries or frameworks such as PyTorch, TensorFlow, Hugging Face Transformers, scikit-learn, LangChain, LlamaIndex, or similar tools.
  • Hands-on experience with prompt engineering, context engineering, structured LLM outputs, or LLM-based information extraction and classification workflows.
  • Strong understanding of data modeling, structured outputs, metadata design, schema quality, validation concepts, and data quality principles.
  • Experience designing, implementing, or evaluating AI workflows that combine LLMs with structured context, retrieval, information extraction, classification, or rule-based validation.
  • Demonstrated ability to conduct independent research, critically analyze complex problems, work through ambiguity, and deliver structured technical outputs on defined timelines.
  • Strong written and verbal communication skills in English, with the ability to explain technical concepts clearly to both technical and domain-expert audiences.
  • The position requires the person to be in the United States of America and hold a valid work permit in the US for the duration of the internship.

Preferred Skills

  • Knowledge of transformer-based models, attention mechanisms, NLP/NLU methods, named entity recognition, relation extraction, question answering, or text classification.
  • Experience building reproducible data or AI pipelines, including data ingestion, validation, testing, documentation, and workflow orchestration with tools such as Apache Airflow, Prefect, Git, Docker, or similar technologies.
  • Ability to work with domain experts to translate engineering failure categories, business requirements, and quality expectations into clear prompts, evaluation criteria, and structured output formats.
  • Excellent analytical skills, attention to detail, and ability to reason about model behavior, evidence quality, data ambiguity, reproducibility, and maintainability of AI pipeline outputs.
  • Capacity to work independently, prioritize effectively, communicate progress clearly, and collaborate in an interdisciplinary research environment.
  • Interest in applying LLMs, knowledge extraction, and quality-focused AI engineering to industrial software systems, intelligent automation, or enterprise-scale engineering use cases.

About Siemens:

We are a global technology company focused on industry, infrastructure, transport, and healthcare. From more resource efficient factories, resilient supply chains, and smarter buildings and grids, to sustainable transportation as well as advanced healthcare, we create technology with purpose adding real value for customers. Learn more about Siemens here .

Our Commitment to Equity and Inclusion in our Diverse Global Workforce:

We value your unique identity and perspective. We are fully committed to providing equitable opportunities and building a workplace that reflects the diversity of society, while ensuring that we attract the best talent based on qualifications, skills, and experiences. We welcome you to bring your authentic self and transform the everyday with us.

#LI-JS

#LI-Remote

#ArtificialIntelligence, #MachineLearning, #GenerativeAI

Job Tags

Full time, Internship, Immediate start, Remote work

Similar Jobs

Goodwill Mid Michigan

Retail Supervisor Job at Goodwill Mid Michigan

 ...Entry Level Retail Management with a purpose!Goodwill's Mission: To assist individuals with barriers to employment in making the transition to independence and self-sufficiency._____________________________________________________________________________________... 

ConocoPhillips

Oiler - Marine Job at ConocoPhillips

 ...production companies, based on proved reserves and production of liquids and natural gas. With operations and activities in 13 countries, we explore for, develop, and produce crude oil and natural gas globally. We are challenged with an important job to safely find and... 

Karina Kiely - Dream to Prosper

Coach and Mentor - Remote Job at Karina Kiely - Dream to Prosper

 ...Coaches & Mentors Elevate Your Influence & Add a New Income Stream While Working Remote Are you a coach or mentor who wants to broaden your impact while creating an additional revenue stream that aligns with the work you're already doing? Do you value flexibility... 

Embry-Riddle Aeronautical University

Flight Dispatcher Job at Embry-Riddle Aeronautical University

 ...Space prepare the next generation of leaders shaping the future of flight and beyond The Opportunity The Flight Department at our...  ...Beach Campus is currently accepting applications for a Flight Dispatcher/Customer Service Representative. This position is... 

City of Trees Ventures, Inc.

Video Editor Job at City of Trees Ventures, Inc.

 ...Video Editor Short-Form, Long-Form & Branded Content Were hiring a sharp, self-driven video editor to help us turn raw footage into scroll-stopping content across YouTube, Reels, TikTok, and brand campaigns. Role: Video Editor Engagement: Full-time or part...