
Research Scientist Intern, AI Core Machine Learning (PhD)
Required skills
- Machine Learning
- Artificial Intelligence
- Information or Multimedia Retrieval
- Computer Vision
- Natural Language Processing
- Reinforcement Learning
- Optimization
- Computational Statistics
- Applied Mathematics
- PyTorch
Nice to have
- LLM agents
- reinforcement learning for LLMs
- automated ML research
- AutoML
- recommender systems
- evaluation of agentic systems
Role summary
Meta is seeking a PhD-level Research Intern to join the AI Core Machine Learning team, focusing on recursive self-improvement for AI research agents. The intern will explore how AI agents can learn from their own experiments to enhance future research processes. This involves designing agents that form hypotheses, utilize tools, conduct experiments, analyze outcomes, and learn from past trajectories. Responsibilities include developing methods for LLM improvement via reinforcement learning and optimizing agent harnesses, building reliable evaluation and reward signals, and studying the compounding effects of self-improvement. The role requires collaboration with researchers and engineers, with the goal of publishing findings at top-tier ML conferences and contributing to Meta's product development.
Responsibilities
- Conduct state-of-the-art research on recursive self-improvement, autoresearch, and self-improving AI agents.
- Design and evaluate agents that form hypotheses, use tools, run experiments, analyze outcomes, and learn from prior research trajectories.
- Develop methods to improve the underlying LLM through reinforcement-learning post-training and/or optimize the surrounding harness, including prompts, tools, memory, retrieval, and orchestration.
- Build reliable evaluation and reward signals for long-running, expensive ML experiments, including safeguards against reward hacking and regressions.
- Study whether gains compound across multiple self-improvement rounds and rigorously attribute improvements to model learning versus harness changes.
- Collaborate with researchers and engineers across varied disciplines, including communicating research plans, progress, and results.
- Publish research results at a top-tier machine learning conference and contribute research that can be applied to Meta product development.
Minimum Qualifications
- Currently has or is in the process of obtaining a Ph.D. degree in Machine Learning, Artificial Intelligence, Computer Science, Information or Multimedia Retrieval, Computer Vision, Natural Language Processing, Reinforcement Learning, Optimization, Computational Statistics, Applied Mathematics, or related technical fields
- Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
- Experience with deep learning frameworks such as Pytorch or Tensorflow
- Experience with Python, C++, C, Java, or other related languages
- Experience with research and building systems based on machine learning and/or deep learning methods
Preferred Qualifications
- Intent to return to degree program after the completion of the internship/co-op
- Research experience in one or more of the following areas: LLM agents, reinforcement learning for LLMs, automated ML research, AutoML, recommender systems, or evaluation of agentic systems
- Proven track record of achieving significant research results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as NeurIPS, ICML, ICLR, AAAI, KDD, IJCAI, CVPR, ICCV, ACL, NAACL, ICASSP, or similar
- Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub)
- Demonstrated experience and self-driven motivation in solving analytical problems using quantitative approaches
- Experience manipulating and analyzing complex, high-volume, high-dimensionality data from varying sources for large-scale training
- Experience working and communicating cross functionally in a team environment
$7,650/month to $12,667/month + benefits
Similar roles
Clinical Research ScientistAbbott · Plymouth, MN · Onsite- Human Subjects Research Scientist (Ph.D.)Exponent · Natick, MA · Onsite
- Tinian Forest Bird Research ScientistUniversity of Washington Medical Center · Seattle, WA · Hybrid
Research Scientist- School of Medicine, PulmonaryEmory University · Atlanta, GA · Onsite
Senior Research Scientist, Silicon Spin QubitsQ-CTRL · Los Angeles, CA · Hybrid- Research Scientist, Post-Training — Video GenerationPika · United States
