Senior Research Associate, Probabilistic Programming Project (LLM & ASP)

Alan Turing Institute London United Kingdom Research Programmes
Warning! Vacancy expired

Company Description

Named in honour of Alan Turing, the Institute is a place for inspiring, exciting work and we need passionate, sharp, and innovative people who want to use their skills to contribute to our mission to make great leaps in data science and AI research to change the world for the better.

Please find more information about us here.

Position

In 2022, the Alan Turing Institute signalled its intention to establish a portfolio of foundational AI research, which would complement the strengths of the institute around applications of AI and AI policy. The initial portfolio of research contains projects in two themes around foundation models and game theory. Five projects within a new probabilistic programming theme are being launched in early 2024. This role is being recruited to be part of one of the new projects in the probabilistic programming theme.


This project aims to improve the reliability and consistency of large language models (LLMs) by integrating the LLMs with probabilistic answer set programming (P-ASP). This will allow for enforcement of logical, semantic, and syntactic constraints on LLM outputs. This role will involve developing methods to map between natural language and P-ASP frameworks, designing experiments to analyse LLM reasoning capabilities, developing methods for implementing P-ASP solvers to reformulate prompts, and develop strategies for constrained inference in LLMs.


DUTIES AND RESPONSIBILITIES

  • Develop novel methods to map between natural language and probabilistic programming frameworks, building on the candidate's expertise with NLP and LLMs.
  • Lead research projects on scaffolding LLMs with declarative constraints
  • Design computational experiments and benchmarks to analyse commonsense reasoning capabilities of LLMs using P-ASP scaffolds.
  • Collaborate with the project investigators to define the research direction and implement the objectives described in the proposal.
  • Stay up to date on relevant literature at the intersection of foundation models, neuro-symbolic AI, and commonsense reasoning.
  • Take the lead on disseminating findings through publications, conferences, and Turing Institute events.
  • Act as a point of contact with stakeholders and supervise junior researchers on the project team.
  • Work closely with cross-disciplinary team members to execute the work packages focused on robust mapping, LLM-ASP inference, and multimodal extensions.
  • Contribute domain expertise in LLMs to advance the Probabilistic Programming research theme

Requirements

  • A PhD or equivalent qualification/experience in Mathematics, Computer Science, or a closely related discipline
  • A solid background in two or more of the following: use of Large Language Models such as GPT and open LLMs (such as Llama). Hands on experience with controlling inference in LLMs and transformer-based sequence to sequence models.
  • Track record of the ability to initiate, develop and deliver high quality research aligned with the research strategy and any industrial stakeholders and to publish in peer reviewed journals and conferences.
  • Experience in design, development and implementation of research software tools and libraries, such as Python, with specific knowledge of PyTorch and JAX).
  • Ability to communicate complex, specialist, or conceptual information clearly and persuasively to diverse audiences

Other information

APPLICATION PROCEDURE

If you are interested in this opportunity, please click the apply button below. You will need to register on the applicant portal and complete the application form including your CV and covering letter. If you have questions about the role or would like to apply using a different format, please contact us at [email protected].


If you are applying for more than one role at the Turing, please note that only one Cover Letter can be visible on your profile at one time. If you wish to apply for multiple roles and do not want to overwrite your existing Cover Letter, please apply for the role using the button below and forward your additional cover letter directly to [email protected] quoting the job title.


If you are an internal applicant and wish to apply, please send your CV and Cover Letter directly to [email protected] and your application will be considered.


CLOSING DATE FOR APPLICATIONS: Sunday 7 January 2024 at 23:59 (London, UK GMT)


INTERVIEW DATES: Interviews will be conducted in late January 2024, with limited communications over the Christmas/New Year break.


TERMS AND CONDITIONS

This full-time post is offered on a 2-year fixed-term basis. The annual salary is £53,576 - £55,125 (depending on experience) plus excellent benefits, including flexible working and family friendly policies, https://www.turing.ac.uk/work-turing/why-work-turing/employee-benefits


The Alan Turing Institute is based at the British Library, in the heart of London’s Knowledge Quarter. We expect staff to come to our office at least 4 days per month. Some roles may require more days in the office; the hiring manager will be able to confirm this during the interview.


EQUALITY, DIVERSITY, AND INCLUSION

The Alan Turing Institute is committed to creating an environment where diversity is valued and everyone is treated fairly. In accordance with the Equality Act, we welcome applications from anyone who meets the specific criteria of the post regardless of age, disability, ethnicity, gender reassignment, marital or civil partnership status, pregnancy and maternity, religion or belief, sex and sexual orientation.


We are committed to making sure our recruitment process is accessible and inclusive. This includes making reasonable adjustments for candidates who have a disability or long-term condition. Please contact us at [email protected] to find out how we can assist you.


Please note all offers of employment are subject to obtaining and retaining the right to work in the UK and satisfactory pre-employment security screening which includes a DBS Check. Full details on the pre-employment screening process can be requested from [email protected].ac.uk.