CV
Updated January 2024.
Education 🎓
University of Liverpool 2018-2021
PhD Machine Learning
National University of Galway, Ireland 2015 - 2016
MSc in Data Analytics Grade: 1.1 (Highest grade in class)
NUIM 2010 - 2014
BEng Electronic Engineering Grade: 2.2
Work experience 💼
DynamoFL January 2024 - Current
Machine Learning Research Scientist I am working on cutting edge LLM research around incorporating regulatory compliance, compressing LLMs and multilinguality.
Huawei Ireland Research Center November 2021 - January 2024
Machine Learning Research Scientist Research and engineering work for multilingual pretrained language models (small and large) including parameter efficient fine-tuning for tasks such as intent detection, text generation, question answering, synthetic data generation, semantic search and information retrieval.
Huawei Ireland Research Center March 2021 - Sep 2021
Research Intern Research on mutlilingual representation learning and neural network compression.
Amazon Search Sep 2019 - Dec 2020, June 2020 - October 2020
Applied Scientist Research on counterfactual detection and negation scope detection for filtering irrelevant features in information retrieval.
The University of Southern California, Information Sciences Institute June 2018 - September 2019
Research Intern Research on neural network compression techniques, specifically structured compression of Convolutional Neural Networks and Transformers.
Insight Center For Data Analytics September 2016 - February 2018
Data Scientist I developed machine learning applications for legal text classification, including novel LSTM architectures and clustering techniques to extract salient topics in regulations and directives.
Machine Learning Group at NUI Galway May 2016 - September 2016
Research Assistant I developed a Bayesian Network with prior knowledge to predict the likelihood of cardiovascular mortality in a cohort of 80k Irish patients.
Awards 🌟
- PhD Scholarship 2018
PhD funding
Invited Talks 🏛️
- Fine-pruning cross-lingual language models and gradient sparsification techniques for efficient fine-tuning. 2020
Huawei Research Center, Dublin, Ireland - Multilingual Counterfact Detection \& Negation Scope Detection 2020
Amazon Search, Japan, Tokyo - Multi-Modal Universal Representations for Conditional Text Generation. 2020
Amazon Search, Japan, Tokyo - Nearest Neighborhood Replacement Sampling for Sequence Prediction and Semi-Supervised Meta Embedding 2020
USC-ISI, Los Angeles, California, USA - Compressing Deep Neural Networks via Layer Fusion 2020
USC-ISI, Los Angeles, California, USA - Mitigating Compounding Errors In Language Modeling, Reward Augmented Maximum Likelihood and Graph Neural Network Classification. 2020
NLP Group at University of Liverpool (2018) - Applications of Recurrent Neural Networks for Legal Text Mining 2020
IBM Research, Dublin, Ireland
Teaching 👨🏫
- Teaching Assistant, Introduction To Programming in Python UoL, 2018
- Teaching Assistant, Graph Theory UoL, 2019
- Teaching Assistant, Machine Learning and Data Mining UoL, 2019
- Supervisor, MSc Project NUI Galway, 2017