I am an AI Research Scientist at Quincus, and my professional expertise and interests span Reinforcement Learning, Machine Learning Theory, Deep Learning, Natural Language Processing (NLP), and Large Language Models (LLM). I am deeply passionate about leveraging cutting-edge AI to solve real-world problems in sectors such as healthcare, education, and legal. If you share my enthusiasm for launching an AI-driven business, I would be thrilled to connect with you.
I got my Thesis-Based Master degree in Computing Science Department of UAlberta, where my research experiences include differential privacy, machine learning theory and reinforcement learning.
I enjoy working on theoretical topics a lot. It's delightful to work in CS department of UA, where you can always be inspired by brilliant ideas proposed by terrific scholars and students.
Before joining UAlberta, I got my B.Sc. degree from The Chinese University of Hong Kong. Studying in CUHK is the most meaningful experience to me. During the 4 years, I not only gained a wealth of knowledge, but also became more self-motivated, more rigorous and more efficient, and most importantly, I gained my most meaningful friendships there.
Major : Mathematics (Enrichment Stream & Computational and Applied Mathematics Stream)
Minor : Computer Science
Robust Risk-Sensitive Reinforcement Learning Agents for Trading Markets.
Yue Gao*, Pablo Hernandez Leal, and Yik Chau (Kry) Lui.
Filed a Patent. 2021.
Accepted to ICML 2021 RL4RealLife
arXiv BlogLeveraging Non-uniformity in First-order Non-convex Optimization.
Jincheng Mei*, Yue Gao*, Bo Dai, Csaba Szepesvári, and Dale Schuurmans.
International Conference on Machine Learning (ICML), 2021.
PMLRSpearheaded the transformation of complex supply chain route optimization challenges into robust RL/DL/ML models, leveraging CV and NLP techniques to enhance predictive accuracy and operational efficiency by over 30% on multiple metrics. Developed scalable pipelines and established industry-specific benchmarks
Proposed and developed paper-ready innovative reinforcement learning algorithms, incorporating novel variations of Q-Learning and deep learning approaches
Engineered and optimized robust end-to-end pipelines for multi-modal products, integrating diverse data types and systems to enhance product functionality and user engagement
Led cross-functional teams in the strategic development and delivery of professional presentations and demos
Worked on ML APIs.
Proposed and validated 4 innovative algorithms for robust risk-sensitive reinforcement learning, tailored for trading markets, achieving a 40% increase in risk-adjusted returns compared to existing models.
Proposed an evaluation method of risk sensitive trading agents using empirical game theory.
Conducted comprehensive simulations using a streamlined trading market model to evaluate and demonstrate a 40% superior performance of our algorithms over conventional methods.
I worked with Professor Or Sheffet on differential privacy, and I'm pretty enthusiastic about this area. Lying on the intersection between machine learning and theory, differential privacy is a mathematically rigorous notation of preserving privacy in data analysis.
I'm also fortunate to with Professor Csaba Szepesvári on Reinforcement Learning, which I believe, stares into a bright future and is promising in many real-life applications.
I had the honor of being supervised by Professor Anthony So on Clustering Problems. Through this research, I found machine learning theory illuminating and made up my mind to take ML theory as my pursuit.
I enjoy singing and playing piano, and I'm also a guitar beginner. Recently I became a member of a band as keyboard player and sub-vocalist.
I'm a big fan of world geography. I enjoy experiencing different cultures, exploring local attractions, food, and especially, the museums.
I've been to different countries including Australia, France, Italy, Vatican, Maldives and so on. Here's my visited map .
I'm an absolute aviation ethusiast. I enjoy flying, collecting the information of each flight, watching aviation documentaries, and especially, taking aerial pictures.
Here are some of my aerial photographs.
Here are some of my self-made flightlogs.
Reading is an inseparable part of my life, and I'm particularly fascinated by philosophy and psychology books since I was a teenager. Reading academic papers in ML/RL is also a source of joy for me. My blogs include some of my reading summaries of academic papers.
I'm not professional in photography, in fact, I'm just a beginner. But I have a huge passion for photographing all kinds of skies and natural scenery.
Here is my sky and nature album.