About
Dr. YU Wing Yin received his BSc degree with First Class Honors and his PhD degree from City University of Hong Kong in 2019 and 2023. Currently, he joins Noah’s Ark Lab Huawei Hong Kong as a senior researcher working on developing PanguLLM and OptVerse AI Solver – a mathematical optimization modeling tool for industrial application . He published many papers on top peer-reviewed AI-related conferences and journals including ICCV, NeurIPS, ICLR, COLING, TIP, TCSVT, etc. His research interests include large language model for optimization modeling/reasoning, reinforcement learning with human feedback and image/video Generation.
Work Experiences
- 2023 - Present: Noah’s Ark Lab AI Researcher, Huawei HK
- Empowering Huawei’s OptVerse AI Solver product with Generative AI technology to solve industrial optimization problem
- Generating large-scale and industrial level instances such as linear programming or mix integer and linear programming to facilitate data-driven learning algorithm;
- Building state-of-the-arts LLM for intelligent modeling applications to minimize operation research experts involved in business cycle, including intelligent consultation, optimization modeling, intelligent coding, explainable modeling, and agentic application
- Enhancing Huawei’s Pangu LLM to solver general and optimization problem
- Data synthesis for developing AI-Generated Content (AIGC) capability with PanguLLM Xiaoyi, core developer of retrieval augmented generation used in Xiaoyi
- Enhancing natural language understanding capability in PanguLLM, such as zero-anaphor, language stylish, knowledge analysis, text editing, etc…
- Empowering reasoning capability in RLHF stage, including building Outcome Reward Model (ORM) for Direct Preference Optimization (DPO) and Process Reward Model (PRM) for Monte Carlo Tree Search (MCTS) guided tree search LLM pipeline
- Empowering Huawei’s OptVerse AI Solver product with Generative AI technology to solve industrial optimization problem
- Sept 2020 – Aug 2023: Teaching Assistant
- Electrical Engineering Department, CityU
- EE3210: Signals and Systems
- EE4015: Digital Signal Processing
- EE5806: Topics of Image Processing
- EE5415: Mobile Applications Design and Development
- Electrical Engineering Department, CityU
- Summer 2018: Research Internship
- Electronic & Electrical Engineering, University College London (UCL)
- To design and implement an IoT solution for farm animal tracking
- To use IBM Cloud services to implement an air quality monitoring system for schools
- To design a case for embedded sensors with 3D printing pipeline
- Summer 2018: Course Assistant
- EE Artificial Intelligence Summer Course 2018 – Electronic Engineering Department, CityU
- Participated in course material design related to machine learning (supervised learning)
- Provided consultation and support on machine learning problem for secondary students
- Organized and operated events
- 2015 - 2019: Course Instructor
- 2015 - 2018: Event Assistant
- Hour of Code HK, CityU Apps Lab
- Event organization / coordination
- To assist participants to solve programming problem
Education
- Ph.D in Electrical Engineering, 2023
- City University of Hong Kong
- Supervised by Dr. PO, Lai-Man
- Research Interest
- Image/Video generative model (VAE, GANs, DDPM)
- Human pose transfer
- Semantic segmentation
- Computer vision
- Deep learning
- Machine learning
- Multimodal LLM
- B.eng in Information Engineering, 2019
- City University of Hong Kong
- First-class Honor, Top 5% in corresponding cohort, Dean’s list, CGPA: 3.76 / 4.0
- Final year project: Digital Empowerment for The Visually Impaired, supervised by Dr. CHEUNG, Chak Chung Ray
Social Services
- 2022 - 2023: Underprivileged Student Mentor
- Strive and Rise Programme - Social Welfare Department, HKSAR Government
- To help mentees broaden their horizons, reinforce their self-confidence, develop a positive outlook on life, set goals for their future and strive for upward mobility
- To inspire mentees to explore more possibilities for personal development, develop action plans and make good use of financial resources to achieve their personal development plans under guidance
- Related news: HKSAR
- Summer 2021: Statistics Enumerator
- Census and Statistics Department, HKSAR Government
- To obtain up-to-date information on the socio-economic characteristics of the population every 10 years
- To obtain census data through field visits or telephone interview
- To follow up on self-enumerate cases through telephone or field visits
- 2016 - 2017: EE Student Mentor
- Student Mentoring Scheme - CityU
- Assisted in campus orientation and consultation on academic life for freshmen
- 2016 - 2017: Volunteer
- Barrier Free City Orienteering Competition - Kowloon East PHAB Centre
- Assisted in preparation and implementation of the competition
Scholarships
- 2021, Research Tuition Scholarship, City University of Hong Kong
- 2019, PCCW-HKT Scholarships, Hong Kong Telecom
- 2017 - 2019, CityU Scholarship, City University of Hong Kong
Awards
- 2022, Outstanding Academic Performance Award, City University of Hong Kong
- 2021, Research Student Symposium Competition (1/46), City University of Hong Kong
- 2019, ASM Technology Award, Outstanding Award (4/10), ASMPT Corporate
- 2019, Final Year Project Competition (3/168), City University of Hong Kong
- 2018, Information Product Design Competition (3/20), City University of Hong Kong
- 2017, Reaching Out Award, HKSAR Government Scholarship Fund
Technical Skills
- Deep learning framework
- PyTorch, TensorFlow, Keras, MXNet
- Machine learning package
- NumPy, Scikit-learn, Pandas, Matplotlib, OpenCV, Pillow
- Programming language
- Python, Java, C++, Matlab, Swift, Kotlin
- Internet of Thing
- Arduino, Raspberry Pi, Nvidia Jetson
- Cloud service
- Amazon AWS, Google Cloud, IBM Cloud, Microsoft Azure
- Mobile application development
- iOS, Android
- Web development
- HTML5, CSS3, PHP, Javascript
- Database
- SQL
- Networking
- Cisco Packet Tracer, Wireshark, Penetration Test
- Game design
- Unity
Publications
Talks
CityU-EE Webinar: Rocket Yu, From UG to PhD study in HK
Webinar at City University of Hong Kong, Hong Kong
CityU-EE Friday Seminar
Talk at City University of Hong Kong, Hong Kong
CityU-EE Recruitment Alumnus Sharing
Talk at City University of Hong Kong, Hong Kong