Khashayar Ghamati Ghamsari

Ph.D. Candidate | Reinforcement Learning | HRI Enthusiast

About Me

Welcome to my personal space on the web! I am a PhD candidate at the University of Hertfordshire, focusing on robot adaptation in unseen environments using Reinforcement Learning (RL). My research centres on developing adaptive algorithms that allow robots to learn on the fly and function effectively in unfamiliar, dynamic settings. By advancing RL techniques, I aim to create systems capable of adjusting to unpredictable real-world conditions, improving robot autonomy and performance. Through my work, I hope to contribute to the future of robotics, making robots more intelligent and capable in complex environments.

Education

Ph.D. in Computer Science - University of Hertfordshire (2023 - present)
- Thesis Project: Robot Adaptation: On the fly learning using RL
- Supervisors: Dr. Abolfazl Zaraki and Prof. Farshid Amirabdollahian
M.Sc. in Computer Science-AI - Science And Research branch of Azad University (2018 - 2021)
- Thesis: Building a recommender system to predict the next customers' purchases
- Supervisors: Dr. R.Kargar and Dr. F.Hosseinzadeh Lotfi

Research Interests

Artificial Intelligence: Reinforcement Learning, LLM
Robotics: Human-Robot Interaction, ML in Robotics

Publications

Skills

Advanced programming in Python and Java
Machine learning with PyTorch, Keras, RayLib and Gym
Mathematical modelling and algorithm design
Robotics system integration and AI application development
Project management and agile software development methodologies

Projects

Robot Adaptation: On the fly learning using RL (Ph.D. Project) - University of Hertfordshire (2023 - present)
- Developing algorithms and systems for effective human-robot interaction.
The Alan Turing Institute Data Study Group - Member (2023)
- Utilised YOLOv7 and R-CNN for tiger detection and recognition based on skin patterns.
PetFinder (Kaggle Competition) - Participant (2022)
- Employed neural networks to predict the "Pawpularity" of pet photos using image and metadata processing.
Indoor Navigation System - Science and Research Branch of Azad University (2019 - 2020)
- Developed a user position estimation system using Beacon sensors.
Market Basket Analysis - Science and Research Branch of Azad University (2017 - 2018)
- Utilised the Bayesian Network to predict customers’ future purchases.
Infravision (DCIM) - Project (2017 - 2018)
- Developed an application utilising SNMP and Modbus protocols for sensor data monitoring in data centres.
Robot Navigation - Project (2012 - 2017)
- Developed a navigation module using Octomap and ROS for robots in unknown environments.

Selected Talks and Teachings

March 2024 - present: Visiting Lecturer, University of Hertfordshire - AI and Robotics
February 2024: Reinforcement Learning and Robotics workshop, University of Hertfordshire
March - April 2023: Visiting Lecturer, Brunel University London - Large Language Model (LLM) and Python
October 2019: Glowworm Swarm Optimisation, Science and Research Branch of Azad University
December 2015: Python Language Programming, Mechatronic Research Laboratory (MRL), Qazvin Azad University

Work Experience

Senior Software Engineer - SnappRoom! (2022 - 2023)
- Technologies used: Python, MongoDB, Docker, Django
Product Manager - AlefMarket (2019 - 2021)
- Led the development of new features and enhancements for the e-commerce platform.
Senior Software Engineer - Arta Vision AVA (2017 - 2019)
- Developed and maintained various software solutions for clients in different industries.
Software Developer - Karina Mobile Solutions (2016 - 2017)
- Worked on mobile application development and backend integration.
Software Developer - Kaman Academy (2014 - 2015)
- Developed educational software tools and applications.

Training Courses

Contact

If you're interested in discussing research, potential collaborations, or just want to say hello, please don't hesitate to reach out:

LinkedIn
GitHub