We tackled this challenge by developing a sophisticated system that leverages cutting-edge computer vision and object detection technologies to automatically extract critical game data, recognize player actions, and provide real-time analysis. Utilizing advanced object recognition models, our system accurately identifies player names and the characters they have selected, ensuring comprehensive data capture from the outset. By implementing precise time-tracking mechanisms, it detects the exact start and end times of the game, enabling focused analysis. The system continuously monitors the number of lives and health levels of each player, crucial for assessing performance and identifying key moments. It then analyzes these moments to determine the mistakes made by the losing player based on his character’s abilities and the actions performed by the opponent player. At the end of each game, it identifies the winner, providing clear outcomes for each session analyzed. Additionally, the application performs real-time monitoring using keystroke analysis, categorizing moves as offensive or defensive and suggesting optimal strategies for future gameplay, giving players an immediate competitive edge.