This project aims to obtain the data available about a player's performance in their respective domestic leagues (e.g. English Premier League) and visualize their performance data in comparison to other players. We have broken up the analysis into 2 types of players in order to ensure a useful form of comparison.
Explaining the Data from fbref (https://fbref.com/en/)
We extracted the data required for our analysis from the FBRef Website, which consists of a breakdown of a match-by-match performance for each player. File used to find this may be found here: https://github.com/hoyishian/fantasypldatascience/blob/main/fbref_scout_extraction.py
There are 2 kind of players in the data we collected: Outfield players and Goalkeepers.
Goalkeeper players only have 1 set of statistics that is made up of 7 groups of Goalkeeping statistics. The following screenshot is taken from the FBRef website:
Outfield players have 4 set of statistics. They are explained in the Appendix section of this Readme Document.
There are 2 types of web scraping that can be done:
Extract all statistics for all domestic league games for players in a given league
Extract the top 10 most similar players for every player in a given domestic league. The top 10 most similar players may not be from the same domestic league that has been selected.
- Run the following command
python fbref_scout_extraction.py
- You will then be given the following prompt:
Enter League Here (EPL, Ligue 1, Bundesliga, Serie A, La Liga). Press Enter when ready:
- Enter the league of interest and press enter. It will take approximately 20 to 30 minutes to completely scrape all data for players in a given domestic league.
-
Ensure to comment out the following line and uncomment out the next line
-
Run the following command
python fbref_scout_extraction.py
- You will then be given the following prompt:
Enter League Here (EPL, Ligue 1, Bundesliga, Serie A, La Liga). Press Enter when ready:
- Enter the league of interest and press enter. It will take approximately 20 to 30 minutes to completely scrape all data for players in a given domestic league.
To see examples of how the data scraped from FBRef will look like, you can refer to the playerstats_(league) and goalkeeperstats_(league) file (For scraping player statistics) and similar_player_(league) file for (For scraping similar player).
SoTA -- Shots on Target Against
GA -- Goals Against
Save% -- Save Percentage (Shots on Target Against - Goals Against/Shots on Target Against)
CS -- Clean Sheets (Full matches by goalkeeper where no goals are allowed.)
PSxG -- Post-Shot Expected Goals (PSxG is expected goals based on how likely the goalkeeper is to save the shot)
PKatt -- Penalty Kicks Attempted
PKA -- Penalty Kicks Allowed
PKsv -- Penalty Kicks Saved
PKm -- Penalty Kicks Missed
Cmp -- Passes Completed (Passes longer than 40 yards)
PassAttemptedLong -- Passes Attempted (Passes longer than 40 yards)
Cmp% -- Pass Completion Percentage (Passes longer than 40 yards)
PassAtt -- Passes Attempted (Not including goal kicks)
Thr -- Throws Attempted
Launch% -- Percentage of Passes that were Launched (Not including goal kicks) (Passes longer than 40 yards)
AvgLen -- Average length of passes, in yards (Not including goal kicks)
GoalKickAtt -- Passes Attempted
GKLaunch% -- Percentage of Goal Kicks that were Launched (Passes longer than 40 yards)
GKAvgLen -- Average length of goal kicks, in yards
Opp -- Opponent's attempted crosses into penalty area
Stp -- Number of crosses into penalty area which were successfully stopped by the goalkeeper
Stp% -- Percentage of crosses into penalty area which were successfully stopped by the goalkeeper
#OPA -- # of defensive actions outside of penalty area
AvgDist -- Average distance from goal to perform defensive actions
Cmp -- Passes Completed
PassAtt -- Passes Attempted
Cmp% -- Pass Completion Percentage (Minimum 30 minutes played per squad game to qualify as a leader)
PassTotDist -- Total distance, in yards, that completed passes have traveled in any direction
PassPrgDist -- Progressive Distance (Total distance, in yards, that completed passes have traveled towards the opponent's goal. Note: Passes away from opponent's goal are counted as zero progressive yards.)
Cmp.1 -- Passes Completed
Att.1 -- Passes Attempted
Cmp%.1 -- Pass Completion Percentage
Cmp.2 -- Passes Completed
Att.2 -- Passes Attempted
Cmp%.2 -- Pass Completion Percentage
Cmp.3 -- Passes Completed
Att.3 -- Passes Attempted
Cmp%.3 -- Pass Completion Percentage
Ast -- Assists
xA -- xG Assisted (xG which follows a pass that assists a shot)
KP -- Key Passes (Passes that directly lead to a shot (assisted shots))
PassFinThird -- Passes into Final Third (Completed passes that enter the 1/3 of the pitch closest to the goal, Not including set pieces)
PPA -- Passes into Penalty Area (Completed passes into the 18-yard box, Not including set pieces)
CrsPA -- Crosses into Penalty Area (Completed crosses into the 18-yard box, Not including set pieces)
PassProg -- Progressive Passes (Completed passes that move the ball towards the opponent's goal at least 10 yards from its furthest point in the last six passes, or any completed pass into the penalty area. Excludes passes from the defending 40% of the pitch)
SCA -- Shot-Creating Actions (The two offensive actions directly leading to a shot, such as passes, dribbles and drawing fouls. Note: A single player can receive credit for multiple actions and the shot-taker can also receive credit.)
PassLiveShot -- Completed live-ball passes that lead to a shot attempt
PassDeadShot -- Completed dead-ball passes that lead to a shot attempt. (Includes free kicks, corner kicks, kick offs, throw-ins and goal kicks)
DribShot -- Successful dribbles that lead to a shot attempt
ShLSh -- Shots that lead to another shot attempt
Fld -- Fouls drawn that lead to a shot attempt
DefShot -- Defensive actions that lead to a shot attempt
GCA -- Goal-Creating Actions (The two offensive actions directly leading to a goal, such as passes, dribbles and drawing fouls. Note: A single player can receive credit for multiple actions and the shot-taker can also receive credit.)
PassLiveGoal -- Completed live-ball passes that lead to a goal
PassDeadGoal -- Completed dead-ball passes that lead to a goal. (Includes free kicks, corner kicks, kick offs, throw-ins and goal kicks)
DribGoal -- Successful dribbles that lead to a goal
ShGoal -- Shots that lead to another goal-scoring shot
FldGoal -- Fouls drawn that lead to a goal
DefGoal -- Defensive actions that lead to a goal
OG -- Actions that led directly to an opponent scoring on their own goal
Tkl -- Number of players tackled
TklW -- Tackles Won (Tackles in which the tackler's team won possession of the ball)
TacklesDef3rd -- Tackles in defensive 1/3
TacklesMid3rd -- Tackles in middle 1/3
TacklesAtt3rd -- Tackles in attacking 1/3
DribTackled -- Number of dribblers tackled
DribContest -- Dribbles Contested (Number of times dribbled past plus number of tackles)
DribTackled% -- Percentage of dribblers tackled (Dribblers tackled divided by dribblers tackled plus times dribbled past, Minimum .625 dribblers contested per squad game to qualify as a leader)
Past -- Number of times dribbled past by an opposing player
Press -- Pressures (Number of times applying pressure to opposing player who is receiving, carrying or releasing the ball)
SuccPress -- Successful Pressures (Number of times the squad gained possession withing five seconds of applying pressure)
SuccPress% -- Successful Pressure Percentage (Percentage of time the squad gained possession withing five seconds of applying pressure)
PressDef3rd -- Number of times applying pressure to opposing player who is receiving, carrying or releasing the ball, in the defensive 1/3
PressMid3rd -- Number of times applying pressure to opposing player who is receiving, carrying or releasing the ball, in the middle 1/3
PressAtt3rd -- Number of times applying pressure to opposing player who is receiving, carrying or releasing the ball, in the attacking 1/3
Blocks -- Number of times blocking the ball by standing in its path
BlockSh -- Number of times blocking a shot by standing in its path
ShSv -- Number of times blocking a shot that was on target, by standing in its path
Pass -- Number of times blocking a pass by standing in its path
Int -- Interceptions
Tkl+Int -- Number of players tackled plus number of interceptions
Clr -- Clearances
Err -- Errors (Mistakes leading to an opponent's shot)
Touches -- Number of times a player touched the ball. Note: Receiving a pass, then dribbling, then sending a pass counts as one touch
Def Pen -- Touches in defensive penalty area
TouchDef3rd -- Touches in defensive 1/3
TouchMid3rd -- Touches in middle 1/3
TouchAtt3rd -- Touches in attacking 1/3
AttPen -- Touches in attacking penalty area
Live -- Live-ball touches. Does not include corner kicks, free kicks, throw-ins, kick-offs, goal kicks or penalty kicks
Succ -- Dribbles Completed Successfully
Att -- Dribbles Attempted
Succ% -- Percentage of Dribbles Completed Successfully
#Pl -- Number of Players Dribbled Past
Megs -- Nutmegs (Number of times a player dribbled the ball through an opposing player's legs)
Carries -- Number of times the player controlled the ball with their feet
TotDist -- Total distance, in yards, a player moved the ball while controlling it with their feet, in any direction
PrgDist -- Progressive Distance (Total distance, in yards, a player moved the ball while controlling it with their feet towards the opponent's goal)
ProgCarries -- Progressive Carries (Carries that move the ball towards the opponent's goal at least 5 yards, or any carry into the penalty area. Excludes carries from the defending 40% of the pitch)
CarriesFinThird -- Carries into Final Third (Carries that enter the 1/3 of the pitch closest to the goal)
CPA -- Carries into Penalty Area (Carries into the 18-yard box)
Mis -- Miscontrols (Number of times a player failed when attempting to gain control of a ball)
Dis -- Dispossessed (Number of times a player loses control of the ball after being tackled by an opposing player. Does not include attempted dribbles)
Targ -- Pass Targets (Number of times a player was the target of an attempted pass)
Rec -- Passes Received (Number of times a player successfully received a pass)
Rec% -- Passes Received Percentage (Percentage of time a player successfully received a pass)
ProgPassRec -- Completed passes that move the ball towards the opponent's goal at least 10 yards from its furthest point in the last six passes, or any completed pass into the penalty area. Excludes passes from the defending 40% of the pitch
Gls -- Goals
PK -- Penalty Kicks Made
PKatt -- Penalty Kicks Attempted
Sh -- Shots Total (Exclude PK)
SoT -- Shots on target (Exclude PK)
CrdY -- Yellow Cards
CrdR -- Red Cards
xG -- Expected Goals (xG totals include penalty kicks, but do not include penalty shootouts)
npxG -- Non-Penalty Expected Goals
