User Pass
Home Sign Up Contact Log In
Forum > Discuss GLB Issues With Catch22 > NOT A BUG - CLOSED > Wide Open Incompletion Case Study - Intended to answer Borts questions about the frequency of this error
Page:
 
rj414
offline
Link
 
Bort, the following are pass plays from this game: http://goallineblitz.com/game/game.pl?game_id=192589&mode=pbp

They are taken from the perspective of this team: http://goallineblitz.com/game/team.pl?team_id=1214

This is the team they are playing: http://goallineblitz.com/game/team.pl?team_id=2890

The defense in these clips is from a very good football team currently in Oceania Pro - they are slightly lower level than the offense but have perfect chemistry and excellent builds, which is how they have risen meteorically from their inception to the Pro leagues in 2 seasons (they were a new team in season 3).


------

These are the wide-open incompletions in this game:

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1569820

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1568093

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1568119

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1569508

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1569559

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1570661

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1570950

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1571411

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1572980

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1573303


These are the plays in which the QB does complete a long pass, but to a reciever who isn't completely open or has somebody in the neighborhood:

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1569790

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1570223

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1570255

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1572749

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1572900

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1574145

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1574312

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1575619

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1569637


These plays are completions to a player who is all by himself, but they are all tight ends

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1570188

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1568761

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1570681

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1573646

http://goallineblitz.com/game/replay.pl?game_id=192589&pbp_id=1574192


I have omitted plays that were completions under 10 yards, or listed as drops or deflections, but this is every deep incompletion or play that was completed in excess of 10 yards from the game. The final stat line for Hugh Laurie in the game read: 38/67, 378 yards, 1 td, 1 int.

I think it is interesting to note that Hugh didn't even once complete a pass to a WR who didn't have a corner anywhere around him - peculiar especially considering the number of passes he did complete when his recievers were covered. I joked on my other thread about this game that perhaps the best defense is now to rush 11 and leave recievers wide open. Additionally, the fact that the tight ends were easily the most reliable recievers in this game (the only ones below 72 speed on the field for Hugh, incidentally) might also bear out Serenity's theory about the problem coming from recievers moving too fast. Also want to point out that all of the WRs on this team have 74+ speed and 50+ agility, as well as a minimum of 4 in first step and quick cut.

I think this game will provide an excellent case study for you Bort and I hope you will take the time to analyse it further. I am also going to update this post here in a few minutes with data from an actual game to give you some comparison.
 
ron2288
offline
Link
 
great work rj...glade to see this..beside some that forum troll and bash others w/o anything useful to say
 
rj414
offline
Link
 
Thanks ron
 
rj414
offline
Link
 
The second set of data comes from a USA A7 game between the Spicewood Longhorns and Portland Hitmen. Again I will give you data from the Spicewood perspective. Fewer attempts in this game altogether, and this was today so I had already made several adjustments to limit the damage this bug did to my team - most notably a fair fewer deep attempts as well as a lower number of attempts in total.

This is the game: http://goallineblitz.com/game/game.pl?game_id=148934

This is the offense: http://goallineblitz.com/game/team.pl?team_id=1214

This is the defense: http://goallineblitz.com/game/team.pl?team_id=1211


I'll begin with the wide open incompletions -

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2289933

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2290993

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2292762 <--- that one really sucked



This play didnt register as a drop or a deflection but there was a corner in the neighborhood -

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2291122




Here are the successful plays to relatively open or wide open recievers -

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2289969

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2293913

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2293004 <--- that one was a shorter completion though

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2293262 <--- that one too

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2294392 <--- and that one

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2294985



Here are the successful plays to covered recievers -

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2290931

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2293230

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2294296

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2294456

http://goallineblitz.com/game/replay.pl?game_id=148934&pbp_id=2295928


In this game the bug seems less pronounced, but considering the adjustments that were made to limit the bugs impact I'd stay it is definitely still visible. Next I'm gonna do one last game - the season opener, in which the same gameplan as the Melbourne scrimmage was in effect.
Last edited Sep 25, 2008 20:32:23
 
Xiidaen
offline
Link
 
I've marked a couple from our last game if you'd like more examples -- cases where the receiver appears to be wide open, the pass appears to be on target...and simply listed as 'incomplete'

 
BigDaddyTim
offline
Link
 
This is a great work up. I looked at the same QB in a game from last season where he had comparable stats. These plays did not reproduce in that game how ever the CB's played a lot tighter in the game i watch and deflected many of the passes. I will agree that a lot of these passes look like they should be catches and that some how the text should tell us what happened so we know weather it was a QB error or a WR error and we can build on it.

Very nice post RJ.
 
winchester
offline
Link
 
Great work and thanks for doing this.
 
rj414
offline
Link
 
The final set of data comes from the A7 Opener between the Spicewood Longhorns and the San Diego Marauders.

Same team is on offense: http://goallineblitz.com/game/team.pl?team_id=1214

This team is on defense: http://goallineblitz.com/game/team.pl?team_id=1697



Incomplete

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1122082

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1124096

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1124286

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1125309

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1125448

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1127174

Long to WR

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1125367


TE
http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1121922

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1123358

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1124206

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1126018

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1126225

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1126338

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1126370

http://goallineblitz.com/game/replay.pl?game_id=148982&pbp_id=1126777

NO Successful plays to wide open recievers. All the long passes (here defined as 10+ yards) that weren't dropped or deflected are accounted for here.

As you can see - the bug killed the team in this game, and this is a huge reason why I scaled back our long passing game over the last two games. However I don't believe forcing teams to adapt by shortening their passing game is fair, especially when they have specifically built to be more vertical. Also, I'm not lobbying for this to build my qb's numbers or favor my team - but what I'm saying is that if the recievers get behind the coverage that many times in a single game - yeah, the majority of them should be completions unless the qb is just horrendous.

I hope this information is helpful to you Bort as you continue to analyse this situation.
Last edited Sep 25, 2008 20:43:14
 
rj414
offline
Link
 
Thanks for all the positive feedback about this thread so far - especially to BigDaddyTim, whom I may have misjudged slightly in my rather ascerbic rebuttal of his post in the other thread

I was hesitant to give out too much tactical information, but since it is important to me that this issue be addressed:

In both of these games Hugh was on medium passing style, with favor long off, no favorite targets, no check down to hbs. I do have data from another game in which he is on Lofty, and he had similar results - I will go through and examine that one as well if it is helpful.
Last edited Sep 25, 2008 20:44:47
 
im4ut999
offline
Link
 
Keep up the pressure rj....good work.
 
Modok
offline
Link
 
Thanks for doing this rj, I know it took considerable time and effort. Hopefully it doesn't go unnoticed.

I have a LVL 27 QB that has been suffering from the same type problems with 2 specific WRs on his team. Both of them are speed WRs with 75+ speed.
 
Sooner Steve
offline
Link
 
Rj has very valid points here and makes a poignant argument to re-visit these passing/catching issues.
 
whodey08
offline
Link
 
I dont know how many threads or players or teams it will take before Bort has to acknowledge that something happened with the code! He said earlier he ran tests and found nothing wrong.

I have spoken to over 30 teams who have the same complaints. Thats not whining...thats a problem

We spent real money to boost our players and we are over LV30 and up to 35 and so we are helpless to adjust to whatever the problem is. Equipment costs $200,000 a pop at the higher levels. Cant just sell and rebuy

PLEASE PLEASE PLEASE BORT FIX IT
 
datongw
offline
Link
 
RJ, I took a look at all 3 of the games. Here are my thoughts:

1. Yes, there is definitely a lot of the occurrence in which the WR seems to be open and the pass is on target, but it's incomplete.
2. The 3 games you showed as an example, the opponents were all pretty decent, so the data is pretty valid. Against these 3 quality opponents, your QB is 83-132, 63%, 281 yards a game, 7 TDs and 3 Ints. Rating of 89.3, which is pretty decent. I don't know what your QB's exact build is, but been a level 31 QB and only having 49 in the passing bar, I'm guessing his throwing+vision is about 140 with a lot invested in the SA (4-5 in most passing SA). Honestly, not a bad QB, but it's probably average for a level 31 QB. In which, against quality opponents, getting a rating of 89.3 is not bad.
3. There are 19 cases where the WR was open and the pass was not completed, if these were completions, your QB would have completed 102 out of 132 passes, which would be 77%. That is a bit high for any QB that plays quality defenses, and average 10 yards a completion. If most passes were short passes, 77% is achievable, but the average completion won't be 10 yards.

So, it's in my opinion that the passing results from these 3 games (based on your QB, and level of competition), are pretty realistic. We know Bort tuned down pump fake a bit, there are two ways to do this: 1) change the graphics so the DB stays with the WR when the pump fake is not working; 2) keep the graphics the way it is, but reduce the completion % for WRs getting open because of the pump fake. Logically, I would think the first method is the way to go. But I think what has happened is that the second method is implemented, maybe for technical reasons such as easier fix without having to change too much code.

I'm still seeing too many DBs getting faked out on passes. As a matter of fact, if you take a look at these incomplete passes, most of the time the WR is open because the CB froze. Of course, I'm just guessing here.
 
rj414
offline
Link
 
Originally posted by datongw
RJ, I took a look at all 3 of the games. Here are my thoughts:

1. Yes, there is definitely a lot of the occurrence in which the WR seems to be open and the pass is on target, but it's incomplete.
2. The 3 games you showed as an example, the opponents were all pretty decent, so the data is pretty valid. Against these 3 quality opponents, your QB is 83-132, 63%, 281 yards a game, 7 TDs and 3 Ints. Rating of 89.3, which is pretty decent. I don't know what your QB's exact build is, but been a level 31 QB and only having 49 in the passing bar, I'm guessing his throwing+vision is about 140 with a lot invested in the SA (4-5 in most passing SA). Honestly, not a bad QB, but it's probably average for a level 31 QB. In which, against quality opponents, getting a rating of 89.3 is not bad.
3. There are 19 cases where the WR was open and the pass was not completed, if these were completions, your QB would have completed 102 out of 132 passes, which would be 77%. That is a bit high for any QB that plays quality defenses, and average 10 yards a completion. If most passes were short passes, 77% is achievable, but the average completion won't be 10 yards.

So, it's in my opinion that the passing results from these 3 games (based on your QB, and level of competition), are pretty realistic. We know Bort tuned down pump fake a bit, there are two ways to do this: 1) change the graphics so the DB stays with the WR when the pump fake is not working; 2) keep the graphics the way it is, but reduce the completion % for WRs getting open because of the pump fake. Logically, I would think the first method is the way to go. But I think what has happened is that the second method is implemented, maybe for technical reasons such as easier fix without having to change too much code.

I'm still seeing too many DBs getting faked out on passes. As a matter of fact, if you take a look at these incomplete passes, most of the time the WR is open because the CB froze. Of course, I'm just guessing here.


It is not the numbers that I'm necessarily arguing with - granted they would be far better if those passes were all complete - but the nature in which these particular passes are incomplete. I'd rather every one of the passes he drops into coverage be incomplete and all the wide open ones be complete - which would give him a far worse percentage but be more accurate.

I think the misconception of everybody who is refuting posts about this issue is that the people posting on it are complaining about the qb's numbers - Hugh's numbers are perfectly acceptable - but the nature of the sim and the way these plays are working is just plain wrong. Also, Bort's nerf of pump fake is intended to shorten the length of the fake - it should have absolutely no effect on whether the pass is caught if it reaches the reciever - so if it IS affecting that, then that is a problem.
Last edited Sep 25, 2008 22:27:08
 
Page:
 


You are not logged in. Please log in if you want to post a reply.