Now as a followup to my previous post; the big latency issue.
(that's from the patent so some of you already understand)
The WiiU controller (the console system) will have an automated system that detects the HDTV latency and calculates the lag beta, lag alpha is the output signal that goes into the HDTV and controller, technically the controller will be able to output practically instantly, lag alpha is very very small, but it won't in practise, the lag beta is the time it takes for the HDTV to process the video signal and pixels change. That lag beta will be added on top of the total lag the controller will have, so it will match the HDTV perfectly when calibrated as explained.
Now the catch is, it's all up to the HDTV that will determine your lag, and that's a significant problem here as most mass consumer HDTV have even crappier firmware, peolpe will need to be able to set proper settings and only those that really get some effort behind into looking on forums to get the perfect settings for their HDTV if they have game-mode at all, but even with game-mode it's still a problem, 40-50ms is still a lot.
So gameplay will be significantly hindered if not unplayable at all for any case of competitive or hardcore gaming, on a worst-case scenario anything above 100ms is a huge lag and input from the controller will not be show on the screen practically immediately. This will create public reaction or developer comments, expect something, definitely from Carmack if they make something for WiiU soon.
The detection will be done with the GamePad camera which I expect it to be capable of 60 FPS at least.
Now let's look further, when you switch your main screen to your controller, that mode should not include the added beta lag, and the gameplay experience may be for some games a lot better in terminal mode. But we'll test if this is true, so it's not a bug or mistake in the system.
In conclusion, if the system uses the camera to detect certain pre-defined data, that would probably be a special image on the HDTV screen projected by the console, probably some colors changing or some kind of pattern or shape for the camera to lock on to. If we re-create the effect that the HDTV projects we can display it on a test PC monitor and scan that instead of the HDTV, we can therefore fool the controller into thinking the lag beta is only 4ms or less, bypassing the requirement for play, and (only speculation from this point on ->) making some games that use asymmetric gameplay wrok better for the GamePad guy because he doesn't have to use the HDTV and only
But I can see that nintendo probably already thought of that and won't apply the lag to the asimmetric guy for no reason ... oh wait, reason it is, nintendo will apply the lag in this mode as well, because it's would be cheating by technical design and that's not fair, the GamePad guy in asymmetric mode will have to suffer the low responsiveness to be equally fair as the other players with wiimotes.
So you can see how HDTV manufacturer's firmware that's designed in a way of easy developing insead of quality. They just make a buffer between each of the features the HDTV has and that's a lackluser and ignorant way of doing code. HDTV firmware is the sole blame for any lag that you will get, that includes all the other consoles, no PS4 no X720 are immune, everybody suffers from this.
Carmack explains:
Kotaku E3 2012 VR Video: Skip to 4:00 minute mark.
Carmack from Eurogamer's Uncut E3 2012 interview:
And then the other thing that happens, if it comes from sort of a consumer TV heritage, is - it's the bane of the gaming industry - all the consumer TVs buffer, add latency for features. They go, 'we want to be able to take different resolutions, we want to take different 3D formats, we want to do motion interpolation, we want to do deblocking and content protection'. And in theory all of these can be combined into one massive, streaming pipeline on there that doesn't add much latency. But realistically, the way they get it developed is they say, 'OK, you did HDCP, you did 3D format conversion, you did this,' and there's a buffer in between each one. Some TVs offer a gaming mode that cuts some of that down but even there it's still...
"48ms" comment at keynote:
http://www.youtube.com/watch?v=wt-iVFxgFWk&feature=player_detailpage#t=3274s
Nintendo may just indirectly cause a big public outcry over this, such a great opportunity; the fact that nintendo has a very effective way of exposing the HDTV latency and rightfully blaming the manufacturers for it and on a mass market scale, everyone with a WiiU will be required to scan the TV before play, it's genious and I can wait until the other developers speak about it publicly, and that may force manufacturers to get working if there's tons of people complaining, because carmack and others in industry are not very successful convincing the HDTV manufacturers into recognizing this issue, he's was bugging at sony to get their firmware fixed and I haven't yet made the full
Keynote 2012 video guide so I don't have the exact time mark at which point in Carmack's 2012 keynote he talks a lot of dirt about sony how he could not get anyone and was basically ignored, I only know it's after 1 hour mark, that's when he starts talking about VR.
So all of those X360 graphics boys out there, that used their brand new HDTVs bragging about their "1080p" setup on various forums and even increasing HDTV picture quality settings - they've all made a big mistake, playing for a waste of time in any competitive or serious match, bad idea , probably getting owned by a random CRT guy lol.