Hiển thị các bài đăng có nhãn Leap Motion. Hiển thị tất cả bài đăng
Hiển thị các bài đăng có nhãn Leap Motion. Hiển thị tất cả bài đăng

Thứ Sáu, 1 tháng 8, 2014

Leap Motion uses the Force to control your Virtual Augmented Reality and beyond!



Want to manipulate and view a 3D virtual and augmented reality display with the power of your hands, a finger or a chopstick? You are going to sooner than you think for the field of VR and AR science has just surpassed the science fiction made famous by the likes of Spieldberg's bleak and dreary Tom fest Minority Report.. 

Minority Report is a film memorable only for that one scene where our anti hero is using those gloves to control that display. In 2012 we are not only more or less are on our way to having the wall sized display sorted , the science has surpassed the science fiction  right now we do not even need a wall to display a wall sized display ! For we have in the form of the smd ST1080 a 180g wearable virtual and augmented reality display bigger than the one Maverick is using in Minority Report ...or his ego in Top Gun and in actual size not much bigger than his Raybans ...somebody stop me...

Currently I am controlling whatever I throw up on that display using traditional mouse, keyboard, joypad controls,thinking of Kinect,IR,Move and other inputs. Reaching down for the input method the complete VR or AR experience is just not happening..

Then I  Google+d on Leap Motion and this 


What you are looking at here is someone controlling a traditional 2D monitor set up, but we now have 3D 1080p hmds like the ST1080, imagine wearing your display and exploiting all  control options and possibilities that the Leap Motion brings to a head mounted display user . The Leap can see down to your individual finger or tip of a pencil level using this in conjunction with head mounted displays like the ST1080 is going to be an obsession for me in the next few months. I can approximate control like this with kinect at the moment the level of control shown on display here hooked up to Windows 8 streaming to a tablet like the new iPad linked wireless through Apple TV to the transparent ST1080 which  is just 180g, portable, powered by USB and you have your perfect wearable augmented and virtual reality computer ... Philip K Dick would be proud and this is a point where the science actually surpasses science fiction in our life times. Nerdvana has been attained.... 

On the ST1080 controlled with the Leap you could actually manipulate objects in augmented reality thanks to the transparent display , you could also beam the image from the camera of your phone or tablet , so if you are using LAYAR or Google Goggles or other AR apps you can now manipulate them on your ST1080 only now with the magic of your hands or even favourite Harry Potter wand or chop stick : Lost  in New York you could impose an augmented 3D image or map of the City and move in it virtually whilst you were you were moving in it actuality ..Look for shops , look for face book friends , find the place where you are meeting and watch in 3d as they close in on your location..  I could do this now wearing the ST1080 but I have no way to control the display on the move , i do if I have the leap connected to my Raspberry Pi or Windows 8 tablet in my pocket or backpack ... 

Then consider that the portable head mounted display, the ST1080 is a 1080p 3D display and paired with the Leap, with Tridef 3D turning your experience into 3D, you just got your first 3D virtual reality and augmented reality world that you can manipulate with your hands or a light sabre if you have one lying around ... That 3D world that you can now manipulate of course could be occupied by anything, 3D games and sports, 3D work, CAD ,modelling , design and of course the obvious which I do not need to mention... 3D google maps ..what ? what did you think I meant .. 

Right now videos only exist showing the Leap controlling 2d displays , but I have several 3D hmds that are dying to be paired up with the Leap , so I have written to the makers of Leap Motion and pre-ordered one too and as soon as I get hold of a developer or retail version I will be throwing up videos and reviews of usage scenarios and the endless possibilities a control unit like the Leap Motion brings..

By the time the Leap Motion hits retail in Feb 2013 , the hmd will have evolved to have a 4K resolution, a 4k resolution 180g wearable portable display that you control with air ... Just make sure you get your eyes in shape. 

The possibilities for an Obama fly swatting, or Miyagi San chopstick fly catching games are endless just remember not to take out your screen or the person in front of you if you are wearing a hmd ... 

And how ...how could I not mention the Force .. the force lightning ,grip, Jar Jar slapping possibilities too are endless and totally independent of your Midichlorian count... mesa   Jedi now too massa Anniiiee.... For Sith George WHY?

Like I said this is way beyond Minority Report,a little ahead of Johny Mnemonic and even the legendary AR VR sequence in that great Michael Douglas /Chricton/Demi Moore sci fi epic Disclosure ... truly a point where science is about to outpace science fiction... finally ..again..maybe.

The natural user interface is evolving alongside the hmd and the touch and gesture based OS that is Windows 8 and tablet/phone operating systems, so we are at the most exciting point for developers in a long time the true potential of this device lies not just in manipulating virtual clay and molecules but in the community of developers that Leap Motion is building which will throw up usage scenarios the designers never thought of, Jar Jar Slapping and Obama-swat-a-fly are just my initial contributions...

More to follow when and if Leap Motion get back to me... All in all 2013 with the arrival of Windows 8, 4k hmds like the successor to the ST1080, (the ongoing review for which you can check to the right of this ), Project Glass and the likes of the Oculus Rift is going to mark the birth of the cyberpunk for real ... gentlemen and ladies get your decks ready... now all we need is a few AIs and Rastafari in space and the prophecies of William Gibson will have been fulfilled ....

check out  Leap Motion now



Thứ Ba, 8 tháng 7, 2014

Leap Motion :combining Zeiss Head Tracking with Leap Motion hand recognition





So your Midichlorian count is lower than Jar Jar's granny's ? What hope is there for you old greying Padawan... once proud school playground/college dorm Jedi or Sith warrior now pegging all your Star Wars hopes on J J Abrams not Jonathan Fraking  Episode VII , VIII and IX ? You who dream of sending sparks of force lightning into your VR world from your AR hands....




Well today my  Leap Motion dev kit revision 5 .. arrived both cost and tax free , on time and it looks as close to final product as I can tell . 




Force Control Irrespective of Midichlorian count...

The Leap Motion is one PC motion controller that defies you not to use the word Force as an adjective,verb and noun every time you use it. Every time you use it you are conscious of all those times you wanted to test if the Force is strong in your family ..dreams shattered ever since George Lucas finally enlightened us as to actual source of  the all encompassing mystical energy that binds us together... Capitalism and a good franchise by your side..

Judge me by my size do you ? The LEAP is tiny, the size of a USB stick, just larger than a battery and weighing about the same ...




There is a gorgeous flat mini USB to USB cable too .. very cool 




The LEAP unit could easily be incorporated into a laptop trackpad or tablet bezel check out a size comparison between it and the Lenovo Trackpad below ..



These are my first moments with the LEAP and it is simple to set up, to fire it up at the moment you need to sign on as a developer ,download any updates and click on the LEAP tile in Windows 8 . The LEAP at present is not set up to take over your mouse or Metro wall control. This is a dev unit though so we are supposed to develop the code for this with the sdk..which is the point !  



Natural control :

As you can see I had no problems with the LEAP detecting movement, what was also impressive is how far I could lean back in my desk chair with the LEAP still detecting my hands. I read no instruction manual or guide, the whole ethos of this device is natural control .. of course developers have to come up with natural interface apps or control layers to apply to legacy apps. What I cannot stand about the old gen of motion controllers is all the unnatural crazy gestures ,waves and holds ..the LEAP is an opportunity for developers to make motion control mimic natural actions..Far more subtle actions . what if you are in are in Elderscrolls 6 and  your avatar is being asked how many dragon eggs you would like to purchase ?  you turn to look at the seller  using headtracking and raise three fingers , with the game recognising that you want 3 ..completely natural and so much more impressive than clicking on or thumb padding down to an option for 3 in an onscreen menu .. You could give silent hand signals and shoulder taps in Ghost Recon,Counter Strike GO or Call of Duty ...the fidelity of the LEAP will allow for this..something other motion detectors cannot.

Calibration
There was no need to calibrate the unit to my X220T's screen or for when I switched to using the Cinemizer OLED hmd , there is a very cool chopstick wielding calibration routine..but like the Carl Zeiss Cinemizer headtracker, really all I needed to do was plug the unit in. These devices represent the next generation of motion control and computer/user interfaces. As such little or no time is spent calibrating ..something which is a hall mark and barrier to every day use of the old gen of motion controllers like the PlayStation Move,Wii mote and of course Kinect.

Unlike the Cinemzer OLED headtracker which can mimic your mouse the second you plug it in ,with the LEAP there is still a software layer between you and the OS or apps you intend to control with leap motion, this is understandable as we are still at a dev stage.What I want to see is Microsoft think past the touch based interface of Windows 8 and start to incorporate VR control sets into Direct X. The same way they started to incorporate joystick input way back when.....

The LEAP will have specific apps developed for it and the fact that it does not default to mouse control emulation (yes there is an App for that if you wish) is a boon: 


Combining Zeiss Headtracking with Leap Motion hand recognition using the Cinemizer OLED hmd




Current hmd VR control interfaces whether the existing Cinemizer OLED headtracker or the yet to be released but now Jimmy "Knight's Crotch Gazing Incident" Fallon endorsed Oculus Rift are all handling VR control using head tracking combined with legacy controllers...but this not what people are expecting, they will want to reach out and touch those VR worlds.. 

The LEAP is the perfect way to do this using your hands ,being accurate and fast enough to recognize individual finger movement, palm curvature and a pencil or chopstick if you so wish. 

I aim to use the LEAP with hmds like the Cinemizer OLED, ST1080, combining  headtracker control with Leap Motion hand recognition and as soon as Palmer san gets my Oculus Rift dev unit to me with that too.

It should be a simple matter to use both in conjunction ..say to control a pilots field of view with the Zeiss Headtracker and to select individual targets ,switches and other virtual controls using the LEAP.. this is not just a device for catapulting aves after all..

And it is ...



Both the Zeiss headtracker and LEAP can be used simultaneously without conflict and without slowdown. I have only had time to do a simple test but there seems to be no issue in combining both forms of VR control . In the above video I use headtracking to move the onscreen cursor ..the white arrow ..whilst using the LEAP to detect my hand gestures , the video is recorded using FRAPS to capture the cursor movement and look for slow down in either control method when using both methods simultaneously.This is a simple test but you can glean that the LEAP hand tracking does not slow down or interfere with the Zeiss headtracker . So any fears you may have about the latency or lag from two motion controlled devices being used simultaneously should be assuaged. 

One of the things I asked the developers of the LEAP was if this would be possible ..and lo and behold it is.I intend to explore this further , this is just my first play woth the LEAP after all!There are so many possibilities ...  Using it with the transparent ST1080 display should prove very interesting ...though impossible to film..


We are at an interesting adjunct in the evolution of computer/user interface.. or VR in laymen's terms.

hardware : No dedicated gpus were used or necessary in any of my testing. Just an Intel HD3000 powered i7 Lenovo X220T .. After all VR is meant to free us from desktops and the cellars/bedrooms they traditionally inhabit... the LEAP worked fine using a 50 inch plasma. the 12.1 inch tablet screen and using the Cinemizer OLED hmd...

software : Windows 8 Pro likes the LEAP as you can see..

Evolution

Over the last year or so we have finally started to see how we will interface with new portable displayed and generated,wearable virtual and augmented worlds ..which admittedly someone has yet to code ...but are tantalisingly close to coming into being  .. VR and AR are here ..but operating systems have yet to catch up...and developers will have to transition users from legacy input devices to real VR and AR relevant input mechanisms..

I see combining use of  the LEAP Motion and Zeiss Cinemizer OLED head tracker  as part of this natural computer / user interface evolution. 

more to follow ...


this content is © and originated from thegameveda http://the-games-veda.blogspot.com/  if you are reading it from any other site that has not provided a link back it has been leached 

Thứ Bảy, 5 tháng 7, 2014

Preparing for VR: Combining LEAP Motion+Cinemizer OLED headtracking+Kinect Voice Recog in PS3 and Xbox 360 games





Ask not what Virtual Reality can do for you ask what you can do for Virtual Reality....This seems to be  the  mantra behind the burgeoning VR scene..and I wouldn't have it any other way ...




I have been using hmds now for almost two years on a daily basis, watched them evolve from the headcrab that was the HMZT1 through the ST1080 to the the Cinemizer OLED and my soon to arrive Rift ( come on Palmer keep calm and carry on!)  .Hmds are only part of the puzzle that is VR .. Another piece is how on Earth we each  personally interface with VR worlds,to do so we have to let go of legacy controllers like joypads ,keyboards and move beyond them assuming someone has managed to create those worlds ..which is yet another piece of the puzzle..


the moving finger moves...... 
We also have to move beyond the current obsession hardware developers have re headtrackers , hypothetical lag that exists or does not exist on pre release hardware or in software ... that itself does not exist outside pre alpha code..For VR to take off , it will take more than a fast headtracker hard soldered to your hmd circuit board sorry app devs ... For VR to take off the end user expects lag free headtracking, voice recognition, hand, palm, finger, thumb recognition ,the ability to include or add on legacy controllers and most importantly the ability to use all this with not only promised VR apps ( launching whenever they are ready) but with ALL the thousands of apps and games that we the users have spent our lives accumulating.. 


and having moved so does Kratos......!

The problem of lag/latency  if it is discernible when using your headtracking hardware is a problem that exists in that current hardware, to solve it either we wait for the technology to catch up to the idea of lag free headtracking and use brute force  ..or with current headtracker tech we offload the grunt work to the cloud or other hardware,which we can also use to tweak, accelerate ,adapt ,adjust or in some cases even slow down the headtracking.. 


The developers of Oculus have to be careful they do not talk their device out of existence with all the scuttlebutt on latency that is clouding the launch of the developer kits this week ...yes I have one coming too ! 


it's full of stars......that you move ! 
I have used headtracking now for 3 months . never experiencing latency or lag in any scenario , I have used LEAP Motion now for over a month and again never seen any discernible lag . In fact if you look through my diatribes on the Cinemizer OLED headtracker and the LEAP Motion I often talk of these devices being over sensitive and that is on what most core game developers would think is obsolete hardware...

I also do not have much time for the idea that VR hmds should only run specific VR ready code.... I always intended to use my hmds to interface with any form of display, OS, game , app or kitchen appliance/lawnmower ..I need to shoot latency free Force lightning from my Sith hands now ..not when Senior Carmack licenses the engine for Doom 5 to Gearbox or Rovio(laugh but it will happen) and as you will see I can ... 


The ability to shoot Force ligthning from your hands pales into insignificance compared to the true power of multiple combined  latency free VR control input mechanisms
errhm ...with all this in mind I set out to use my i7 X220T running Windows 8 to combine the Cinemizer  OLED headtracker AND LEAP Motion finger tracking on 10 year old hardware .. namely the PlayStation 3 and Xbox 360 ... 

So we are going to use actual games , play them with multiple VR leaning control methods 1. Zeiss headtracking 2. LEAP Motion  finger tracking 3.Kinect voice recognition  and throw in some legacy control too ...

Note I would use the Cinemizer OLED hmd to play these games in 3D and or the smd ST1080 ...to show you it works though I am filming off a normal home Plasma tv...!





Are we ready ? then let's see how we can combine headtracking , voice recog and finger tracking to play Xbox 360 games ...any Xbox 360 game ... and PS3 games ...any PS3 games...




1.Xbox 360+ Cronus+Bullseye + Win 8 running Bullseye+Dangermouse + Leap Motion for finger tracking +Zeiss Cinemizer OLED headtracker + Kinect connected to the console



Xbox 360 gaming with VR leaning controls :  

 



Halo 4 with LEAP Motion finger tracking and trigger action combined with Zeiss Headtracker FOV movement

Halo Anniversary lets us combine Kinect Voice recog , Leap Motion finger tracking . Zeiss headtracking AND play in OLED ghost free 3D on the Cinemizer OLED hmd...

Ikaruga played with LEAP Motion with the thumb click mapped to the trigger...my score's improving already....
Combining LEAP Motion+ Cinemizer OLED headtracking to play Xbox 360 games : 

Hand tracking combined with headtracking to play REZ HD,Panzer Dragoon Orta , Ace Combat 6, Halo Wars, Shenmue 2, Bastion, Radiant Silvergun




this may look good ...but it feels totally awesome when you play using the LEAP and or Zeiss Headtracker!
Panzer Dragoon Orta with LEAP Motion control  NB we could easily map the FOV shoulder movement to the Zeiss Headtracker too 

This is an example of where headtracking does not need to mirror real world head movement ..in a game .. Panzer Dragoon Orta uses rigid shoulder pad view shifts ..we could map these to left right turns of the Zeiss headtracker , and or we could also map the entire FOV control to the headtracker  , whilst we use the LEAP Motion to handle the targeting, weapon selection, or movement..

Rez HD playing with LEAP Motion ... now you can feel the vibes from the 360 controller in your pocket ..whilst playing the game with Finger tracking ...Matron!!!!!

look around or pilot your Ace Combat 6 planes with your fingers,hands or your head!
Before Ikaruga there was Radiant Silvergun...here played with LEAP Motion finger tracking ...I have yet to figure out what to do with the concurrent headtracking!


Combining Leap Motion+Cinemizer OLED headtracker+Kinect Xbox 360+Legacy control : 




This is very nearly the VR control Holy Grail,  using Mass Effect 3 :which lets us combine 3 VR leaning control methods : Kinect Voice Recogntion, LEAP Motion finger tracking and Zeiss Cinemizer OLED headtracking ... Note we are actually using 4 control methods simultaneously if you count the legacy Xbox 360 Pad.. If you really want to push it you could have Kinect on the PC too , with full body tracking in addition to voice, head and hand recog! (but that is for another time !) 




You should be able to see there is 0 lag that can be discerned by the user when combining LEAP Motion and Zeiss headtracker use on Xbox 360 games using this solution. And that we can if our games allow it also add voice recognition to the mix.  The Cronus and Bullseye combination is most impressive , there is no screen judder or delay when using our VR leaning controllers with this set up . I found it simple to tweak settings from Bullseye too . Lastly we can see that LEAP Motion runs parallel to any other form of controller that we want and we can use apps like Dangermouse running alongside them. 


So on to PlayStation 3 gaming with VR leaning controls ...


PS3+Cronus+Windows 8 i7 Lenovo X220T running Bullyseye+Dangermouse+ Leap Motion +Zeiss Cinemizer OLED headtracker +/- any other input we can connect to the PS3 or X220T!


Some of these controllers are not like the others... 




Combining LEAP Motion+Cinemizer OLED headtracking on PS3 to play Child of Eden 




How cool is that? Now imagine..well you do not need to imagine..just attach the Zeiss Headtracker to a Cinemizer OLED or ST1080 hmd and you can do all the above in OLED ghost free 3D ..or LCOS 1080p ghost free 3D... right now. 




playing Child Of Eden in ghost free OLED 3D with LEAP Motion and Zeiss headtracking is simply mind blowing!
  


Combining LEAP Motion + Cinemizer OLED headtracker in PlayStation 3 games test 2



Combining LEAP Motion+Cinemizer OLED headtracker in PlayStation 3 games Metal Gear Solid 3 , Metal Gear Rising , DUST 514,Uncharted 3, Crysis , Wipeout ,DYAD all tested with combined LEAP Motion finger tracking and Zeiss Cinemizer OLED headtracking 


you spin me right round ... 


right round....!


both Zeiss headtracking and LEAP Motion working in conjunction ...


you know for when Raiden goes to the dentist... 
LEAP Motion and DangerMouse,Bullseye and Cronus used to control Cryengine 3 Crysis on PS3 you should experience this in 3D!
Zeiss headtracker and LEAP motion used together to play Crysis on the PS3 ...no conflicts , no slow down ... no discernible lag
Using the Cronus both Cinemizer OLED headtracker and LEAP Motion can be used to play DUST 514 , being able to tweak settings from Bullseye also means we can do far more than with direct connection of a mouse and keyboard to the PS3
With Dust 514 I have already spent time using the the Zeiss headtracker directly connected to the PS3 , taking over the mouse FOV duties. With this new solution though we can do far more .. first we can set up both hands to control the game , in the video I had time to set the LEAP to the left thumbstick , which let me move the character and also to the FOV stick which let me move the field of view .. The Zeiss headtracker ran alongside the LEAP without issue .. this means we have plenty of VR leaning control options to combine and play DUST 514 .. what we are doing here is looking for and at new ways of playing.... moving your FOV around quicker than the next guys headtracker is not going to be enough to kickstart the VR gaming revolution...

VR gaming control is here ...


all that stuff you saw in movies like GAMER ... 

it is in your hands ...

and on your head too if you are using hmds... 
There is 0 lag or latency when using the Zeiss Headtracker and LEAP and both of them together to play MGS3 ! 

Snake responding obediently to the Zeiss headtracker ...as will Gabe .. and Sam too !!!
Using LEAP Motion to turn on my shield and the Zeiss Cinemizer OLED headtracker to steer and accelerate ....










What you see in the above pics are the subtle movements to the mm that LEAP Motion can pick up. Note though, we do not need all this power , what matters in making LEAP and Zeiss headtracking viable VR controllers is how we tweak those small movements and convert them to ingame actions that the gamer and not hardware developer with a slide rule expects ... We can get at this using the Bullseye software, the LEAP sdk, DangerMouse and the Zeiss headtracker sdk. But I purposefully did none of that .. because I want to come at this from a gamers point of view .. they want to connect these devices and play ..not spend hours updating drivers .. Yes you can on the developer side do all those things , but remember the Wii Mote took off not because people were measuring or adjusting it's lag but by the simple fact people were able to pick up and play . I have to say using the Zeiss headtracker and the LEAP is actually simpler than the Wii mote .. no drivers , no lengthy calibration routines ... 






As you can see there is no end to the possibilities of playing games with VR leaning controls and combining them, in Uncharted 3 I would be playing in 3D using the Cinemizer OLED hmd , moving the FOV with the Zeiss Headtracker and moving the character with LEAP motion .. in the video I have just the punch button mapped to the thumb click. LEAP Motion does gestures too, so a punch could actually be a punch ..steady on though we do not want to go the KINECT route ....! 

DYAD is one of the simplest games to demo LEAP Motion with , the response is excellent 0 lag! 


Leap Motion used to play God of War Ascension 




Whilst I was errh testing all this out, my God of War Ascension arrived and as I had everything set up and with the demo already installed,I thought I would give playing it with LEAP Motion a go ... And I was pleasantly surprised, these games tend to twist your thumbs off after a while so mapping one thumbstick to the LEAP was a revelation, suddenly I was jumping , and combo fighting with a twirl of my finger or hand movements or a click of my thumb. More than just a test , I found I was actually playing through a level .. using a VR leaning control method to play what is essentially (the epitome of) a side scrolling beatemup.. 

 Compared to the PS3s own motion control The LEAP is insanely fast even at this developer stage.

Note you could map both hands, 8 fingers, 2 thumbs, add voice recog for other commands using the method here .. Looks like I am finally going to finish some of my PS3 games ... VR style ... We have not even begun to tap the potential of the LEAP and Zeiss Headtracker !




Here is our test setup ...  should you wish to try this out for yourself...

1.Xbox 360+ Cronus+Bullseye + Win 8 running Bullseye+Dangermouse + Leap Motion for finger tracking +Zeiss Cinemizer OLED headtracker + Kinect connected to the console

2.PS3+Cronus+Windows 8 i7 Lenovo X220T running Bullyseye+Dangermouse+ Leap Motion +Zeiss Cinemizer OLED headtracker +/- any other input we can connect to the PS3 or X220T! Note you could connect the Kinect to the laptop and add full body tracking to your PS3 games using this setup...

Theory and Method:

They say you get lag and latency issues on the fastest of hardware , so I set out to use up to 10 year old hardware .. the PS3 and Xbox 360 to show otherwise...note even with direct connection of the Zeiss headtracker to the PS3 there is no discernible lag in any game you play.

The Cronus lets you use mice and other input methods on either console , the flaw is it has to be connected to a laptop or PC, allowing adjustment and user defined control setups through Bullseye software ..

But that flaw is just what we need to connect our VR leaning controllers and to take the load off the consoles looking to eliminate lag...the consoles do not have a clue you are using finger tracking to play God of War Ascension  or Halo 4 ...but hey that's consoles for you ...

Now since the Zeiss headtracker emulates mouse control this gives us headtracking in any game we choose on the consoles as I have shown before with PS3 ,PS2 and PS1 games  and  with Xbox 360 games  ...and yes it does the dof axes too but we wont be using them here

 True VR is going to require more than just headtracking ...we want to use our fingers thumbs and palms ... this is where LEAP Motion comes in ..erhh handy...

But how do we get it working with the Xbox 360 and PS3 ...we need the Bullseye to see it as a Windows controller ...say something simple ...like a mouse for instance...

DangerMouse is a java app that runs from a command line and gives you mouse like control using LEAP Motion only using your fingers in air ...

I had the idea of running this in parallel to the Bullseye software ..and it worked like magic ... the Bullseye and Cronus see the Zeiss headtracker and the LEAP Motion as Windows controllers ..mice in this case ..which through Bullseye we can easily map to any function of the Xbox 360 or PS3 controllers..

As the Cronus turns any controller you connect to your PC into a PS3 or Xbox 360 controller ..we can have multple VR inputs .

We can have BOTH headtracking and finger tracking control in ANY game ..

But that is not enough for VR we also want voice recognition and this we achieve through Kinect attached to the Xbox 360 .. Now the poor old ageing console can barely manage full body recognition but we don't care about that for we have the power of LEAP , what the Kinect can handle well though is speech recog ...

And thus we are ready to test not one but 3 forms of VR control , that will be essential for VR to take off in the consumer arena on aged hardware along with legacy control too..

If this seems a long way around, it is , deliberately so ... I want to introduce points of latency into the control loop to see if a) we can use 3 VR control methods together b) if there is any discernible latency or lag c) Asymmetry my dear Watson is the future ...using the cloud or a higher powered device(our laptop )  to do the grunt work for a lower powered or closed device(our PS3 and Xbox 360) that could not handle it ...and most importantly d) So I can stop asking William Gibson are we there yet?

I could also have substituted GIMX for the Cronus and used a wireless solution ( but that is for yet another day)

So developers, take some time off using your slide rules , grab your favourite game and gaming device , take some time to actually test out all the multiple forms of VR leaning control . Actually play something and then go back to the lab... 


If the development of VR continues along a path where all talk is dominated by problems, problems, problems we may just miss the simple and obvious solutions staring at us ...

I have not even begun to tap the potential of this way of playing games, more to follow !

And good luck with the launch Palmer and Co !

Thanks to Zeiss for the headtracker ,LEAP Motion, DangerMouse , the developers of Cronus 

More to follow .. 







 Purchase  in the UK/EU the Zeiss Cinemizer OLED 3D iPack including iPhone adapter and in the USA the Cinemizer OLED






























this content is © and originated from thegameveda http://the-games-veda.blogspot.com/  if you are reading it from any other site that has not provided a link back it has been leached