Well, we have MVP. I made a mixed reality trailer of my favorite game, Space Pirate Trainer!
Some problems with it. It defaulted to flac, not mp4, so I can’t edit it with the software I know. The capture card for some reason is sending up very choppy images, so it looks like I’m moving around in some kind of weird time bubble. I have no idea why. The chroma key detecting the screen is pretty sloppy, which is probably due to the lighting, which needs improvement. I only have one green screen, so you can only see one vector instead of a whole bunch. The camera angle is lousy, and too close, it needs to be set farther back and up more. This will mean re calibrating it but I’ve kind of got the process down from doing it 30 times today. What else. There’s probably a scaling issue between the two cameras, I don’t think they’re mapped perfectly, I was kind of guessing at the resolutions, but until I get the image less choppy there’s no way to know for sure! Other than that… well, see for yourself. I dodge lasers like a pro, and got a new high score, 14900!
There’s more than one way to do mixed reality, and my approach was a kind of hodge podge of other techniques pioneered by my colleagues. The point is, there’s an unlimited number of correct ways to do MR, and a hundred ways for me to improve my process. This is just a first step and it was lots of fun taking it!