www.ssontech.com Forum Index www.ssontech.com
SynthEyes Camera Tracker Forum
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Camera setup and calibration for Motion Capture shoot

 
Post new topic   Reply to topic    www.ssontech.com Forum Index -> Shooting for VFX (NOT TECH SUPPORT)
View previous topic :: View next topic  
Author Message
loocas



Joined: 21 Mar 2009
Posts: 18
Location: Prague, Czech Republic

PostPosted: Sun Nov 06, 2011 8:19 am    Post subject: Camera setup and calibration for Motion Capture shoot Reply with quote

Hi there guys,

I'd like to ask a few questions about a shoot I'm about to supervise, that'll require us to precisely track the camera motion.

The requirements of the shoot call for a supervised tracking via a witness camera setup, I'm about to build and deploy on set.

The problem is, I'll need to track the real camera as it moves in the scene using ONLY these witness cams. I'll do this similarly to what The Mill used in their City Harvest spot.

I'll build the tracking "tripod" etc... but, I only have experience with this kind of a setup in a regular motion-capture environment using on-line software, such as the Arena, but, I won't have the mo-cap setup available for this shoot.

I'll use a number of regular Playstation 3 Eye Cams (I'm thinking 4-6 cams) to setup so that they can clearly see the entire set. I'll sync-record everything using the iPi capture software, but then I'll need to track and solve everything using SynthEyes. My questions are:

1) I'll need to first determine where the cameras are. This is usually done in a regular mo-cap scenario by randomly waving and moving around a special "wand" with tracking markers, the software then calibrates the setup and solves the cameras' positions automatically.

2) Determine the ground plane. Again, usually this is done by tracking a rigid "tripod" that I can easily take and place on the ground. This, again, happens pretty much automatically in the regular mo-cap setup. I'm sure it can be done in SynthEyes, but I've never done that in SE before.

3) Lastly, when all this is done, I'll, obviously, need to track the real camera which will have the marker "tripod" attached to it. I imagine when I load up the solved scene in SE and load up the six source videos in there, I'll be able to precisely solve the "tripod's" position in space/time.

This is all I need. I know it can be "easily" done in a regular on-line mo-cap studio, but I'll be limited to offline imagery provided via PS3 EyeCams (6 I think will be enough) at 60fps or even 120fps (though the resolution will be 640x480 or even 320x240 respectively)

Can anyone tell me this is possible to be done with SynthEyes?

Thank you very much in advance, best...
Back to top
View user's profile Send private message Visit poster's website
borgus



Joined: 30 Dec 2009
Posts: 144
Location: bremen, germany

PostPosted: Wed Nov 09, 2011 6:21 am    Post subject: Reply with quote

Hi Loocas,

are you sure that you wanna do that with playstation cameras? I've
played around a abit with ipi studio/ ipi recorder and wasn't able to get a good sync of more then three cameras. The other questions is how do you wanna use the produced footage to track in syntheyes due to heavy compression and the way the camera images are layed out in the final "image stream". You'd have to edit the recorder output and split it off
in seperate sequences... Did you test the basic workflow before?

Seb
Back to top
View user's profile Send private message
loocas



Joined: 21 Mar 2009
Posts: 18
Location: Prague, Czech Republic

PostPosted: Wed Nov 09, 2011 7:07 am    Post subject: Reply with quote

borgus wrote:
Hi Loocas,

are you sure that you wanna do that with playstation cameras? I've
played around a abit with ipi studio/ ipi recorder and wasn't able to get a good sync of more then three cameras. The other questions is how do you wanna use the produced footage to track in syntheyes due to heavy compression and the way the camera images are layed out in the final "image stream". You'd have to edit the recorder output and split it off
in seperate sequences... Did you test the basic workflow before?

Seb


Hi, thanks for the info.

I'm testing the workflow and setup today.

Unfrotunately there is ABSOLUTELY NO TIME for me to prep for any other situation. The shoot is going to be extremely hectic, chaotic and problematic. This is the only solution that I could come up with on such a short notice (saturday 10pm the director decided for this type of shoot, on sunday I did my research, monday - ordered parts, tuesday - got the parts, today - testing, tomorrow - setup at the atelier, friday - shoot).

The editing isn't really that big of a deal, a simple Nuke gizmo will do the trick for me. The low res picture shouldn't be a problem either.

I don't think the data itself should be an issue. If shot properly (which is what I'm afraid of most). I wasn't really sure about the SynthEyes workflow then as I am not a pro tracker, I use SynthEyes for simpler stuff mostly.

There is no other way I'll be able to extract camera position data without motion-capture (which I cannot get for the shoot for budget and time reasons).

So, this is all I've got. Smile
Back to top
View user's profile Send private message Visit poster's website
borgus



Joined: 30 Dec 2009
Posts: 144
Location: bremen, germany

PostPosted: Wed Nov 09, 2011 7:42 am    Post subject: Reply with quote

hmm... ok. I've just checked the latest ipi recorder and the sync is no
problem anymore... that's good to know Smile

you definitely need more points to calculate the camera positions in syntheyes, so you
need something like the porcupine-ball (there's an image of it in the manual).
As far as I know Syntheyes mocap solution only works with three cameras,
but I might be wrong!
Back to top
View user's profile Send private message
loocas



Joined: 21 Mar 2009
Posts: 18
Location: Prague, Czech Republic

PostPosted: Wed Nov 09, 2011 7:50 am    Post subject: Reply with quote

borgus wrote:
As far as I know Syntheyes mocap solution only works with three cameras


?? What do you mean? I thought the more video sources, the better for the tracking session.

This will be a manual tracking task anyways.

I imagine it this way:

1) I shoot with the witness cameras the actual RED cam on set with several ping-pong balls illuminated from inside (due to dim lighting conditions on set)

2) I'll be recording 6 Eye cams simultaneously (please, don't bring up action synchronization questions, I've been having nightmares about it for the past couple of days)

3) I'll edit the recordings so that I'll have six individual views of the set for SynthEyes.

4) I'll pre-record some calibration moves of myself before anything else to use for proper scene orientation and calibration.

5) I'll manually track all the markers on the camera (provided there will be little occlusion)

6) Solve the RED cam movement and align it according to my setup calibration I'd tracked and solved before.

7) I'll be happy and save my team a ton of manual work... we'll all go for beers. Smile
Back to top
View user's profile Send private message Visit poster's website
Display posts from previous:   
Post new topic   Reply to topic    www.ssontech.com Forum Index -> Shooting for VFX (NOT TECH SUPPORT) All times are GMT - 4 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group