Setting Up a Virtual Camera | Vive Pro + UE4

published on July 17, 2020

So I've hooked up the vibe tracker to Sinha tracer we got everything up and running here and I'm operating the virtual camera and one of my city tracer scenes and this has like a really cool effect when you're operating in it's a lot of fun

Hello and welcome to this virtual production vlog we're on our third one here pretty good series so far but today we're gonna get this virtual camera up and running using the vive pro the vibe tracker which is this guy right here and

We're gonna get that into Unreal Engine and maybe a de Sena tracer okay so now everything is unboxed from the vive pro we have these two base stations these are basically sensors that are keeping track of where everything is this is the

Head mounted display the hmd right so this is where you put this on and you're here in the video game sort of and these are the two motion controllers so if you've never used VR before the great part about it is that the system is

Always tracking the position of these and their rotation and there's a bunch of buttons on them too so I can use this for the virtual camera as well so I'm going to put the vive sensors the base stations in the corners of the room so

We're gonna put one there I know this is kind of disorienting but I'm just filming it anyway and we're gonna put one there so this is for all you grips out there I have these two types of scissor clamps here this one's kupo this

One's made by owls oh and these ones are a little smaller and they come with these little cable clamps too so those are for drop ceilings and then the end goal is to get this you know this base station with a cord of 20 in it we have

Baby 2/4 20 with a little adapter there and we'll put that there and as long as it doesn't wobble and it's stable I think everything's gonna be okay okay the second one is installed here I'm gonna peel off the old wrapper so I

Just got the second sensor over there and this one is here so that gives me basically this entire floor area to work with I think they're gonna be pretty stable as long as you don't pull on the cable you see I have some like some drop

Ceiling kind of like relief mounts for the cable and then this one comes down it's on the wall that's what I had to do it's not the best I kind of command strip there and okay so after about like two hours of messing around I have the

Base stations installed they look really nice actually and I changed my camera rig to actually use the controller now and this came from a comment on Instagram I forget the person's day maybe I'll I'll shout them

Out but the controller it does the same tracking you don't have to buy the vibe tracker for people that want to do this in cinah tracer Unreal Engine and then you actually have controls so I can like change focus and focal lengths and stuff

With the controls on the controller it's just makes more sense so this this is a Redrock micro cage here from my 7d and I just basically have two clamps on here so this is the valve controller right and I just have it so that you can like

Super clamp it in like this I think it works pretty well you also want to get the controller so that the sensors here are seen by the base stations so before I had it like kind of low this keeps it on top so I will show you the first

Prototype I made an unreal engine in like a new project I'll show you basically how that works it's really really easy and then I'll be integrating this same exact set up into Cinna tracer that I can't show you

That's pretty complicated those cameras are like massive blueprints but let's check out how the virtual camera works in a stock Unreal Engine setup and then yeah Sinnott racers now baby so this is my test virtual camera setup the first

One I made and I made an actor that basically has a camera in it and that's it and all you do literally is ask for the position and rotation of the track device which is the

Controller and then you set the camera rotation in position to that that is it that's the whole setup I mean I'm gonna do a lot more than this in cinah tracer but this is like the backbone of how a virtual camera works with a vibe or

Really any any tracking system okay so I'm gonna pick up my virtual camera now you can see that the vive is tracking it right so there's this controller and it needs to be seen by that station and the one over there

I can probably add more and we are doing our very first virtual camera and that's a boring one I can't change focal length I can't focus I can't do any of the Signet tracer trickery i have built-in but it is the prototype for sure' I'll

Put it on my shoulder like this to the mannequin all right so I can kind of walk around him pretty cool right and so you get a different rotation than you would if you were just like animating this as a free camera there's a lot to

Talk about there but overall you could hand this virtual camera to any filmmaker who's used to being hands held like this which is a lot and they should be able to come out and pick out some shots here like this they don't have to

Know anything technically right I'll make it so you can zoom in and focus and all that stuff okay so now I've got the virtual camera set up with Senate racer here so we're picking up our virtual camera here

I think the heights a little bit off but you can see now that the vive tracker or controller is working and I've mapped it now to a camera and Senate racer so with the controller I can zoom out or zoom in and then I can just kind of wander

Around this scene like I was in the real world look at this zoom at its maybe here it's like a reasonable little shot so this is the mocap from the floor with a Roca go suit so I've hooked up the virtual

Camera to Sinha tracer as you can see right now so this is technically already possible in Senate rates are in the hands health gives us a whole different vibe right this is the mocap from yesterday that we

Did with the rope we're Koko suit and I can change focal length with the controller I can zoom in I'm gonna come a little lower all right like this pretty awesome any framerate drops or mostly because I'm

Ray tracing a bunch of the lights just to make them look good the capture latency is really not noticeable and so it's all lighting performance right now but I wanted to make a scene that looked like kinda realistic

Alright so his focus is often to change to his focus and so we'll come in for a little side shot over here for him look at this and a handheld gives it like really cool like a really cool look you could put this now on a tripod and get

Natural tripod movement on a crane Steadicam if you wanted to and it's pretty similar to how they shot The Lion King with virtual cameras ok so that is gonna wrap it up for this virtual production vlog this got way crazier

Really faster than I thought it was going to I didn't know how long this is gonna take me to do it's not very hard to do an unreal engine at all the Signet racer pirate that's that took me a couple years but just getting the

Tracking into Unreal Engine is like super seamless and I wasn't sure if this was gonna become like an actual Senate racer feature or it would be like you know just use it in Unreal Engine but you can 100% just do this and Senate

Racer now like fully crazy I think I said it already you just need Sinha tracer signatures is already on Steam so you'll have steamvr what you need and then a vibe just got any old vibe you don't need as much room

As I have here either you don't even need the rig you could just use the controller if you wanted to but um this is gonna be like a very like consumer prosumer way of doing virtual production with a camera like this and Trust it's

Very different like you can use the mouse and the keyboard the Xbox controller those are great but once you use it with the vive controller it just takes on a whole different feeling and if you want to operate

Cameras with like a tripod you haveyou can do that just stick this on the tripod on the crane and the movement you get from it is just really interesting and I think it's also just a lot more realistic to walk around the scene in 3d

With the hand-held camera like this it's just you just get this like you know parallax thing I'm moving back and forth it's like as close as you're gonna get to being in VR without actually being in it is using motion controller and then

Looking through one of these cameras it's a kind of incredible and also combining this with the Rococo animation I mean it's like this is getting kind of kind of nutty and I think the next integration I'm going to try which looks

Pretty easy is to film with this camera live while we also use Sena tracer and puppet one of the characters with the suit live so this would take two people obviously one person on the camera one person in the suit and I think that's

Good work and Sena tracer I think that's gonna be okay definitely works in Unreal Engine there's no question there but equally excited to get it working in Senate races so yeah we got the vibe up and running we got the virtual camera up

And running it works in San Andreas are like this is this is crazy this is crazy so yeah I'm kind of speechless myself I just got done filming and it's crazy it's really crazy okay I'll see you guys on the next vlog

Related Videos

You you hey guys welcome back to the first livestream of 2019 hopefully we're live I think the twenty second delay is just it's weird to get used to but...
In today’s tutorial we’re going to be looking at the 360 workflow and a couple of features HitFilm has to offer. The link in the description will provide a 50% ...
In this video we're going to take a look at the new features that were added in version 2 of Imerge Pro. You can learn more from the blog post on our websit...
Today we're taking a look at the upcoming features in the version 12 update for HitFilm Pro and Express the update will be coming out later this month but w...
Green screen is used in all types of movies, to put actors in places that would otherwise be expensive or impossible. Maybe you’ve filmed your subject against a...
So you’ve filmed your subject against a green screen, and you’ve successfully brought it into HitFilm and keyed out the green. But you’re not done yet- the comp...
Hi, I’m Axel from FXhome, and this video series is going to answer the question, “How do I use masks in Imerge Pro?” This video will examine how we can use Grad...
Hi, I’m Axel from FXhome, and this is the second part of our series on Masking in Imerge Pro. So if you haven’t watched the first video yet, I encourage you to ...
Hey guys, welcome back to another HitFilm tutorial. Alita Battle Angel recently launched and in this film they took CG and mo-cap to a completely new level to r...
Lighting your shots correctly is one of the most basic, but often overlooked, things you can do to make your videos look better. It doesn’t matter what type of ...
That clip comes from our new short classified mission renegade over the next few weeks we'll have tutorials for the effects you see in renegade and today we...
In this tutorial we’ll be covering how to create the bullet hits effect from our latest short, Renegade. This scene used stock footage from ActionVFX, who have ...
A good title sequence can help set the mood for your film. Today we'll be taking a look at how we creatd the title for our short film, Renegade, using stock...
When we made our latest short, Renegade, we knew we wanted to include a Mission: Impossible-style timer. In this tutorial we’ll take a look at how to create one...
Hey guys, welcome back to another video. Today we're going to be covering the behind the scenes stuff of Renegade; how we did it, what happened and what we ...
Hey guys, today we're going to be looking at the VFX Supervisor and how you can prepare for visual effects. When producing visual effects it’s never as simp...
Hey, this is Axel from FXhome, here with a tutorial on using Blend Modes for grading. We will be looking primarily at Imerge Pro in this tutorial, but the techn...
In today’s tutorial, we’re going to be looking at satellite surveillance and image stitching. In the example sequence, I use footage from a DJI Spark for my end...
A shaky camera can be a good thing or a bad thing, depending on the type of film you’re trying to make. It can increase the feeling of danger and put you right ...
Today we're going to be talking about camera psychology. They say a picture is worth a thousand words, and in the realm of film production that couldn’t be ...