01.05 Reality Glitch In Class Production Challenge Assignment

Assignment Deliverables

1. Exported 10 - 20 second video with sound captured in a single take, without any editing, or post-production
   • Label file YYYY-MM-DD impossible co-lab video (.mp4, .mov, .webm)

Assignment Overview

In teams, create a 10–20 second continuous video in which a photogrammetry scanned 3D mesh interacts with the physical world in a way that would otherwise be impossible.

First, make an original photogrammetry scan of an object or feature at CIA. Then use its digital double to create a 10–20 second impossible event in the real world. The goal is not simply to display a 3D scan. The scan must participate in an event or interaction that changes during the shot. Your team should create a short impossible event by coordinating the camera, a performer or physical action, and live manipulation of the digital object.

You can use any practical, physical, or in camera effects but everything must happen live in one continuous recording. No editing. You may hide the display, crop it out, or deliberately make it part of the piece. You can optionally use the Reality Glitch Camera   to place and manipulate that digital scan within a live camera view.

Required Elements

Your video must include:

• 1 physical location or object
• 1 original photogrammetry scan (The scan must be created by your team during class. Do not use a downloaded 3D model or a scan made before class.)
• 1 performer or intentional physical interaction
• 1 live manipulation of the digital object
• deliberate sound
• one continuous 10-20 take (You may rehearse and record multiple attempts, but the submitted video must be one continuous take.)

During the recording, the digital scan must visibly change its relationship to the physical scene. This may happen through live manipulation of position, scale, rotation, or opacity, or through coordinated movement of the camera, display, performer, or physical objects.

Simply putting a static 3D object over a camera image doesn’t satisfy the assignment.

Reality Glitch Camera App

The optional Reality Glitch Camera   combines your phone’s or laptop’s live camera image with an uploaded 3D model. You can move, rotate, scale, change the opacity of, and manipulate the scan while recording a single continuous shot. It does not automatically anchor the model to the physical world, so one team member may need to operate the digital object while another moves the camera or performs.

Reality Glitch Camera  

Co/Lab Teamwork and Collaboration Roles

A three to four person team naturally divides into:

1. Camera Operator - frames and moves the camera.
2. Performer / Physical Operator - interacts with the real environment, object, or digital scan.
3. Digital-Object Puppeteer - manipulates the photogrammetry scan live during the recording.

These roles can overlap or switch between attempts, but the final shot should show clear coordination between the physical and digital action.

Creating the Illusion

Think about how the digital scan, physical space, camera, and performer can work together to create a convincing or intentionally strange visual relationship.

• fill the camera frame with the screen
• physically mask or conceal the edge of the screen
• crop the screen edge out through framing
• deliberately make the screen itself part of the fiction
• use forced perspective
• move the camera
• briefly cover the lens
• use physical props
• pass hands or objects in front of the lens
• synchronize performer movement with digital movement
• use live sound
• move toward or away from the camera

The illusion does not need to be technically perfect. Instead, use framing, timing, performance, and live manipulation creatively.

For example, a performer could pretend to throw an object while the digital-object puppeteer sends the scanned version flying upward.

Example Challenges and Concepts

These are starting points, not recipes. You may combine ideas or invent a completely different solution. The strongest work will use the limitations of live recording as part of the idea rather than trying to imitate polished visual effects.

Floating Miniature

Make a sculpture appear tiny enough to float above someone’s hand.

One student frames the performer’s hand while the digital-object puppeteer scales the scan down and positions it over the palm.

Giant Object

Make an ordinary object appear enormous.

For example, point the camera through a window, enlarge a scanned chair, and position it so that it appears to float outside the building.

Ghost Copy

Place the real object in the scene while a semi-transparent digital version floats above it, moves, or rotates.

Digital Escape

Begin with the scan approximately aligned with its physical counterpart. During the shot, pull the digital version away while the physical object remains in place.

Impossible Falling Object

Begin with an oversized scan high in the frame. Drag it downward while the performer reacts as though a giant object is falling toward them.

Floating Head

Move a scanned head through a hallway while a performer walks underneath or reacts to it.

This can become especially effective once the EinScan head scans are available.

Giant Head

Place an oversized scanned head behind or beside a performer. Reposition and scale it live as the performer moves through the physical space.

Misbehaving Digital Twin

Begin with the scan approximately aligned with the physical object. Then move the real object in one direction while the digital duplicate moves somewhere else.

Ghost Passing Through a Person

Move a semi-transparent scan through or across a performer.

The Reality Glitch Camera does not provide true depth occlusion, so opacity can help make the overlap feel intentional.

Changing Size During an Interaction

Have a performer mime holding, carrying, catching, or handing off the digital object while another student scales it larger or smaller in real time.

Capture to Production deadline

For this in class challenge exercise, time management is part of the learning.

• By 1:30 p.m.: your team should have a scan processing or completed.
• By 3:30 p.m.: your team must have at least one complete video attempt.
• Final 30 minutes: revise, record final attempts, label, and submit.

Grading Rubric

Assignment Resources

Reality Scan Mobile Photogrammetry Tutorials

• Object Masking Photogrammetry Capture - Reality Scan Tutorial  
• Indoor Photogrammetry Capture - Reality Scan Tutorial  
• Outdoor Photogrammetry Capture - Reality Scan Tutorial