01.05 In Class Production Exercise

Assignment Deliverables

1. Exported 10 - 20 second H.264 encoded MP4 video with sound
   • Label file YYYY-MM-DD impossible co-lab video (.mp4)

Assignment Overview

REALITY GLITCH

In teams of three, create a 10–20 second continuous shot in which a photogrammetry scan interacts with the physical world in a way that would otherwise be impossible. Scan something that exists at CIA. Then use its digital double to create a 10–20 second impossible event in the real world. Everything must happen live in one continuous recording. No editing. Use a photogrammetry scan, a camera, a display, and physical staging to create an impossible relationship between the digital object and the real world. You may hide the display, crop it out, or deliberately make it part of the piece. No editing.

Your team must use:

1 physical location or object 1 original photogrammetry scan 1 performer or physical interaction 1 live manipulation of the digital object

No editing.

During recording, someone must manipulate at least one property of the scan:

position scale rotation opacity

So merely putting a static 3D object over a camera image doesn’t satisfy the assignment.

Glitch Camera App

Reality Glitch Camera  

This is not augmented-reality tracking.

The scan is essentially attached to the camera image, not fixed at a coordinate in the physical room. If the student swings the phone to the left, the virtual object doesn’t automatically remain sitting on the physical table.

Use the following methods to potentially conceal or use the edge of the screen.

• fill the camera frame with the screen
• physically mask the screen
• make the screen itself part of the fiction

Teams can combine digital overlay with:

forced perspective; camera moves; covering the lens; physical props; hands passing in front of the lens; synchronized performer movement; live sound; walking toward/away from camera.

For example, the performer pretends to throw an object and the digital puppeteer sends the scan flying upward.

Prompts using the Glitch App

A tiny sculpture floating above someone’s hand. One student frames the hand while another pinches the scan smaller and positions it over the palm.

A giant chair floating outside the building. Point the camera through a window, scale the chair enormously, and position it over the landscape.

A ghost copy of an object. Physical object sits on a table while a semitransparent scanned version floats above it and rotates.

A digital object escaping its original object. Begin with the scan aligned approximately over the physical object and then drag the scan upward while the physical object remains still.

An impossible falling object. Start a giant scan high in the frame and drag it downward while the performer reacts.

A floating head following someone down the hallway. This becomes especially funny once you have the EinScan head scans available.

A huge head appearing behind someone. Performer walks through the physical space while another student scales/repositions the scan live.

A digital twin that refuses to behave. Align scan and physical object, then have the real object move one way while the student manipulating the scan moves it another.

A ghost passing through a person. The simple version can’t do proper depth occlusion, but opacity makes the fact that the model renders over the person much less objectionable.

An object that changes size while being handed to someone. Have the performer mime holding/interacting while another student pinches the scan larger and smaller in real time.

Co/Lab Teamworks and Collaboration

That creates an interesting division of labor all by itself:

Camera operator + performer + digital-object puppeteer

Grading Rubric