02.07 Photo Matching Site Specific 3D Visualization Assignment

Assignment Deliverables

1. Composite image of 3D model in outdoor location. (.jpg, .png)
   • Label file YYYY-MM-DD Lastname Firstname 3D Composite outdoor
2. Composite image of 3D model in indoor location. (.jpg, .png)
   • Label file YYYY-MM-DD Lastname Firstname 3D Composite indoor
3. Composite image of 3D model in location from Google Street View. (.jpg, .png)
   • Label file YYYY-MM-DD Lastname Firstname 3D Composite street view

Overview

This assignment is designed to help you develop skills in using fSpy, Blender, Photoshop, Adobe Substance 3D Stager, and Google Street View to create realistic visualizations of potential public art installations. You will learn how to photo match images for outdoor public spaces or indoor gallery environments using fSpy and utilize your previous modular form 3d model arrangements as large-scale sculptures. The goal is to understand site context and how your sculptures interact with the potential environment.

Instructions

Collect Photos

1. Choose three different potential sites for public art installation:
   • A photo of an outdoor location where public art might be installed. This photo should be taken by you.
   • A photo of an indoor gallery or public indoor space (e.g., a museum lobby, a large hall, or a gallery space). This photo should be taken by you.
   • A screen shot from Google Street View to choose a location in a distant city or country for a potential public art installation.
2. Use Photoshop tools and generative fill to remove unwanted elements from the photos and correct levels and white balance as needed.

Photo Match with fSpy and Blender Render

1. Import each image into fSpy to set up the correct camera perspective
   • Photo Matching with fSpy
2. Import the fSpy file into Blender with the fSpy Blender Addon.
   • Place 3D Model in 2D Photo Blender
3. Append or insert the 3D models of your modular form arrangements from the previous assignment.
   • Import obj into Blender  
   • Reconnect Textures in Blender  
4. Scale and position the 3D models within the Blender scene to simulate how they would look as large-scale sculptures in the real-world environment.

Texture and Lighting

1. Apply the scene textures from your reference image onto simple 3D geometry that matches the scene (e.g., ground planes or building facades).
2. Create an emissive texture using the image texture to simulate a pseudo HDRI lighting setup. This will allow your sculpture to reflect the colors and light from the environment.
3. Adjust lighting and shadow settings to match the scene’s natural light conditions (e.g., sunlight for outdoor, gallery lighting for indoor). Pay attention to the size, shape, height, and falloff of the lights so they match the existing lights in the background photo.
4. Use HDRIs for the sky for outdoor images. You can create an HDRI from a photo   in Adobe Substance 3D Stager.

Rendering:

1. Render and composite an image for each site. Use Blender and/or Adobe Substance 3D Stager to render.
2. Use Photoshop and other image editing tools to further composite and touch up the renders. Adobe Substance 3D Stager can export a PSD file with multiple layers for straight forward composite post processing.
   • Export Material, Object and Depth Masks from 3D Stager to Photoshop  

Assignment Resources

Notes

• Pay close attention to scale when placing your 3D models in the scene.
• Experiment with different lighting setups to see how they impact the interaction between your sculpture and its environment.
• Try using Blender’s compositor to enhance the final render, adjusting color grading and exposure as needed.
• Blender units default to meters while Adobe Substance 3D Stager defaults to centimeters. For real world scale in Substance Stager change the export scale in Blender   to 100 to export in centimeters.

Guides

Adobe Substance 3D Stager

The assignment can be completed using Adobe Substance 3D Stager.

• Street View 3D Model Render Composite Adobe Substance 3D Stager  
• Interior Scene 3D Model Render Composite Adobe Substance 3D Stager  
• Exterior Scene 3D Model Render Composite Adobe Substance 3D Stager  
• Set Scene Scale in Adobe Substance 3D Stager  
• Export Material, Object and Depth Masks from 3D Stager to Photoshop  
• Create an HDRI from a photo  

Blender and fSpy

• HDRI Background Blender
• Photo Matching with fSpy
• Place 3D Model in 2D Photo Blender
• Reflections, Shadows, and Materials for fSpy Compositing
• How to Rotate HDRI Environment Texture

Blender OBJ Handling

• Import OBJ in Blender  
• Fix Broken Texture Links in Blender  
• Blender Export Unit Scale  

Video Guides for fSpy and Blender

Video Guides for Adobe Substance 3D Stager

Grading Rubric