Saturday, February 18, 2012
Multijello Simulation
Saturday, February 4, 2012
Pathtracer Time
Here's my project abstract:
Both path tracing and bidirectional scatter distribution functions (BSDFs) are ideas that have existed within the field of computer graphics for many years and have seen numerous implementations in a variety of rendering pack- ages. Similarly, creating images of convincing plant life is a technical challenge that a host of solutions now exist for. However, achieving dynamic plant effects such as the change of a plants coloring during the transition from summer to fall is a task that to date has been mostly been accomplished using procedural techniques and various compositing tricks.
The goal of this project is to build a path tracing based renderer that is designed specifically with the intent to facil- itate achieving dynamic plant effects with a more physically based approach by introducing a new time component to the existing bidirectional scatter distribution model. By allowing BSDFs to vary over not only space but also over time, plant effects such as leaf decay could be achieved through shaders with appearances that are driven through physically based mathematical models instead of procedural techniques. In other words, this project has two main prongs: develop a robust path tracer with at least basic functionality, and then develop and implement a time- dependent BSDF model within the path tracer.
...and here's some background that I wrote up for my proposal...
1. INTRODUCTION
Efficiently rendering convincing images with direct and indirect lighting has been a major problem in the field of computer graphics since the field’s very inception, as con- vincingly realistic graphics in games and movies depends upon lighting that can accurately mimic that of reality. Known generally as global illumination, the indirect light- ing problem has in the past decade seen a number of solu- tions such as path tracing and photon mapping that can generate convincingly realistic images with reasonable computational resource consumption and efficiency.
One of the key discoveries that enabled the development of modern global illumination techniques is the concept of Bidirectional Scattering Distribution Functions, or BSDFs. Developed as a superset and generalization of two other concepts known as bidirectional reflectance distribution functions (BRDFs) and bidirectional transmittance distribu- tion functions (BTDFs), BSDF is a general mathematical function that describes how light is scattered by a certain surface, given the material properties of the surface. BSDFs are useful today for representing the material properties of an object at a single point in time; however, in reality mate- rial properties can change and morph over time, as exem- plified by the natural phenomena of leaf color changes from summer to fall.
This project will attempt to build a prototype of a path tracing renderer with a BSDF model modified to include an additional time component to allow for material properties to change over time in a way representative of how material properties change over time in reality. The hope is that
such a renderer will prove to be useful in future attempts to recreate natural phenomena using physically based models, such as leaf decay.
...and the actual goal of the project...
1.1 Design Goals
The project’s goal is to develop a reasonably robust and efficient path tracing renderer with a BSDF model modified to include an additional time component. In order to prove the feasibility of such a modified BSDF model, the end goal is to be able to use the renderer to produce images of plant life with changing surface material properties, in addition to standard test image such as Cornell Box tests that validate the functionality of the underlying basic path tracer.
...and finally, what I'm hoping I'll actually be able to produce at the end of this independent study:
1.2 Projects Proposed Features and Functionality
The proposed renderer should allow a user to load a sce- ne with an arbitrary number of lights, materials, and objects and render out a realistic, global illumination based render. The renderer should be able to render implicitly defined objects such as spheres and cubes in addition to meshes defined in the .obj format. The renderer should also allow users to specify changes in object/light/camera transfor- mations over time in addition to changes in materials and BSDFs over time and render out a series of frames showing the scene at various points in time. A graphical interface would be a nice additional feature, but is not a priority of this project.
I'll be posting at least weekly updates to this blog showing my progress. In my next post, I'll go over some of the papers and sources Joe gave me to look over and explain some of the basic mechanics of how a pathtracer works. Apologies for the casual reader for this particular post being extremely text heavy; I shall have images to show soon!
Thursday, December 22, 2011
Basic Raytracer and Fun with KD-Trees
The assignment is actually pretty straightforward: implement a recursive, direct lighting only raytracer with support for Blinn-Phong shading and support for basic primitive shapes (spheres, boxes, and polygon extrusions). In other words, pretty much a barebones implementation of the original Turner Whitted raytracing paper.
I've been planning on writing a global-illumination renderer (perhaps based on pathtracing or photon mapping?) for a while now, so my own personal goal with the raytracer project was to use it as a testbed for some things that I know I will need for my GI renderer project. With that in mind, I decided from the start that my raytracer should support rendering OBJ meshes and include some sort of acceleration system for OBJ meshes.
The idea behind the acceleration system goes like this: in the raytracer, one obviously needs to cast rays into the scene and track how they bounce around to get a final image. That means that every ray needs to have intersection tests against objects in the scene in order to determine what ray is hitting what object. Intersection testing against mathematically defined primitives is simple, but OBJ meshes present more of a problem; since an OBJ mesh is composed of a bunch of triangles or polygons, the naive way to intersection test against an OBJ mesh is to check for ray intersections with every single polygon inside of the mesh. This naive approach can get extremely expensive extremely quickly, so a better approach would be to use some sort of spatial data structure to quickly figure out what polygons are within the vicinity of the ray and therefore need intersection testing.
After talking with Joe and trawling around on Wikipedia for a while, I picked a KD-Tree as my spatial data structure for accelerated mesh intersection testing. I won't go into the details of how KD-Trees work, as the Wikipedia article does a better job of it than I ever could. I will note, however, that the main resources I ended up pulling information from while looking up KD-Tree stuff are Wikipedia, Jon McCaffrey's old CIS565 slides on spatial data structure, and the fantastic PBRT book that Joe pointed me towards.
Implementing the KD-Tree for the first time took me the better part of two weeks, mainly because I was misunderstanding how the surface area splitting heuristic works. Unfortunately, I probably can't post actual code for my raytracer, since this is a class assignment that will repeated in future incarnations of the class. However, I can show images!
The KD-Tree meant I could render meshes in a reasonable amount of time, so I rendered an airplane:
The airplane took about a minute or so to render, which got me wondering how well my raytracer would work if I threw the full 500000+ poly Stanford Dragon at it. This render took about five or six minutes to finish (without the KD-Tree in place, this same image takes about 30 minutes to render):
Of course, the natural place to go after one dragon is three dragons. Three dragons took about 15 minutes to render, which is pretty much exactly a three-fold increase over one dragon. That means my renderer's performance scales more or less linearly, which is good.
For fun, and because I like space shuttles, here is a space shuttle. Because the space shuttle has a really low poly count, this image took under a minute to render:
For reflections, I took a slightly different approach from the typical recursive method. The normal recursive approach to a raytracer is to begin with one ray, and trace that ray completely through recursion to its recursion depth limit before moving onto the next pixel and ray. However, such an approach might not actually be idea in a GI renderer. For example, from what I understand, in pathtracing a better raytracing approach is to actually trace everything iteratively; that is, trace the first bounce for all rays and store where the rays are, then trace the second bounce for all rays, then the third, and so on and so forth. Basically, such an approach allows one to set an unlimited trace depth and just let the renderer trace and trace and trace until one stops the renderer, but the corresponding cost of such a system is slightly higher memory usage, since ray positions need to be stored for the previous iteration.
Adding reflections did impact my render times pretty dramatically. I have a suspicion that both my intersection code and my KD-Tree are actually far from ideal, but I'll have to look at that later. Here's a test with reflections with the airplane:
...and here is a test with three reflective dragons. This image took foooorrreeevvveeeerrrr to render.... I actually do not know how long, as I let it run overnight:
I also added support for multiple lights with varying color support:
Here are some more images rendered with my raytracer:
As an amusing parting note, here is the first proper image I ever got out of my raytracer. Awww yeeeaaahhhhhh:
Friday, October 14, 2011
A Volumetric Renderer for Rendering Volumes
...or you can make pretty clouds.
One of the first things I ever tried to make when I first was introduced to Maya was a cloud. I quickly learned that there simply is no way to get a nice fluffy cloud using polygonal modeling techniques. Ever since then I've kept the idea of making clouds parked in the back of my head, so when we were assigned the task of writing a volumetric renderer that could produce clouds, obviously I was pretty excited.
At least in the case of my renderer, there is a fourth way to deal with the artifacting: instead of preloading the voxel buffer with values from Perlin noise, why not just get rid of the notion of a discretized voxel buffer altogether and directly sample the Perlin noise function when raymarching? The result would indeed be a perfectly smooth, artifact free render, but the computational cost is extraordinarily high compared to using a voxel buffer.
So! The volumetric renderer was definitely a fun assignment, and now I've got a cool way to make clouds! Hopefully I'll be able to integrate this renderer into some future projects!
Thursday, October 6, 2011
Building/Installing Alembic for OSX
Alembic is a new open-source computer graphics interchange framework being developed by Sony Imageworks and ILM. The basic idea is that moving animation rigs and data and whatnot between packages can be a very tricky procedure since every package has its own way to handle animation, so why not bake out all of that animation data into a common interchange format? So, for example, instead of having to import a Maya rig into Houdini, you could rig/animate in Maya, bake out the animation to Alembic, bring that into Houdini to conduct simulations with, and then bake out the animation and bring it back into Maya. This is a trend that a number of studios including Sony, ILM, Pixar, etc. have been moving toward for some time.
I’ve been working on a project lately (more on that later) that makes use of Alembic, but I found that the only way to actually get Alembic is to build it from source. That’s not terribly difficult, but there’s not really any guides out there for folks who might not be as comfortable with building things from source. So, I wrote up a little guide!
Here’s how to build Alembic for OSX (10.6 and 10.7):
1. Alembic has a lot of dependencies that can be annoying to build/install by hand, so we’re going to cheat and use Homebrew. To install Homebrew:
/usr/bin/ruby -e "$(curl -fsSL https://raw.github.com/gist/323731)"
2. Get/build/install cmake with Homebrew:
brew install cmake
3. Get/build/install Boost with Homebrew:
brew install Boost
4. Get/build/install HDF5 with Homebrew:
brew install HDF5
HDF5 has to make install itself, so this may take some time to run. Be patient.
5. Unfortunately, ilmbase is not a standard UNIX package, so we can’t use Homebrew. We’ll have to build ilmbase manually. Get it from:
http://download.savannah.nongnu.org/releases/openexr/ilmbase-1.0.2.tar.gz
Untar/unzip to a readily accessible directory and cd into the ilmbase directory. Run:
./configure
After that finishes, we get to the annoying part: ilmbase by default makes use of a deprecated GCC 3.x compiler flag called Wno-long-double, which no longer exists in GCC 4.x. We’ll have to deactivate this flag in ilmbase’s makefiles manually in order to build correctly. In each and every of the following files:
/Half/Makefile
/HalfTest/Makefile
/Iex/Makefile
/IexTest/Makefile
/IlmThread/Makefile
/Imath/Makefile
/ImathTest/Makefile
Find the following line:
CXXFLAGS = -g -O2 -D_THREAD_SAFE -Wno-long-double
and delete it from the makefile.
Once all of that is done, you can make and then make install like normal.
Now move the ilmbase folder to somewhere safe. Something like /Developer/Dependencies might work, or alternatively /usr/include/
6. Time to actually build Alembic. Get the source tarball from:
http://code.google.com/p/alembic/wiki/GettingAlembic
Untar/unzip into a readily accessible directory and then create a build root directory parallel to the source root you just created:
mkdir ALEMBIC_BUILD
The build root doesn’t necesarily have to be parallel, but here we’ll assume it is for the sake of consistency.
7. Now cd into ALEMBIC_BUILD and bootstrap the Alembic build process. The bootstrap script is a python script:
python ../[Your Alembic Source Root]/build/bootstrap/alembic_bootstrap.py
The script will ask you for a whole bunch of paths:
For “Please enter the location where you would like to build the Alembic”, enter the full path to your ALEMBIC_BUILD directory.
For “Enter the path to lexical_cast.hpp:”, enter the full path to your lexical_cast.hpp, which should be something like /usr/local/include/boost/lexical_cast.hpp
For “Enter the path to libboost_thread:”, your path should be something like /usr/local/lib/libboost_thread-mt.a
For “Enter the path to zlib.h”, your path should be something like /usr/include/zlib.h
For “Enter the path to libz.a”, we’re actually not going to link against libz.a. We’ll be using libz.dylib instead, which should be at something like /usr/lib/libz.dylib
For “Enter the path to hdf5.h”, your path should be something like /usr/local/include/hdf5.h
For “Enter the path to libhdf5.a”, your path should be something like /usr/local/Cellar/hdf5/1.x.x/lib/libhdf5.a (unless you did not use Homebrew for installing hdf5, in which case libhdf5.a will be in whatever lib directory you installed it to)
For “Enter the path to ImathMath.h”, your path should be something like /usr/local/include/OpenEXR/ImathMath.h
For “Enter the path to libImath.a”, your path should be something like /usr/local/lib/libImath.a
Now hit enter, and let the script finish running!
8. If everything is bootstrapped correctly, you can now make. This will take a while, be patient.
9. Once the make finishes successfully, run make test to check for any problems.
10. Finally, run make install, and we’re done! Alembic should install to something like /usr/bin/alembic-1.x.x/.
Monday, September 5, 2011
Installing Numpy for Maya 2012 64-bit on OSX 10.7
However, OSX 10.7 comes with Python 2.7.x, so a few extra steps are needed:
For Maya 2012 64-bit:
1. OSX 10.7 comes with Python 2.7.x, but we need 2.6.x, so install 2.6.x using the official installer from here: http://www.python.org/ftp/python/2.6.6/python-2.6.6-macosx10.3.dmg
2. Since we're using 64-bit Maya with 64-bit Python, we'll need a 64-bit build of Numpy. The official version distributed on scipy.numpy.org is 32-bit, so we'll need a 64-bit build. Thankfully, there is an unofficial 64-bit build in the form of the Scipy Superpack for Mac OSX. Even though we're on OSX 10.7, we'll want the OSX 10.6 variety of the script since the OSX 10.7 is Python 2.7.x dependent:
3. Go to where the script downloaded to and in Terminal:
chmod +x superpack_10.6_2011.07.10.sh
./superpack_10.6_2011.07.10.sh
If you don't already have GNU Fortran, make sure to answer 'yes' when the script asks.
4. Once the script is done installing, in Terminal:
ls /Library/Python/2.7/site-packages/ | grep numpy
You should get something like: numpy-2.0.0.dev_b5cdaee_20110710-py2.6-macosx-10.6-universal.egg
Even though we installed Numpy for Python 2.6.x, on Lion it installs to the 2.7 folder for some reason. No matter, you can either leave it there or move it to 2.6.
5. Go to /Users/[your username]/Library/Preferences/Autodesk/maya/2012-x64/scripts
6. If you don't have a file named userSetup.py, make one and open it in a text editor. If yes, open it.
7. Add these lines to the file:
import os
import sys
sys.path.append('/Library/Python/2.7/site-packages/[thing you got from step 4]')
8. Sidenote: installing Python 2.6.x sets your default OSX Python to 2.6.x, but if you want to go back to 2.7.x, just edit your ~/.bash_profile and remove these lines:
PATH="/Library/Frameworks/Python.framework/Versions/2.6/bin:${PATH}"
export PATH
....and you should be done! In Maya, you should be able to just use
import numpy and you'll be good to go!
Thursday, September 1, 2011
Why Backups are Important
Over the summer, I started making a little scene based off of the GH House Challenge from RonenBekerman.com, partially as a way to learn Vray and partially just for fun. I was working off of my laptop for the entire project, since I was in California at the time and didn't have access to more powerful machines at home. Being out in California for the summer, I brought as little stuff with me as possible.
One of the things I decided to leave home was my backup Time Machine drive. "Oh, I won't need this over the summer, what are the odds of file corruption or harddrive issues anyhow? I'll be fine", I thought to myself.
Which means, of course, that halfway through the summer a bunch of my files got corrupted and were therefore lost forever, and of course that block of lost data included my in-progress GH House project. NEVER ASSUME THAT YOU DO NOT NEED BACKUP.
What follows are some random in-progress renders that survived through being in posts I made to Facebook and Tumblr.
Here are a series of small in-progress renders showing shading and lighting tests:
I also started playing with some ideas for the interior:
...and finally, some larger in-progress renders. These renders represent where the project was when I lost all of the data:
In the end, the fact that I lost the project isn't as important as the fact that I learned quite a lot from tinkering with this project. However, losing all of the data for this project was definitely a major bummer. But, lesson learned: BACK UP ALL THE TIME.
Sunday, May 8, 2011
Animation Final Project Stills
Thursday, May 5, 2011
Why cd when you can go?
So in a standard *nix bash CLI, you have you're typical cd command. We all know how to use cd.
But have you ever accidentally cd'd a file? "cd /stuff/blah.txt" makes no sense and just gets you a "Not a directory" error. So then you have to backtrack and use vim or emacs or nano or whatever... blarg. If you're using emacs or vim, you like efficiency and you've already lost efficiency by wasting a perfectly good moment trying to cd into a file.
Enter the 'go' command!
Add this bit of code to your .bashrc file and replace $EDITOR with the CLI text editor of your choice:
go()
{
if [ -f $1 ]
then
$EDITOR $1
else
cd $1 && ls
fi
}
and you're all done! Now when you go to a directory, bash will cd and when you go to a file, bash will fire up vim or emacs or whatever.
As a side note, it might be fun to modify the 'go' command even further to automatically launch actions for other filetypes as well, like run javac whenever a .java is encountered or launch .jar files or run gcc or make whenever C++ makefiles are encountered. That's left as an exercise to the reader though ;)
Friday, April 29, 2011
Chairs…. now with Balloons!
A few weeks back I decided to try out overhauling one of my previous projects with VRay. I figured the chairs project would be fun, so...
Wwwwaaaayyyy prettier than before. I really like VRay, although I feel that setting it up is a bit more involved than MentalRay is. Still haven't made too many inroads with Photorealistic Renderman yet, so I can't comment on that quite yet.
Oh, also, as you can see, I added balloons too. I like balloons.
I decided to add balloons after seeing an article on RonenBerkerman.com a while back about shading balloons using VRay in 3DSMax. I'm using VRay in Maya, however, so I had to figure out how to recreate the shader in Maya's Hypershade. The shader network winded up looking like this:
It's *almost* fully procedural, minus that one black and white ramp image that I wound up using for a lot of things. Replacing that image with a procedural ramp shader to make the entire shader fully procedural probably wouldn't be very hard at all, but I got lazy :p
I was originally going to post breakdowns of all of the settings for each node in the shading network as well, but again, I'm lazy. So instead, here's the shader in a Maya .ma file!
A few more renders:
As soon as my last finals are over in about a week, I'll catch up with my backlog of things that need to be posted. I'm planning on posting a series of posts introducing some concepts in graphics programming that I learned in CIS277 this semester. I'm not going to go super duper in depth (for that, take CIS277! Dr. Norm Badler is an awesome professor.), but at the very least I'll highlight some of the cooler things I learned. That class was really neat, we wound up writing our own 2D animation software from scratch and our final team project assignment was to build our own 3D modeling software. Basically, we made mini-Maya. My team (Adam Mally, Stewart Hills, and me) got some really neat stuff to work.
Speaking of Stewart, Stewart and I both will be interning at Pixar this summer! We got into their Pixar Undergraduate Program... uh... program. PUP essentially is a 10 week crash course on Pixar's production pipeline, so we'll be learning about everything from modeling to simulation to using Photorealistic Renderman. I'm really looking forward to that. :D
Monday, March 28, 2011
VRay Tree
I've been continuing my tree experiments using VRay. VRay's Sun&Sky system is much nicer than Mentalray's system and VRay has this crazy useful two-sided material for flat two dimensional planes... such as leaves. Here's what I managed to cook up over the weekend:
I'm still working out some kinks in my new tree workflow. I'll post a full breakdown in a few days.
Saturday, March 19, 2011
Mo’ Tree (and Grass) Experimenting
The grass is just Maya fur with a custom shader (woot subsurface scatter!) and the tree is modeled after a Japanese Maple and was made the same way as the one I posted a few days back.
Back to exploring!
Friday, March 18, 2011
Things I'm Bad At...
So I'm going to practice until I get better!
For the past few days I've been playing with using a limited color palette. So... here's what I made.
Blah. Blaarrrggggg. I'm not happy with it at all. But... it's where I'm starting from. So... let this be a base line. Hopefully I'll learn quickly...
Thursday, March 17, 2011
Autumn Tree!
I've found that using XFrog's plant modeler program is my favorite way to create base meshes for plants. It sure as heck beats hand modeling all of those leaves... Speaking of models and leaves, the method I've settled on for tree leaves is to just use planes where the leaves should go and then make the planes look like leaves through alpha mapping.
Anyhoo, here's where I managed to get tonight:
The displacement on the bark is really really weird right now and the color of the leaves is weird too. I think I'm going to try subsurface scattering on the leaves... see if that helps. More updates later...
Friday, March 11, 2011
Demoreel Update!
Breakdown is here (PDF).
So why the updated reel? Interviewing with Paul and chatting with the other two people from Pixar that visited Penn was a really interesting. Paul had a lot of suggestions for my work during our interview, so I've decided to go ahead and incorporate a lot of the changes that Paul suggested.
So changelog time!
Overall Changes:
-New song! The new song is an instrumental version of Baby Universe from the We Love Katamari OST. As usual, the version of the reel I'm actually sending out to studios for internships has not music, though.
-I've replaced "Postcards from Prague" with a new project, "Chairs"
-Shuffled around the order of some pieces.
Apples:
-Recomposited with slightly better z-depth using a new depth of field plugin for After Effects I found called Frischluft Lenscare. Apparently Alex Roman uses it, and if Alex Roman uses it, then gosh golly I'd better give it a try. Hahaha.
-Slightly tweaked color grading
-There's a little more footage of the second shot of the apples bouncing than there was in the previous reel
Hermit Crab:
-Recomposited with tweaked ambient occlusion in the turntable. Paul pointed out that there were some odd light leaking issues on the underside of the shell's opening, so I've increased the intensity of the AO there to try to make it a bit darker.
-Fixed a small problem with the transition between the Untextured Lambert and the Fully Textured parts of the turntable
White Room:
-Every shot's depth of field has been redone using Frischluft Lenscare
-The first shot of the underside of the stairs was lengthened, rerendered, recomposited, and re color graded.
-The second shot has new color grading and altered AO.
-The third shot was rerendered with new contrast settings and re color gaded.
Clock:
-Paul pointed out that a major flaw with the clock was that the highlight on the glass washed out everything under the glass, so I fixed that by changing the reflective properties of the glass slightly and giving the glass more of a curve to break up the highlight
-Turntables were sped up to help the reel's overall pacing
-Textures on the clock face are sharper than before
Raincoat Girls:
-Turntable was rerendered to get rid of the light blue band that appeared partway through the turntables in the previous reel
-Environment shots were re color graded